Apr 12 12:24:05 user nova-compute[71321]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Apr 12 12:24:08 user nova-compute[71321]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=71321) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=71321) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=71321) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 12 12:24:08 user nova-compute[71321]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:24:08 user nova-compute[71321]: INFO nova.virt.driver [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] Loading compute driver 'libvirt.LibvirtDriver'
Apr 12 12:24:08 user nova-compute[71321]: INFO nova.compute.provider_config [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] Acquiring lock "singleton_lock" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] Acquired lock "singleton_lock" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] Releasing lock "singleton_lock" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] Full set of CONF: {{(pid=71321) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] ******************************************************************************** {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] Configuration options gathered from: {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] ================================================================================ {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] allow_resize_to_same_host      = True {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] arq_binding_timeout            = 300 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] backdoor_port                  = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] backdoor_socket                = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] block_device_allocate_retries  = 300 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] block_device_allocate_retries_interval = 5 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cert                           = self.pem {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] compute_monitors               = [] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] config_dir                     = [] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] config_drive_format            = iso9660 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] config_source                  = [] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] console_host                   = user {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] control_exchange               = nova {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cpu_allocation_ratio           = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] daemon                         = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] debug                          = True {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] default_access_ip_network_name = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] default_availability_zone      = nova {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] default_ephemeral_format       = ext4 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] default_schedule_zone          = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] disk_allocation_ratio          = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] enable_new_services            = True {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] enabled_apis                   = ['osapi_compute'] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] enabled_ssl_apis               = [] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] flat_injected                  = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] force_config_drive             = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] force_raw_images               = True {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] graceful_shutdown_timeout      = 5 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] heal_instance_info_cache_interval = 60 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] host                           = user {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] instance_build_timeout         = 0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] instance_delete_interval       = 300 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] instance_format                = [instance: %(uuid)s]  {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] instance_name_template         = instance-%08x {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] instance_usage_audit           = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] instance_usage_audit_period    = month {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] internal_service_availability_zone = internal {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] key                            = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] live_migration_retry_count     = 30 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] log_config_append              = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] log_dir                        = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] log_file                       = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] log_options                    = True {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] log_rotate_interval            = 1 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] log_rotate_interval_type       = days {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] log_rotation_type              = none {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] long_rpc_timeout               = 1800 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] max_concurrent_builds          = 10 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] max_concurrent_live_migrations = 1 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] max_concurrent_snapshots       = 5 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] max_local_block_devices        = 3 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] max_logfile_count              = 30 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] max_logfile_size_mb            = 200 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] maximum_instance_delete_attempts = 5 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] metadata_listen                = 0.0.0.0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] metadata_listen_port           = 8775 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] metadata_workers               = 3 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] migrate_max_retries            = -1 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] mkisofs_cmd                    = genisoimage {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] my_ip                          = 10.0.0.210 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] network_allocate_retries       = 0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] osapi_compute_listen_port      = 8774 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] osapi_compute_unique_server_name_scope =  {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] osapi_compute_workers          = 3 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] password_length                = 12 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] periodic_enable                = True {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] periodic_fuzzy_delay           = 60 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] pointer_model                  = ps2mouse {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] preallocate_images             = none {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] publish_errors                 = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] pybasedir                      = /opt/stack/nova {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] ram_allocation_ratio           = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] rate_limit_burst               = 0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] rate_limit_except_level        = CRITICAL {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] rate_limit_interval            = 0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] reboot_timeout                 = 0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] reclaim_instance_interval      = 0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] record                         = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] reimage_timeout_per_gb         = 20 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] report_interval                = 10 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] rescue_timeout                 = 0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] reserved_host_cpus             = 0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] reserved_host_disk_mb          = 0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] reserved_host_memory_mb        = 512 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] reserved_huge_pages            = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] resize_confirm_window          = 0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] resize_fs_using_block_device   = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] resume_guests_state_on_host_boot = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] rpc_response_timeout           = 60 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] run_external_periodic_tasks    = True {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] running_deleted_instance_action = reap {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] running_deleted_instance_poll_interval = 1800 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] running_deleted_instance_timeout = 0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] scheduler_instance_sync_interval = 120 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] service_down_time              = 60 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] servicegroup_driver            = db {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] shelved_offload_time           = 0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] shelved_poll_interval          = 3600 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] shutdown_timeout               = 0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] source_is_ipv6                 = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] ssl_only                       = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] state_path                     = /opt/stack/data/nova {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] sync_power_state_interval      = 600 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] sync_power_state_pool_size     = 1000 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] syslog_log_facility            = LOG_USER {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] tempdir                        = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] timeout_nbd                    = 10 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] transport_url                  = **** {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] update_resources_interval      = 0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] use_cow_images                 = True {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] use_eventlog                   = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] use_journal                    = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] use_json                       = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] use_rootwrap_daemon            = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] use_stderr                     = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] use_syslog                     = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vcpu_pin_set                   = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vif_plugging_is_fatal          = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vif_plugging_timeout           = 0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] virt_mkfs                      = [] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] volume_usage_poll_interval     = 0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] watch_log_file                 = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] web                            = /usr/share/spice-html5 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_concurrency.disable_process_locking = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api.auth_strategy              = keystone {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api.compute_link_prefix        = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api.dhcp_domain                = novalocal {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api.enable_instance_password   = True {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api.glance_link_prefix         = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api.instance_list_per_project_cells = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api.list_records_by_skipping_down_cells = True {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api.local_metadata_per_cell    = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api.max_limit                  = 1000 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api.metadata_cache_expiration  = 15 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api.neutron_default_tenant_id  = default {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api.use_forwarded_for          = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api.use_neutron_default_nets   = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api.vendordata_dynamic_targets = [] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api.vendordata_jsonfile_path   = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cache.backend                  = dogpile.cache.memcached {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cache.backend_argument         = **** {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cache.config_prefix            = cache.oslo {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cache.dead_timeout             = 60.0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cache.debug_cache_backend      = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cache.enable_retry_client      = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cache.enable_socket_keepalive  = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cache.enabled                  = True {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cache.expiration_time          = 600 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cache.hashclient_retry_attempts = 2 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cache.memcache_dead_retry      = 300 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cache.memcache_password        =  {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cache.memcache_pool_maxsize    = 10 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cache.memcache_sasl_enabled    = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cache.memcache_username        =  {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cache.proxies                  = [] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cache.retry_attempts           = 2 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cache.retry_delay              = 0.0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cache.socket_keepalive_count   = 1 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cache.socket_keepalive_idle    = 1 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cache.socket_keepalive_interval = 1 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cache.tls_allowed_ciphers      = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cache.tls_cafile               = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cache.tls_certfile             = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cache.tls_enabled              = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cache.tls_keyfile              = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cinder.auth_section            = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cinder.auth_type               = password {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cinder.cafile                  = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cinder.certfile                = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cinder.collect_timing          = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cinder.cross_az_attach         = True {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cinder.debug                   = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cinder.endpoint_template       = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cinder.http_retries            = 3 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cinder.insecure                = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cinder.keyfile                 = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cinder.os_region_name          = RegionOne {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cinder.split_loggers           = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cinder.timeout                 = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] compute.cpu_dedicated_set      = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] compute.cpu_shared_set         = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] compute.image_type_exclude_list = [] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] compute.max_concurrent_disk_ops = 0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] compute.max_disk_devices_to_attach = -1 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] compute.resource_provider_association_refresh = 300 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] compute.shutdown_retry_interval = 10 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] conductor.workers              = 3 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] console.allowed_origins        = [] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] console.ssl_ciphers            = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] console.ssl_minimum_version    = default {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] consoleauth.token_ttl          = 600 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cyborg.cafile                  = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cyborg.certfile                = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cyborg.collect_timing          = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cyborg.connect_retries         = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cyborg.connect_retry_delay     = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cyborg.endpoint_override       = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cyborg.insecure                = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cyborg.keyfile                 = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cyborg.max_version             = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cyborg.min_version             = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cyborg.region_name             = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cyborg.service_name            = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cyborg.service_type            = accelerator {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cyborg.split_loggers           = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cyborg.status_code_retries     = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cyborg.status_code_retry_delay = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cyborg.timeout                 = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] cyborg.version                 = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] database.backend               = sqlalchemy {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] database.connection            = **** {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] database.connection_debug      = 0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] database.connection_parameters =  {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] database.connection_recycle_time = 3600 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] database.connection_trace      = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] database.db_inc_retry_interval = True {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] database.db_max_retries        = 20 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] database.db_max_retry_interval = 10 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] database.db_retry_interval     = 1 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] database.max_overflow          = 50 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] database.max_pool_size         = 5 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] database.max_retries           = 10 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] database.mysql_enable_ndb      = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] database.mysql_wsrep_sync_wait = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] database.pool_timeout          = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] database.retry_interval        = 10 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] database.slave_connection      = **** {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] database.sqlite_synchronous    = True {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api_database.backend           = sqlalchemy {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api_database.connection        = **** {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api_database.connection_debug  = 0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api_database.connection_parameters =  {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api_database.connection_recycle_time = 3600 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api_database.connection_trace  = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api_database.db_inc_retry_interval = True {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api_database.db_max_retries    = 20 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api_database.db_max_retry_interval = 10 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api_database.db_retry_interval = 1 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api_database.max_overflow      = 50 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api_database.max_pool_size     = 5 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api_database.max_retries       = 10 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api_database.mysql_enable_ndb  = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api_database.pool_timeout      = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api_database.retry_interval    = 10 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api_database.slave_connection  = **** {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] api_database.sqlite_synchronous = True {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] devices.enabled_mdev_types     = [] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] ephemeral_storage_encryption.enabled = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] glance.api_servers             = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] glance.cafile                  = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] glance.certfile                = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] glance.collect_timing          = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] glance.connect_retries         = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] glance.connect_retry_delay     = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] glance.debug                   = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] glance.default_trusted_certificate_ids = [] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] glance.enable_certificate_validation = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] glance.enable_rbd_download     = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] glance.endpoint_override       = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] glance.insecure                = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] glance.keyfile                 = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] glance.max_version             = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] glance.min_version             = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] glance.num_retries             = 3 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] glance.rbd_ceph_conf           =  {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] glance.rbd_connect_timeout     = 5 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] glance.rbd_pool                =  {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] glance.rbd_user                =  {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] glance.region_name             = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] glance.service_name            = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] glance.service_type            = image {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] glance.split_loggers           = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] glance.status_code_retries     = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] glance.status_code_retry_delay = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] glance.timeout                 = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] glance.verify_glance_signatures = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] glance.version                 = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] guestfs.debug                  = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] hyperv.config_drive_cdrom      = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] hyperv.config_drive_inject_password = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] hyperv.enable_instance_metrics_collection = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] hyperv.enable_remotefx         = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] hyperv.instances_path_share    =  {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] hyperv.iscsi_initiator_list    = [] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] hyperv.limit_cpu_features      = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] hyperv.power_state_check_timeframe = 60 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] hyperv.use_multipath_io        = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] hyperv.volume_attach_retry_count = 10 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] hyperv.vswitch_name            = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] mks.enabled                    = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] image_cache.manager_interval   = 2400 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] image_cache.precache_concurrency = 1 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] image_cache.remove_unused_base_images = True {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] image_cache.subdirectory_name  = _base {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] ironic.api_max_retries         = 60 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] ironic.api_retry_interval      = 2 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] ironic.auth_section            = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] ironic.auth_type               = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] ironic.cafile                  = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] ironic.certfile                = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] ironic.collect_timing          = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] ironic.connect_retries         = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] ironic.connect_retry_delay     = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] ironic.endpoint_override       = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] ironic.insecure                = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] ironic.keyfile                 = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] ironic.max_version             = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] ironic.min_version             = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] ironic.partition_key           = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] ironic.peer_list               = [] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] ironic.region_name             = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] ironic.serial_console_state_timeout = 10 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] ironic.service_name            = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] ironic.service_type            = baremetal {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] ironic.split_loggers           = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] ironic.status_code_retries     = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] ironic.status_code_retry_delay = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] ironic.timeout                 = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] ironic.version                 = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] key_manager.fixed_key          = **** {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] barbican.barbican_api_version  = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] barbican.barbican_endpoint     = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] barbican.barbican_endpoint_type = public {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] barbican.barbican_region_name  = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] barbican.cafile                = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] barbican.certfile              = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] barbican.collect_timing        = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] barbican.insecure              = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] barbican.keyfile               = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] barbican.number_of_retries     = 60 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] barbican.retry_delay           = 1 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] barbican.send_service_user_token = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] barbican.split_loggers         = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] barbican.timeout               = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] barbican.verify_ssl            = True {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] barbican.verify_ssl_path       = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] barbican_service_user.auth_section = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] barbican_service_user.auth_type = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] barbican_service_user.cafile   = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] barbican_service_user.certfile = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] barbican_service_user.collect_timing = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] barbican_service_user.insecure = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] barbican_service_user.keyfile  = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] barbican_service_user.split_loggers = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] barbican_service_user.timeout  = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vault.approle_role_id          = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vault.approle_secret_id        = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vault.cafile                   = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vault.certfile                 = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vault.collect_timing           = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vault.insecure                 = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vault.keyfile                  = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vault.kv_mountpoint            = secret {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vault.kv_version               = 2 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vault.namespace                = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vault.root_token_id            = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vault.split_loggers            = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vault.ssl_ca_crt_file          = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vault.timeout                  = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vault.use_ssl                  = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] keystone.cafile                = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] keystone.certfile              = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] keystone.collect_timing        = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] keystone.connect_retries       = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] keystone.connect_retry_delay   = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] keystone.endpoint_override     = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] keystone.insecure              = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] keystone.keyfile               = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] keystone.max_version           = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] keystone.min_version           = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] keystone.region_name           = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] keystone.service_name          = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] keystone.service_type          = identity {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] keystone.split_loggers         = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] keystone.status_code_retries   = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] keystone.status_code_retry_delay = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] keystone.timeout               = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] keystone.version               = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.connection_uri         =  {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.cpu_mode               = custom {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: WARNING oslo_config.cfg [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.cpu_power_governor_high = performance {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.cpu_power_governor_low = powersave {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.cpu_power_management   = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.device_detach_attempts = 8 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.device_detach_timeout  = 20 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.disk_cachemodes        = [] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.disk_prefix            = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.enabled_perf_events    = [] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.file_backed_memory     = 0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.gid_maps               = [] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.hw_disk_discard        = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.hw_machine_type        = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.images_rbd_glance_store_name =  {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.images_rbd_pool        = rbd {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.images_type            = default {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.images_volume_group    = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.inject_key             = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.inject_partition       = -2 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.inject_password        = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.iscsi_iface            = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.iser_use_multipath     = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.live_migration_bandwidth = 0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.live_migration_downtime = 500 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.live_migration_inbound_addr = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.live_migration_permit_post_copy = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.live_migration_scheme  = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.live_migration_timeout_action = abort {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.live_migration_tunnelled = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: WARNING oslo_config.cfg [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Apr 12 12:24:08 user nova-compute[71321]: live_migration_uri is deprecated for removal in favor of two other options that
Apr 12 12:24:08 user nova-compute[71321]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Apr 12 12:24:08 user nova-compute[71321]: and ``live_migration_inbound_addr`` respectively.
Apr 12 12:24:08 user nova-compute[71321]: ).  Its value may be silently ignored in the future.
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.live_migration_with_native_tls = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.max_queues             = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.nfs_mount_options      = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.num_memory_encrypted_guests = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.num_pcie_ports         = 0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.pmem_namespaces        = [] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.quobyte_client_cfg     = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.rbd_secret_uuid        = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.rbd_user               = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.remote_filesystem_transport = ssh {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.rescue_image_id        = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.rescue_kernel_id       = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.rescue_ramdisk_id      = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.rx_queue_size          = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.smbfs_mount_options    =  {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.snapshot_compression   = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.snapshot_image_format  = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.sparse_logical_volumes = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.swtpm_enabled          = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.swtpm_group            = tss {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.swtpm_user             = tss {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.sysinfo_serial         = unique {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.tx_queue_size          = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.uid_maps               = [] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.use_virtio_for_bridges = True {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.virt_type              = kvm {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.volume_clear           = zero {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.volume_clear_size      = 0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.volume_use_multipath   = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.vzstorage_cache_path   = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.vzstorage_mount_user   = stack {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] neutron.auth_section           = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] neutron.auth_type              = password {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] neutron.cafile                 = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] neutron.certfile               = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] neutron.collect_timing         = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] neutron.connect_retries        = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] neutron.connect_retry_delay    = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] neutron.default_floating_pool  = public {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] neutron.endpoint_override      = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] neutron.extension_sync_interval = 600 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] neutron.http_retries           = 3 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] neutron.insecure               = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] neutron.keyfile                = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] neutron.max_version            = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] neutron.min_version            = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] neutron.ovs_bridge             = br-int {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] neutron.physnets               = [] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] neutron.region_name            = RegionOne {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] neutron.service_metadata_proxy = True {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] neutron.service_name           = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] neutron.service_type           = network {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] neutron.split_loggers          = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] neutron.status_code_retries    = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] neutron.status_code_retry_delay = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] neutron.timeout                = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] neutron.version                = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] notifications.bdms_in_notifications = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] notifications.default_level    = INFO {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] notifications.notification_format = unversioned {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] notifications.notify_on_state_change = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] pci.alias                      = [] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] pci.device_spec                = [] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] pci.report_in_placement        = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.auth_section         = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.auth_type            = password {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.cafile               = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.certfile             = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.collect_timing       = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.connect_retries      = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.connect_retry_delay  = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.default_domain_id    = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.default_domain_name  = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.domain_id            = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.domain_name          = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.endpoint_override    = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.insecure             = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.keyfile              = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.max_version          = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.min_version          = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.password             = **** {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.project_domain_id    = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.project_domain_name  = Default {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.project_id           = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.project_name         = service {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.region_name          = RegionOne {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.service_name         = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.service_type         = placement {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.split_loggers        = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.status_code_retries  = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.status_code_retry_delay = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.system_scope         = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.timeout              = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.trust_id             = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.user_domain_id       = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.user_domain_name     = Default {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.user_id              = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.username             = placement {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] placement.version              = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] quota.cores                    = 20 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] quota.count_usage_from_placement = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] quota.injected_file_content_bytes = 10240 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] quota.injected_file_path_length = 255 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] quota.injected_files           = 5 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] quota.instances                = 10 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] quota.key_pairs                = 100 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] quota.metadata_items           = 128 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] quota.ram                      = 51200 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] quota.recheck_quota            = True {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] quota.server_group_members     = 10 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] quota.server_groups            = 10 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] rdp.enabled                    = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] scheduler.image_metadata_prefilter = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] scheduler.max_attempts         = 3 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] scheduler.max_placement_results = 1000 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] scheduler.query_placement_for_availability_zone = True {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] scheduler.query_placement_for_image_type_support = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] scheduler.workers              = 3 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] filter_scheduler.host_subset_size = 1 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] filter_scheduler.isolated_hosts = [] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] filter_scheduler.isolated_images = [] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] filter_scheduler.pci_in_placement = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] filter_scheduler.track_instance_changes = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] metrics.required               = True {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] metrics.weight_multiplier      = 1.0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] metrics.weight_setting         = [] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] serial_console.enabled         = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] serial_console.port_range      = 10000:20000 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] serial_console.serialproxy_port = 6083 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] service_user.auth_section      = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] service_user.auth_type         = password {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] service_user.cafile            = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] service_user.certfile          = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] service_user.collect_timing    = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] service_user.insecure          = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] service_user.keyfile           = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] service_user.send_service_user_token = True {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] service_user.split_loggers     = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] service_user.timeout           = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] spice.agent_enabled            = True {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] spice.enabled                  = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] spice.html5proxy_port          = 6082 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] spice.image_compression        = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] spice.jpeg_compression         = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] spice.playback_compression     = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] spice.server_listen            = 127.0.0.1 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] spice.streaming_mode           = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] spice.zlib_compression         = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] upgrade_levels.baseapi         = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] upgrade_levels.cert            = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] upgrade_levels.compute         = auto {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] upgrade_levels.conductor       = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] upgrade_levels.scheduler       = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vendordata_dynamic_auth.auth_section = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vendordata_dynamic_auth.auth_type = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vendordata_dynamic_auth.cafile = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vendordata_dynamic_auth.certfile = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vendordata_dynamic_auth.insecure = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vendordata_dynamic_auth.keyfile = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vendordata_dynamic_auth.timeout = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vmware.api_retry_count         = 10 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vmware.ca_file                 = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vmware.cache_prefix            = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vmware.cluster_name            = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vmware.connection_pool_size    = 10 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vmware.console_delay_seconds   = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vmware.datastore_regex         = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vmware.host_ip                 = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vmware.host_password           = **** {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vmware.host_port               = 443 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vmware.host_username           = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vmware.insecure                = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vmware.integration_bridge      = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vmware.maximum_objects         = 100 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vmware.pbm_default_policy      = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vmware.pbm_enabled             = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vmware.pbm_wsdl_location       = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vmware.serial_port_proxy_uri   = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vmware.serial_port_service_uri = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vmware.task_poll_interval      = 0.5 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vmware.use_linked_clone        = True {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vmware.vnc_keymap              = en-us {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vmware.vnc_port                = 5900 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vmware.vnc_port_total          = 10000 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vnc.auth_schemes               = ['none'] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vnc.enabled                    = True {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vnc.novncproxy_port            = 6080 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vnc.server_listen              = 0.0.0.0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vnc.vencrypt_ca_certs          = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vnc.vencrypt_client_cert       = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vnc.vencrypt_client_key        = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] workarounds.disable_rootwrap   = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] workarounds.enable_numa_live_migration = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] workarounds.libvirt_disable_apic = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] wsgi.client_socket_timeout     = 900 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] wsgi.default_pool_size         = 1000 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] wsgi.keep_alive                = True {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] wsgi.max_header_line           = 16384 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] wsgi.ssl_ca_file               = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] wsgi.ssl_cert_file             = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] wsgi.ssl_key_file              = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] wsgi.tcp_keepidle              = 600 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] zvm.ca_file                    = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] zvm.cloud_connector_url        = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] zvm.reachable_timeout          = 300 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_policy.enforce_new_defaults = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_policy.enforce_scope      = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_policy.policy_default_rule = default {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_policy.policy_file        = policy.yaml {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] profiler.connection_string     = messaging:// {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] profiler.enabled               = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] profiler.es_doc_type           = notification {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] profiler.es_scroll_size        = 10000 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] profiler.es_scroll_time        = 2m {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] profiler.filter_error_trace    = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] profiler.hmac_keys             = SECRET_KEY {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] profiler.sentinel_service_name = mymaster {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] profiler.socket_timeout        = 0.1 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] profiler.trace_sqlalchemy      = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] remote_debug.host              = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] remote_debug.port              = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_rabbit.ssl      = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_notifications.retry = -1 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_messaging_notifications.transport_url = **** {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_limit.auth_section        = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_limit.auth_type           = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_limit.cafile              = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_limit.certfile            = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_limit.collect_timing      = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_limit.connect_retries     = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_limit.connect_retry_delay = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_limit.endpoint_id         = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_limit.endpoint_override   = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_limit.insecure            = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_limit.keyfile             = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_limit.max_version         = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_limit.min_version         = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_limit.region_name         = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_limit.service_name        = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_limit.service_type        = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_limit.split_loggers       = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_limit.status_code_retries = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_limit.status_code_retry_delay = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_limit.timeout             = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_limit.valid_interfaces    = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_limit.version             = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_reports.file_event_handler = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] oslo_reports.log_dir           = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vif_plug_ovs_privileged.group  = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] vif_plug_ovs_privileged.user   = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] os_vif_linux_bridge.flat_interface = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] os_vif_ovs.isolate_vif         = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] os_vif_ovs.per_port_bridge     = False {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] os_brick.lock_path             = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] privsep_osbrick.capabilities   = [21] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] privsep_osbrick.group          = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] privsep_osbrick.helper_command = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] privsep_osbrick.user           = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] nova_sys_admin.group           = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] nova_sys_admin.helper_command  = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] nova_sys_admin.user            = None {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 12:24:08 user nova-compute[71321]: DEBUG oslo_service.service [None req-43f25806-431f-40a4-89fd-91ae61a28d28 None None] ******************************************************************************** {{(pid=71321) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 12 12:24:08 user nova-compute[71321]: INFO nova.service [-] Starting compute node (version 0.0.0)
Apr 12 12:24:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Starting native event thread {{(pid=71321) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Apr 12 12:24:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Starting green dispatch thread {{(pid=71321) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Apr 12 12:24:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Starting connection event dispatch thread {{(pid=71321) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Apr 12 12:24:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Connecting to libvirt: qemu:///system {{(pid=71321) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Apr 12 12:24:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fef860be620> {{(pid=71321) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Apr 12 12:24:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fef860be620> {{(pid=71321) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Apr 12 12:24:09 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Connection event '1' reason 'None'
Apr 12 12:24:09 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 12 12:24:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.mount [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Initialising _HostMountState generation 0 {{(pid=71321) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Apr 12 12:24:16 user nova-compute[71321]: INFO nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Libvirt host capabilities <capabilities>
Apr 12 12:24:16 user nova-compute[71321]:   <host>
Apr 12 12:24:16 user nova-compute[71321]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Apr 12 12:24:16 user nova-compute[71321]:     <cpu>
Apr 12 12:24:16 user nova-compute[71321]:       <arch>x86_64</arch>
Apr 12 12:24:16 user nova-compute[71321]:       <model>IvyBridge-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <vendor>Intel</vendor>
Apr 12 12:24:16 user nova-compute[71321]:       <microcode version='1070'/>
Apr 12 12:24:16 user nova-compute[71321]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Apr 12 12:24:16 user nova-compute[71321]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature name='ss'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature name='vmx'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature name='pcid'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature name='osxsave'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature name='hypervisor'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature name='arat'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature name='tsc_adjust'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature name='md-clear'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature name='stibp'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature name='arch-capabilities'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature name='ssbd'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature name='invtsc'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature name='rsba'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature name='skip-l1dfl-vmentry'/>
Apr 12 12:24:16 user nova-compute[71321]:       <pages unit='KiB' size='4'/>
Apr 12 12:24:16 user nova-compute[71321]:       <pages unit='KiB' size='2048'/>
Apr 12 12:24:16 user nova-compute[71321]:     </cpu>
Apr 12 12:24:16 user nova-compute[71321]:     <power_management>
Apr 12 12:24:16 user nova-compute[71321]:       <suspend_mem/>
Apr 12 12:24:16 user nova-compute[71321]:       <suspend_disk/>
Apr 12 12:24:16 user nova-compute[71321]:       <suspend_hybrid/>
Apr 12 12:24:16 user nova-compute[71321]:     </power_management>
Apr 12 12:24:16 user nova-compute[71321]:     <iommu support='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     <migration_features>
Apr 12 12:24:16 user nova-compute[71321]:       <live/>
Apr 12 12:24:16 user nova-compute[71321]:       <uri_transports>
Apr 12 12:24:16 user nova-compute[71321]:         <uri_transport>tcp</uri_transport>
Apr 12 12:24:16 user nova-compute[71321]:         <uri_transport>rdma</uri_transport>
Apr 12 12:24:16 user nova-compute[71321]:       </uri_transports>
Apr 12 12:24:16 user nova-compute[71321]:     </migration_features>
Apr 12 12:24:16 user nova-compute[71321]:     <topology>
Apr 12 12:24:16 user nova-compute[71321]:       <cells num='2'>
Apr 12 12:24:16 user nova-compute[71321]:         <cell id='0'>
Apr 12 12:24:16 user nova-compute[71321]:           <memory unit='KiB'>8189224</memory>
Apr 12 12:24:16 user nova-compute[71321]:           <pages unit='KiB' size='4'>2047306</pages>
Apr 12 12:24:16 user nova-compute[71321]:           <pages unit='KiB' size='2048'>0</pages>
Apr 12 12:24:16 user nova-compute[71321]:           <distances>
Apr 12 12:24:16 user nova-compute[71321]:             <sibling id='0' value='10'/>
Apr 12 12:24:16 user nova-compute[71321]:             <sibling id='1' value='20'/>
Apr 12 12:24:16 user nova-compute[71321]:           </distances>
Apr 12 12:24:16 user nova-compute[71321]:           <cpus num='6'>
Apr 12 12:24:16 user nova-compute[71321]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Apr 12 12:24:16 user nova-compute[71321]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Apr 12 12:24:16 user nova-compute[71321]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Apr 12 12:24:16 user nova-compute[71321]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Apr 12 12:24:16 user nova-compute[71321]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Apr 12 12:24:16 user nova-compute[71321]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Apr 12 12:24:16 user nova-compute[71321]:           </cpus>
Apr 12 12:24:16 user nova-compute[71321]:         </cell>
Apr 12 12:24:16 user nova-compute[71321]:         <cell id='1'>
Apr 12 12:24:16 user nova-compute[71321]:           <memory unit='KiB'>8218764</memory>
Apr 12 12:24:16 user nova-compute[71321]:           <pages unit='KiB' size='4'>2054691</pages>
Apr 12 12:24:16 user nova-compute[71321]:           <pages unit='KiB' size='2048'>0</pages>
Apr 12 12:24:16 user nova-compute[71321]:           <distances>
Apr 12 12:24:16 user nova-compute[71321]:             <sibling id='0' value='20'/>
Apr 12 12:24:16 user nova-compute[71321]:             <sibling id='1' value='10'/>
Apr 12 12:24:16 user nova-compute[71321]:           </distances>
Apr 12 12:24:16 user nova-compute[71321]:           <cpus num='6'>
Apr 12 12:24:16 user nova-compute[71321]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Apr 12 12:24:16 user nova-compute[71321]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Apr 12 12:24:16 user nova-compute[71321]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Apr 12 12:24:16 user nova-compute[71321]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Apr 12 12:24:16 user nova-compute[71321]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Apr 12 12:24:16 user nova-compute[71321]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Apr 12 12:24:16 user nova-compute[71321]:           </cpus>
Apr 12 12:24:16 user nova-compute[71321]:         </cell>
Apr 12 12:24:16 user nova-compute[71321]:       </cells>
Apr 12 12:24:16 user nova-compute[71321]:     </topology>
Apr 12 12:24:16 user nova-compute[71321]:     <cache>
Apr 12 12:24:16 user nova-compute[71321]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Apr 12 12:24:16 user nova-compute[71321]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Apr 12 12:24:16 user nova-compute[71321]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Apr 12 12:24:16 user nova-compute[71321]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Apr 12 12:24:16 user nova-compute[71321]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Apr 12 12:24:16 user nova-compute[71321]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Apr 12 12:24:16 user nova-compute[71321]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Apr 12 12:24:16 user nova-compute[71321]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Apr 12 12:24:16 user nova-compute[71321]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Apr 12 12:24:16 user nova-compute[71321]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Apr 12 12:24:16 user nova-compute[71321]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Apr 12 12:24:16 user nova-compute[71321]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Apr 12 12:24:16 user nova-compute[71321]:     </cache>
Apr 12 12:24:16 user nova-compute[71321]:     <secmodel>
Apr 12 12:24:16 user nova-compute[71321]:       <model>apparmor</model>
Apr 12 12:24:16 user nova-compute[71321]:       <doi>0</doi>
Apr 12 12:24:16 user nova-compute[71321]:     </secmodel>
Apr 12 12:24:16 user nova-compute[71321]:     <secmodel>
Apr 12 12:24:16 user nova-compute[71321]:       <model>dac</model>
Apr 12 12:24:16 user nova-compute[71321]:       <doi>0</doi>
Apr 12 12:24:16 user nova-compute[71321]:       <baselabel type='kvm'>+64055:+108</baselabel>
Apr 12 12:24:16 user nova-compute[71321]:       <baselabel type='qemu'>+64055:+108</baselabel>
Apr 12 12:24:16 user nova-compute[71321]:     </secmodel>
Apr 12 12:24:16 user nova-compute[71321]:   </host>
Apr 12 12:24:16 user nova-compute[71321]:   <guest>
Apr 12 12:24:16 user nova-compute[71321]:     <os_type>hvm</os_type>
Apr 12 12:24:16 user nova-compute[71321]:     <arch name='alpha'>
Apr 12 12:24:16 user nova-compute[71321]:       <wordsize>64</wordsize>
Apr 12 12:24:16 user nova-compute[71321]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>clipper</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <domain type='qemu'/>
Apr 12 12:24:16 user nova-compute[71321]:     </arch>
Apr 12 12:24:16 user nova-compute[71321]:     <features>
Apr 12 12:24:16 user nova-compute[71321]:       <cpuselection/>
Apr 12 12:24:16 user nova-compute[71321]:       <deviceboot/>
Apr 12 12:24:16 user nova-compute[71321]:       <disksnapshot default='on' toggle='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     </features>
Apr 12 12:24:16 user nova-compute[71321]:   </guest>
Apr 12 12:24:16 user nova-compute[71321]:   <guest>
Apr 12 12:24:16 user nova-compute[71321]:     <os_type>hvm</os_type>
Apr 12 12:24:16 user nova-compute[71321]:     <arch name='armv6l'>
Apr 12 12:24:16 user nova-compute[71321]:       <wordsize>32</wordsize>
Apr 12 12:24:16 user nova-compute[71321]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>integratorcp</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>borzoi</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>spitz</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>nuri</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>musca-b1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>versatileab</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>kzm</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>musca-a</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>smdkc210</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>sx1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>z2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>tosa</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>sabrelite</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>realview-eb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>n810</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>n800</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>versatilepb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>terrier</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>mainstone</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>midway</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>musicpal</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>microbit</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>cubieboard</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>verdex</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>netduino2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>raspi2b</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>cheetah</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>highbank</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>akita</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>connex</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>collie</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>raspi0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <domain type='qemu'/>
Apr 12 12:24:16 user nova-compute[71321]:     </arch>
Apr 12 12:24:16 user nova-compute[71321]:     <features>
Apr 12 12:24:16 user nova-compute[71321]:       <cpuselection/>
Apr 12 12:24:16 user nova-compute[71321]:       <deviceboot/>
Apr 12 12:24:16 user nova-compute[71321]:       <disksnapshot default='on' toggle='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     </features>
Apr 12 12:24:16 user nova-compute[71321]:   </guest>
Apr 12 12:24:16 user nova-compute[71321]:   <guest>
Apr 12 12:24:16 user nova-compute[71321]:     <os_type>hvm</os_type>
Apr 12 12:24:16 user nova-compute[71321]:     <arch name='armv7l'>
Apr 12 12:24:16 user nova-compute[71321]:       <wordsize>32</wordsize>
Apr 12 12:24:16 user nova-compute[71321]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>integratorcp</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>borzoi</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>spitz</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>nuri</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>musca-b1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>versatileab</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>kzm</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>musca-a</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>smdkc210</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>sx1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>z2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>tosa</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>sabrelite</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>realview-eb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>n810</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>n800</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>versatilepb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>terrier</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>mainstone</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>midway</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>musicpal</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>microbit</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>cubieboard</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>verdex</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>netduino2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>raspi2b</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>cheetah</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>highbank</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>akita</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>connex</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>collie</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>raspi0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <domain type='qemu'/>
Apr 12 12:24:16 user nova-compute[71321]:     </arch>
Apr 12 12:24:16 user nova-compute[71321]:     <features>
Apr 12 12:24:16 user nova-compute[71321]:       <cpuselection/>
Apr 12 12:24:16 user nova-compute[71321]:       <deviceboot/>
Apr 12 12:24:16 user nova-compute[71321]:       <disksnapshot default='on' toggle='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     </features>
Apr 12 12:24:16 user nova-compute[71321]:   </guest>
Apr 12 12:24:16 user nova-compute[71321]:   <guest>
Apr 12 12:24:16 user nova-compute[71321]:     <os_type>hvm</os_type>
Apr 12 12:24:16 user nova-compute[71321]:     <arch name='aarch64'>
Apr 12 12:24:16 user nova-compute[71321]:       <wordsize>64</wordsize>
Apr 12 12:24:16 user nova-compute[71321]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>integratorcp</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>borzoi</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>spitz</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>nuri</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>musca-b1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>versatileab</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>kzm</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>musca-a</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>smdkc210</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>sx1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>z2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>tosa</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>sabrelite</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>realview-eb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='512'>sbsa-ref</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>n810</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>n800</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>versatilepb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>terrier</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>mainstone</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>midway</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>musicpal</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>microbit</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>raspi3ap</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>cubieboard</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>verdex</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>netduino2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>raspi3b</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>raspi2b</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>cheetah</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>highbank</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>akita</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>connex</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>collie</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>raspi0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <domain type='qemu'/>
Apr 12 12:24:16 user nova-compute[71321]:     </arch>
Apr 12 12:24:16 user nova-compute[71321]:     <features>
Apr 12 12:24:16 user nova-compute[71321]:       <acpi default='on' toggle='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:       <cpuselection/>
Apr 12 12:24:16 user nova-compute[71321]:       <deviceboot/>
Apr 12 12:24:16 user nova-compute[71321]:       <disksnapshot default='on' toggle='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     </features>
Apr 12 12:24:16 user nova-compute[71321]:   </guest>
Apr 12 12:24:16 user nova-compute[71321]:   <guest>
Apr 12 12:24:16 user nova-compute[71321]:     <os_type>hvm</os_type>
Apr 12 12:24:16 user nova-compute[71321]:     <arch name='cris'>
Apr 12 12:24:16 user nova-compute[71321]:       <wordsize>32</wordsize>
Apr 12 12:24:16 user nova-compute[71321]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>axis-dev88</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <domain type='qemu'/>
Apr 12 12:24:16 user nova-compute[71321]:     </arch>
Apr 12 12:24:16 user nova-compute[71321]:     <features>
Apr 12 12:24:16 user nova-compute[71321]:       <cpuselection/>
Apr 12 12:24:16 user nova-compute[71321]:       <deviceboot/>
Apr 12 12:24:16 user nova-compute[71321]:       <disksnapshot default='on' toggle='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     </features>
Apr 12 12:24:16 user nova-compute[71321]:   </guest>
Apr 12 12:24:16 user nova-compute[71321]:   <guest>
Apr 12 12:24:16 user nova-compute[71321]:     <os_type>hvm</os_type>
Apr 12 12:24:16 user nova-compute[71321]:     <arch name='i686'>
Apr 12 12:24:16 user nova-compute[71321]:       <wordsize>32</wordsize>
Apr 12 12:24:16 user nova-compute[71321]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>x-remote</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>isapc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>microvm</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <domain type='qemu'/>
Apr 12 12:24:16 user nova-compute[71321]:       <domain type='kvm'/>
Apr 12 12:24:16 user nova-compute[71321]:     </arch>
Apr 12 12:24:16 user nova-compute[71321]:     <features>
Apr 12 12:24:16 user nova-compute[71321]:       <pae/>
Apr 12 12:24:16 user nova-compute[71321]:       <nonpae/>
Apr 12 12:24:16 user nova-compute[71321]:       <acpi default='on' toggle='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:       <apic default='on' toggle='no'/>
Apr 12 12:24:16 user nova-compute[71321]:       <cpuselection/>
Apr 12 12:24:16 user nova-compute[71321]:       <deviceboot/>
Apr 12 12:24:16 user nova-compute[71321]:       <disksnapshot default='on' toggle='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     </features>
Apr 12 12:24:16 user nova-compute[71321]:   </guest>
Apr 12 12:24:16 user nova-compute[71321]:   <guest>
Apr 12 12:24:16 user nova-compute[71321]:     <os_type>hvm</os_type>
Apr 12 12:24:16 user nova-compute[71321]:     <arch name='m68k'>
Apr 12 12:24:16 user nova-compute[71321]:       <wordsize>32</wordsize>
Apr 12 12:24:16 user nova-compute[71321]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>mcf5208evb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>an5206</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>virt-6.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>q800</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>virt-6.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>next-cube</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>virt-6.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <domain type='qemu'/>
Apr 12 12:24:16 user nova-compute[71321]:     </arch>
Apr 12 12:24:16 user nova-compute[71321]:     <features>
Apr 12 12:24:16 user nova-compute[71321]:       <cpuselection/>
Apr 12 12:24:16 user nova-compute[71321]:       <deviceboot/>
Apr 12 12:24:16 user nova-compute[71321]:       <disksnapshot default='on' toggle='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     </features>
Apr 12 12:24:16 user nova-compute[71321]:   </guest>
Apr 12 12:24:16 user nova-compute[71321]:   <guest>
Apr 12 12:24:16 user nova-compute[71321]:     <os_type>hvm</os_type>
Apr 12 12:24:16 user nova-compute[71321]:     <arch name='microblaze'>
Apr 12 12:24:16 user nova-compute[71321]:       <wordsize>32</wordsize>
Apr 12 12:24:16 user nova-compute[71321]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <domain type='qemu'/>
Apr 12 12:24:16 user nova-compute[71321]:     </arch>
Apr 12 12:24:16 user nova-compute[71321]:     <features>
Apr 12 12:24:16 user nova-compute[71321]:       <cpuselection/>
Apr 12 12:24:16 user nova-compute[71321]:       <deviceboot/>
Apr 12 12:24:16 user nova-compute[71321]:       <disksnapshot default='on' toggle='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     </features>
Apr 12 12:24:16 user nova-compute[71321]:   </guest>
Apr 12 12:24:16 user nova-compute[71321]:   <guest>
Apr 12 12:24:16 user nova-compute[71321]:     <os_type>hvm</os_type>
Apr 12 12:24:16 user nova-compute[71321]:     <arch name='microblazeel'>
Apr 12 12:24:16 user nova-compute[71321]:       <wordsize>32</wordsize>
Apr 12 12:24:16 user nova-compute[71321]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <domain type='qemu'/>
Apr 12 12:24:16 user nova-compute[71321]:     </arch>
Apr 12 12:24:16 user nova-compute[71321]:     <features>
Apr 12 12:24:16 user nova-compute[71321]:       <cpuselection/>
Apr 12 12:24:16 user nova-compute[71321]:       <deviceboot/>
Apr 12 12:24:16 user nova-compute[71321]:       <disksnapshot default='on' toggle='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     </features>
Apr 12 12:24:16 user nova-compute[71321]:   </guest>
Apr 12 12:24:16 user nova-compute[71321]:   <guest>
Apr 12 12:24:16 user nova-compute[71321]:     <os_type>hvm</os_type>
Apr 12 12:24:16 user nova-compute[71321]:     <arch name='mips'>
Apr 12 12:24:16 user nova-compute[71321]:       <wordsize>32</wordsize>
Apr 12 12:24:16 user nova-compute[71321]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='16'>malta</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>mipssim</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <domain type='qemu'/>
Apr 12 12:24:16 user nova-compute[71321]:     </arch>
Apr 12 12:24:16 user nova-compute[71321]:     <features>
Apr 12 12:24:16 user nova-compute[71321]:       <cpuselection/>
Apr 12 12:24:16 user nova-compute[71321]:       <deviceboot/>
Apr 12 12:24:16 user nova-compute[71321]:       <disksnapshot default='on' toggle='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     </features>
Apr 12 12:24:16 user nova-compute[71321]:   </guest>
Apr 12 12:24:16 user nova-compute[71321]:   <guest>
Apr 12 12:24:16 user nova-compute[71321]:     <os_type>hvm</os_type>
Apr 12 12:24:16 user nova-compute[71321]:     <arch name='mipsel'>
Apr 12 12:24:16 user nova-compute[71321]:       <wordsize>32</wordsize>
Apr 12 12:24:16 user nova-compute[71321]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='16'>malta</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>mipssim</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <domain type='qemu'/>
Apr 12 12:24:16 user nova-compute[71321]:     </arch>
Apr 12 12:24:16 user nova-compute[71321]:     <features>
Apr 12 12:24:16 user nova-compute[71321]:       <cpuselection/>
Apr 12 12:24:16 user nova-compute[71321]:       <deviceboot/>
Apr 12 12:24:16 user nova-compute[71321]:       <disksnapshot default='on' toggle='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     </features>
Apr 12 12:24:16 user nova-compute[71321]:   </guest>
Apr 12 12:24:16 user nova-compute[71321]:   <guest>
Apr 12 12:24:16 user nova-compute[71321]:     <os_type>hvm</os_type>
Apr 12 12:24:16 user nova-compute[71321]:     <arch name='mips64'>
Apr 12 12:24:16 user nova-compute[71321]:       <wordsize>64</wordsize>
Apr 12 12:24:16 user nova-compute[71321]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='16'>malta</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>mipssim</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>pica61</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>magnum</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <domain type='qemu'/>
Apr 12 12:24:16 user nova-compute[71321]:     </arch>
Apr 12 12:24:16 user nova-compute[71321]:     <features>
Apr 12 12:24:16 user nova-compute[71321]:       <cpuselection/>
Apr 12 12:24:16 user nova-compute[71321]:       <deviceboot/>
Apr 12 12:24:16 user nova-compute[71321]:       <disksnapshot default='on' toggle='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     </features>
Apr 12 12:24:16 user nova-compute[71321]:   </guest>
Apr 12 12:24:16 user nova-compute[71321]:   <guest>
Apr 12 12:24:16 user nova-compute[71321]:     <os_type>hvm</os_type>
Apr 12 12:24:16 user nova-compute[71321]:     <arch name='mips64el'>
Apr 12 12:24:16 user nova-compute[71321]:       <wordsize>64</wordsize>
Apr 12 12:24:16 user nova-compute[71321]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='16'>malta</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='16'>loongson3-virt</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>mipssim</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>pica61</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>magnum</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='16'>boston</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>fuloong2e</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <domain type='qemu'/>
Apr 12 12:24:16 user nova-compute[71321]:     </arch>
Apr 12 12:24:16 user nova-compute[71321]:     <features>
Apr 12 12:24:16 user nova-compute[71321]:       <cpuselection/>
Apr 12 12:24:16 user nova-compute[71321]:       <deviceboot/>
Apr 12 12:24:16 user nova-compute[71321]:       <disksnapshot default='on' toggle='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     </features>
Apr 12 12:24:16 user nova-compute[71321]:   </guest>
Apr 12 12:24:16 user nova-compute[71321]:   <guest>
Apr 12 12:24:16 user nova-compute[71321]:     <os_type>hvm</os_type>
Apr 12 12:24:16 user nova-compute[71321]:     <arch name='ppc'>
Apr 12 12:24:16 user nova-compute[71321]:       <wordsize>32</wordsize>
Apr 12 12:24:16 user nova-compute[71321]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>g3beige</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>mac99</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='32'>ppce500</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>pegasos2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>sam460ex</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>bamboo</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>40p</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>ref405ep</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>taihu</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <domain type='qemu'/>
Apr 12 12:24:16 user nova-compute[71321]:     </arch>
Apr 12 12:24:16 user nova-compute[71321]:     <features>
Apr 12 12:24:16 user nova-compute[71321]:       <cpuselection/>
Apr 12 12:24:16 user nova-compute[71321]:       <deviceboot/>
Apr 12 12:24:16 user nova-compute[71321]:       <disksnapshot default='on' toggle='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     </features>
Apr 12 12:24:16 user nova-compute[71321]:   </guest>
Apr 12 12:24:16 user nova-compute[71321]:   <guest>
Apr 12 12:24:16 user nova-compute[71321]:     <os_type>hvm</os_type>
Apr 12 12:24:16 user nova-compute[71321]:     <arch name='ppc64'>
Apr 12 12:24:16 user nova-compute[71321]:       <wordsize>64</wordsize>
Apr 12 12:24:16 user nova-compute[71321]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2048'>powernv9</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>taihu</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2048'>powernv10</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='32'>ppce500</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>40p</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>pegasos2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>bamboo</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>g3beige</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>mac99</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>sam460ex</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>ref405ep</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2048'>powernv8</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <domain type='qemu'/>
Apr 12 12:24:16 user nova-compute[71321]:     </arch>
Apr 12 12:24:16 user nova-compute[71321]:     <features>
Apr 12 12:24:16 user nova-compute[71321]:       <cpuselection/>
Apr 12 12:24:16 user nova-compute[71321]:       <deviceboot/>
Apr 12 12:24:16 user nova-compute[71321]:       <disksnapshot default='on' toggle='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     </features>
Apr 12 12:24:16 user nova-compute[71321]:   </guest>
Apr 12 12:24:16 user nova-compute[71321]:   <guest>
Apr 12 12:24:16 user nova-compute[71321]:     <os_type>hvm</os_type>
Apr 12 12:24:16 user nova-compute[71321]:     <arch name='ppc64le'>
Apr 12 12:24:16 user nova-compute[71321]:       <wordsize>64</wordsize>
Apr 12 12:24:16 user nova-compute[71321]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2048'>powernv9</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>taihu</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2048'>powernv10</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='32'>ppce500</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>40p</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>pegasos2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>bamboo</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>g3beige</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>mac99</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>sam460ex</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>ref405ep</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2048'>powernv8</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <domain type='qemu'/>
Apr 12 12:24:16 user nova-compute[71321]:     </arch>
Apr 12 12:24:16 user nova-compute[71321]:     <features>
Apr 12 12:24:16 user nova-compute[71321]:       <cpuselection/>
Apr 12 12:24:16 user nova-compute[71321]:       <deviceboot/>
Apr 12 12:24:16 user nova-compute[71321]:       <disksnapshot default='on' toggle='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     </features>
Apr 12 12:24:16 user nova-compute[71321]:   </guest>
Apr 12 12:24:16 user nova-compute[71321]:   <guest>
Apr 12 12:24:16 user nova-compute[71321]:     <os_type>hvm</os_type>
Apr 12 12:24:16 user nova-compute[71321]:     <arch name='riscv32'>
Apr 12 12:24:16 user nova-compute[71321]:       <wordsize>32</wordsize>
Apr 12 12:24:16 user nova-compute[71321]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='8'>spike</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>opentitan</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='5'>sifive_u</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>sifive_e</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='8'>virt</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <domain type='qemu'/>
Apr 12 12:24:16 user nova-compute[71321]:     </arch>
Apr 12 12:24:16 user nova-compute[71321]:     <features>
Apr 12 12:24:16 user nova-compute[71321]:       <cpuselection/>
Apr 12 12:24:16 user nova-compute[71321]:       <deviceboot/>
Apr 12 12:24:16 user nova-compute[71321]:       <disksnapshot default='on' toggle='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     </features>
Apr 12 12:24:16 user nova-compute[71321]:   </guest>
Apr 12 12:24:16 user nova-compute[71321]:   <guest>
Apr 12 12:24:16 user nova-compute[71321]:     <os_type>hvm</os_type>
Apr 12 12:24:16 user nova-compute[71321]:     <arch name='riscv64'>
Apr 12 12:24:16 user nova-compute[71321]:       <wordsize>64</wordsize>
Apr 12 12:24:16 user nova-compute[71321]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='8'>spike</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='5'>sifive_u</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>shakti_c</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>sifive_e</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='8'>virt</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <domain type='qemu'/>
Apr 12 12:24:16 user nova-compute[71321]:     </arch>
Apr 12 12:24:16 user nova-compute[71321]:     <features>
Apr 12 12:24:16 user nova-compute[71321]:       <cpuselection/>
Apr 12 12:24:16 user nova-compute[71321]:       <deviceboot/>
Apr 12 12:24:16 user nova-compute[71321]:       <disksnapshot default='on' toggle='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     </features>
Apr 12 12:24:16 user nova-compute[71321]:   </guest>
Apr 12 12:24:16 user nova-compute[71321]:   <guest>
Apr 12 12:24:16 user nova-compute[71321]:     <os_type>hvm</os_type>
Apr 12 12:24:16 user nova-compute[71321]:     <arch name='s390x'>
Apr 12 12:24:16 user nova-compute[71321]:       <wordsize>64</wordsize>
Apr 12 12:24:16 user nova-compute[71321]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <domain type='qemu'/>
Apr 12 12:24:16 user nova-compute[71321]:     </arch>
Apr 12 12:24:16 user nova-compute[71321]:     <features>
Apr 12 12:24:16 user nova-compute[71321]:       <cpuselection/>
Apr 12 12:24:16 user nova-compute[71321]:       <deviceboot/>
Apr 12 12:24:16 user nova-compute[71321]:       <disksnapshot default='on' toggle='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     </features>
Apr 12 12:24:16 user nova-compute[71321]:   </guest>
Apr 12 12:24:16 user nova-compute[71321]:   <guest>
Apr 12 12:24:16 user nova-compute[71321]:     <os_type>hvm</os_type>
Apr 12 12:24:16 user nova-compute[71321]:     <arch name='sh4'>
Apr 12 12:24:16 user nova-compute[71321]:       <wordsize>32</wordsize>
Apr 12 12:24:16 user nova-compute[71321]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>shix</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>r2d</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <domain type='qemu'/>
Apr 12 12:24:16 user nova-compute[71321]:     </arch>
Apr 12 12:24:16 user nova-compute[71321]:     <features>
Apr 12 12:24:16 user nova-compute[71321]:       <cpuselection/>
Apr 12 12:24:16 user nova-compute[71321]:       <deviceboot/>
Apr 12 12:24:16 user nova-compute[71321]:       <disksnapshot default='on' toggle='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     </features>
Apr 12 12:24:16 user nova-compute[71321]:   </guest>
Apr 12 12:24:16 user nova-compute[71321]:   <guest>
Apr 12 12:24:16 user nova-compute[71321]:     <os_type>hvm</os_type>
Apr 12 12:24:16 user nova-compute[71321]:     <arch name='sh4eb'>
Apr 12 12:24:16 user nova-compute[71321]:       <wordsize>64</wordsize>
Apr 12 12:24:16 user nova-compute[71321]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>shix</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>r2d</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <domain type='qemu'/>
Apr 12 12:24:16 user nova-compute[71321]:     </arch>
Apr 12 12:24:16 user nova-compute[71321]:     <features>
Apr 12 12:24:16 user nova-compute[71321]:       <cpuselection/>
Apr 12 12:24:16 user nova-compute[71321]:       <deviceboot/>
Apr 12 12:24:16 user nova-compute[71321]:       <disksnapshot default='on' toggle='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     </features>
Apr 12 12:24:16 user nova-compute[71321]:   </guest>
Apr 12 12:24:16 user nova-compute[71321]:   <guest>
Apr 12 12:24:16 user nova-compute[71321]:     <os_type>hvm</os_type>
Apr 12 12:24:16 user nova-compute[71321]:     <arch name='sparc'>
Apr 12 12:24:16 user nova-compute[71321]:       <wordsize>32</wordsize>
Apr 12 12:24:16 user nova-compute[71321]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>SS-5</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>SS-20</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>LX</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>SPARCClassic</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>leon3_generic</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>SPARCbook</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>SS-4</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>SS-600MP</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>SS-10</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>Voyager</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <domain type='qemu'/>
Apr 12 12:24:16 user nova-compute[71321]:     </arch>
Apr 12 12:24:16 user nova-compute[71321]:     <features>
Apr 12 12:24:16 user nova-compute[71321]:       <cpuselection/>
Apr 12 12:24:16 user nova-compute[71321]:       <deviceboot/>
Apr 12 12:24:16 user nova-compute[71321]:       <disksnapshot default='on' toggle='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     </features>
Apr 12 12:24:16 user nova-compute[71321]:   </guest>
Apr 12 12:24:16 user nova-compute[71321]:   <guest>
Apr 12 12:24:16 user nova-compute[71321]:     <os_type>hvm</os_type>
Apr 12 12:24:16 user nova-compute[71321]:     <arch name='sparc64'>
Apr 12 12:24:16 user nova-compute[71321]:       <wordsize>64</wordsize>
Apr 12 12:24:16 user nova-compute[71321]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>sun4u</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>niagara</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>sun4v</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <domain type='qemu'/>
Apr 12 12:24:16 user nova-compute[71321]:     </arch>
Apr 12 12:24:16 user nova-compute[71321]:     <features>
Apr 12 12:24:16 user nova-compute[71321]:       <cpuselection/>
Apr 12 12:24:16 user nova-compute[71321]:       <deviceboot/>
Apr 12 12:24:16 user nova-compute[71321]:       <disksnapshot default='on' toggle='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     </features>
Apr 12 12:24:16 user nova-compute[71321]:   </guest>
Apr 12 12:24:16 user nova-compute[71321]:   <guest>
Apr 12 12:24:16 user nova-compute[71321]:     <os_type>hvm</os_type>
Apr 12 12:24:16 user nova-compute[71321]:     <arch name='x86_64'>
Apr 12 12:24:16 user nova-compute[71321]:       <wordsize>64</wordsize>
Apr 12 12:24:16 user nova-compute[71321]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>x-remote</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='1'>isapc</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>microvm</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <domain type='qemu'/>
Apr 12 12:24:16 user nova-compute[71321]:       <domain type='kvm'/>
Apr 12 12:24:16 user nova-compute[71321]:     </arch>
Apr 12 12:24:16 user nova-compute[71321]:     <features>
Apr 12 12:24:16 user nova-compute[71321]:       <acpi default='on' toggle='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:       <apic default='on' toggle='no'/>
Apr 12 12:24:16 user nova-compute[71321]:       <cpuselection/>
Apr 12 12:24:16 user nova-compute[71321]:       <deviceboot/>
Apr 12 12:24:16 user nova-compute[71321]:       <disksnapshot default='on' toggle='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     </features>
Apr 12 12:24:16 user nova-compute[71321]:   </guest>
Apr 12 12:24:16 user nova-compute[71321]:   <guest>
Apr 12 12:24:16 user nova-compute[71321]:     <os_type>hvm</os_type>
Apr 12 12:24:16 user nova-compute[71321]:     <arch name='xtensa'>
Apr 12 12:24:16 user nova-compute[71321]:       <wordsize>32</wordsize>
Apr 12 12:24:16 user nova-compute[71321]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>sim</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='32'>kc705</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='32'>ml605</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='32'>virt</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='32'>lx200</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='32'>lx60</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <domain type='qemu'/>
Apr 12 12:24:16 user nova-compute[71321]:     </arch>
Apr 12 12:24:16 user nova-compute[71321]:     <features>
Apr 12 12:24:16 user nova-compute[71321]:       <cpuselection/>
Apr 12 12:24:16 user nova-compute[71321]:       <deviceboot/>
Apr 12 12:24:16 user nova-compute[71321]:       <disksnapshot default='on' toggle='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     </features>
Apr 12 12:24:16 user nova-compute[71321]:   </guest>
Apr 12 12:24:16 user nova-compute[71321]:   <guest>
Apr 12 12:24:16 user nova-compute[71321]:     <os_type>hvm</os_type>
Apr 12 12:24:16 user nova-compute[71321]:     <arch name='xtensaeb'>
Apr 12 12:24:16 user nova-compute[71321]:       <wordsize>32</wordsize>
Apr 12 12:24:16 user nova-compute[71321]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='4'>sim</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='32'>kc705</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='32'>ml605</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='32'>virt</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='32'>lx200</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='32'>lx60</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 12 12:24:16 user nova-compute[71321]:       <domain type='qemu'/>
Apr 12 12:24:16 user nova-compute[71321]:     </arch>
Apr 12 12:24:16 user nova-compute[71321]:     <features>
Apr 12 12:24:16 user nova-compute[71321]:       <cpuselection/>
Apr 12 12:24:16 user nova-compute[71321]:       <deviceboot/>
Apr 12 12:24:16 user nova-compute[71321]:       <disksnapshot default='on' toggle='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     </features>
Apr 12 12:24:16 user nova-compute[71321]:   </guest>
Apr 12 12:24:16 user nova-compute[71321]: </capabilities>
Apr 12 12:24:16 user nova-compute[71321]: 
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=71321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=71321) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=71321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71321) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71321) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=71321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71321) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=71321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=71321) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Getting domain capabilities for cris via machine types: {None} {{(pid=71321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=71321) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'pc', 'q35', 'ubuntu-q35'} {{(pid=71321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Apr 12 12:24:16 user nova-compute[71321]: <domainCapabilities>
Apr 12 12:24:16 user nova-compute[71321]:   <path>/usr/bin/qemu-system-i386</path>
Apr 12 12:24:16 user nova-compute[71321]:   <domain>kvm</domain>
Apr 12 12:24:16 user nova-compute[71321]:   <machine>pc-i440fx-jammy</machine>
Apr 12 12:24:16 user nova-compute[71321]:   <arch>i686</arch>
Apr 12 12:24:16 user nova-compute[71321]:   <vcpu max='255'/>
Apr 12 12:24:16 user nova-compute[71321]:   <iothreads supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:   <os supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:     <enum name='firmware'/>
Apr 12 12:24:16 user nova-compute[71321]:     <loader supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='type'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>rom</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>pflash</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='readonly'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>yes</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>no</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='secure'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>no</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </loader>
Apr 12 12:24:16 user nova-compute[71321]:   </os>
Apr 12 12:24:16 user nova-compute[71321]:   <cpu>
Apr 12 12:24:16 user nova-compute[71321]:     <mode name='host-passthrough' supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='hostPassthroughMigratable'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>off</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </mode>
Apr 12 12:24:16 user nova-compute[71321]:     <mode name='maximum' supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='maximumMigratable'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>on</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>off</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </mode>
Apr 12 12:24:16 user nova-compute[71321]:     <mode name='host-model' supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <vendor>Intel</vendor>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='ss'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='vmx'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='pcid'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='hypervisor'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='arat'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='umip'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='md-clear'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='stibp'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='ssbd'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='ibpb'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='ibrs'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='amd-stibp'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='disable' name='erms'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='disable' name='lm'/>
Apr 12 12:24:16 user nova-compute[71321]:     </mode>
Apr 12 12:24:16 user nova-compute[71321]:     <mode name='custom' supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>qemu64</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>qemu32</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>phenom</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>pentium3</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>pentium2</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>pentium</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>n270</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>kvm64</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>kvm32</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>coreduo</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>core2duo</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>athlon</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Westmere-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Westmere</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Snowridge</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Server</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Client</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>SandyBridge</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Penryn</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G5</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G4</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G3</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G2</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G1</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Nehalem-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Nehalem</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>IvyBridge</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Icelake-Server</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Haswell</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>EPYC-Rome</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>EPYC-Milan</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>EPYC</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Dhyana</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Cooperlake</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Conroe</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Broadwell</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>486</model>
Apr 12 12:24:16 user nova-compute[71321]:     </mode>
Apr 12 12:24:16 user nova-compute[71321]:   </cpu>
Apr 12 12:24:16 user nova-compute[71321]:   <memoryBacking supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:     <enum name='sourceType'>
Apr 12 12:24:16 user nova-compute[71321]:       <value>file</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>anonymous</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>memfd</value>
Apr 12 12:24:16 user nova-compute[71321]:     </enum>
Apr 12 12:24:16 user nova-compute[71321]:   </memoryBacking>
Apr 12 12:24:16 user nova-compute[71321]:   <devices>
Apr 12 12:24:16 user nova-compute[71321]:     <disk supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='diskDevice'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>disk</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>cdrom</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>floppy</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>lun</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='bus'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>ide</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>fdc</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>scsi</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>usb</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>sata</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='model'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio-transitional</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio-non-transitional</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </disk>
Apr 12 12:24:16 user nova-compute[71321]:     <graphics supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='type'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>sdl</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>vnc</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>spice</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>egl-headless</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </graphics>
Apr 12 12:24:16 user nova-compute[71321]:     <video supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='modelType'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>vga</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>cirrus</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>vmvga</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>qxl</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>none</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>bochs</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>ramfb</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </video>
Apr 12 12:24:16 user nova-compute[71321]:     <hostdev supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='mode'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>subsystem</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='startupPolicy'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>default</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>mandatory</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>requisite</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>optional</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='subsysType'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>usb</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>pci</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>scsi</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='capsType'/>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='pciBackend'/>
Apr 12 12:24:16 user nova-compute[71321]:     </hostdev>
Apr 12 12:24:16 user nova-compute[71321]:     <rng supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='model'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio-transitional</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio-non-transitional</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='backendModel'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>random</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>egd</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>builtin</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </rng>
Apr 12 12:24:16 user nova-compute[71321]:     <filesystem supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='driverType'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>path</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>handle</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtiofs</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </filesystem>
Apr 12 12:24:16 user nova-compute[71321]:     <tpm supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='model'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>tpm-tis</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>tpm-crb</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='backendModel'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>passthrough</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>emulator</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </tpm>
Apr 12 12:24:16 user nova-compute[71321]:   </devices>
Apr 12 12:24:16 user nova-compute[71321]:   <features>
Apr 12 12:24:16 user nova-compute[71321]:     <gic supported='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     <vmcoreinfo supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:     <genid supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:     <backingStoreInput supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:     <backup supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:     <sev supported='no'/>
Apr 12 12:24:16 user nova-compute[71321]:   </features>
Apr 12 12:24:16 user nova-compute[71321]: </domainCapabilities>
Apr 12 12:24:16 user nova-compute[71321]:  {{(pid=71321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Apr 12 12:24:16 user nova-compute[71321]: <domainCapabilities>
Apr 12 12:24:16 user nova-compute[71321]:   <path>/usr/bin/qemu-system-i386</path>
Apr 12 12:24:16 user nova-compute[71321]:   <domain>kvm</domain>
Apr 12 12:24:16 user nova-compute[71321]:   <machine>pc-i440fx-6.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:   <arch>i686</arch>
Apr 12 12:24:16 user nova-compute[71321]:   <vcpu max='255'/>
Apr 12 12:24:16 user nova-compute[71321]:   <iothreads supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:   <os supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:     <enum name='firmware'/>
Apr 12 12:24:16 user nova-compute[71321]:     <loader supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='type'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>rom</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>pflash</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='readonly'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>yes</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>no</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='secure'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>no</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </loader>
Apr 12 12:24:16 user nova-compute[71321]:   </os>
Apr 12 12:24:16 user nova-compute[71321]:   <cpu>
Apr 12 12:24:16 user nova-compute[71321]:     <mode name='host-passthrough' supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='hostPassthroughMigratable'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>off</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </mode>
Apr 12 12:24:16 user nova-compute[71321]:     <mode name='maximum' supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='maximumMigratable'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>on</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>off</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </mode>
Apr 12 12:24:16 user nova-compute[71321]:     <mode name='host-model' supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <vendor>Intel</vendor>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='ss'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='vmx'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='pcid'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='hypervisor'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='arat'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='umip'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='md-clear'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='stibp'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='ssbd'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='ibpb'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='ibrs'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='amd-stibp'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='disable' name='erms'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='disable' name='lm'/>
Apr 12 12:24:16 user nova-compute[71321]:     </mode>
Apr 12 12:24:16 user nova-compute[71321]:     <mode name='custom' supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>qemu64</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>qemu32</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>phenom</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>pentium3</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>pentium2</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>pentium</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>n270</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>kvm64</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>kvm32</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>coreduo</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>core2duo</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>athlon</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Westmere-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Westmere</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Snowridge</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Server</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Client</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>SandyBridge</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Penryn</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G5</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G4</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G3</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G2</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G1</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Nehalem-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Nehalem</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>IvyBridge</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Icelake-Server</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Haswell</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>EPYC-Rome</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>EPYC-Milan</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>EPYC</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Dhyana</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Cooperlake</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Conroe</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Broadwell</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>486</model>
Apr 12 12:24:16 user nova-compute[71321]:     </mode>
Apr 12 12:24:16 user nova-compute[71321]:   </cpu>
Apr 12 12:24:16 user nova-compute[71321]:   <memoryBacking supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:     <enum name='sourceType'>
Apr 12 12:24:16 user nova-compute[71321]:       <value>file</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>anonymous</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>memfd</value>
Apr 12 12:24:16 user nova-compute[71321]:     </enum>
Apr 12 12:24:16 user nova-compute[71321]:   </memoryBacking>
Apr 12 12:24:16 user nova-compute[71321]:   <devices>
Apr 12 12:24:16 user nova-compute[71321]:     <disk supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='diskDevice'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>disk</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>cdrom</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>floppy</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>lun</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='bus'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>ide</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>fdc</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>scsi</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>usb</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>sata</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='model'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio-transitional</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio-non-transitional</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </disk>
Apr 12 12:24:16 user nova-compute[71321]:     <graphics supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='type'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>sdl</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>vnc</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>spice</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>egl-headless</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </graphics>
Apr 12 12:24:16 user nova-compute[71321]:     <video supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='modelType'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>vga</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>cirrus</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>vmvga</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>qxl</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>none</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>bochs</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>ramfb</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </video>
Apr 12 12:24:16 user nova-compute[71321]:     <hostdev supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='mode'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>subsystem</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='startupPolicy'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>default</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>mandatory</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>requisite</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>optional</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='subsysType'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>usb</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>pci</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>scsi</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='capsType'/>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='pciBackend'/>
Apr 12 12:24:16 user nova-compute[71321]:     </hostdev>
Apr 12 12:24:16 user nova-compute[71321]:     <rng supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='model'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio-transitional</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio-non-transitional</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='backendModel'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>random</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>egd</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>builtin</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </rng>
Apr 12 12:24:16 user nova-compute[71321]:     <filesystem supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='driverType'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>path</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>handle</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtiofs</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </filesystem>
Apr 12 12:24:16 user nova-compute[71321]:     <tpm supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='model'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>tpm-tis</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>tpm-crb</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='backendModel'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>passthrough</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>emulator</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </tpm>
Apr 12 12:24:16 user nova-compute[71321]:   </devices>
Apr 12 12:24:16 user nova-compute[71321]:   <features>
Apr 12 12:24:16 user nova-compute[71321]:     <gic supported='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     <vmcoreinfo supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:     <genid supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:     <backingStoreInput supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:     <backup supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:     <sev supported='no'/>
Apr 12 12:24:16 user nova-compute[71321]:   </features>
Apr 12 12:24:16 user nova-compute[71321]: </domainCapabilities>
Apr 12 12:24:16 user nova-compute[71321]:  {{(pid=71321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Apr 12 12:24:16 user nova-compute[71321]: <domainCapabilities>
Apr 12 12:24:16 user nova-compute[71321]:   <path>/usr/bin/qemu-system-i386</path>
Apr 12 12:24:16 user nova-compute[71321]:   <domain>kvm</domain>
Apr 12 12:24:16 user nova-compute[71321]:   <machine>pc-q35-6.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:   <arch>i686</arch>
Apr 12 12:24:16 user nova-compute[71321]:   <vcpu max='288'/>
Apr 12 12:24:16 user nova-compute[71321]:   <iothreads supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:   <os supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:     <enum name='firmware'/>
Apr 12 12:24:16 user nova-compute[71321]:     <loader supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='type'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>rom</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>pflash</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='readonly'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>yes</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>no</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='secure'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>no</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </loader>
Apr 12 12:24:16 user nova-compute[71321]:   </os>
Apr 12 12:24:16 user nova-compute[71321]:   <cpu>
Apr 12 12:24:16 user nova-compute[71321]:     <mode name='host-passthrough' supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='hostPassthroughMigratable'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>off</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </mode>
Apr 12 12:24:16 user nova-compute[71321]:     <mode name='maximum' supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='maximumMigratable'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>on</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>off</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </mode>
Apr 12 12:24:16 user nova-compute[71321]:     <mode name='host-model' supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <vendor>Intel</vendor>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='ss'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='vmx'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='pcid'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='hypervisor'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='arat'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='umip'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='md-clear'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='stibp'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='ssbd'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='ibpb'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='ibrs'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='amd-stibp'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='disable' name='erms'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='disable' name='lm'/>
Apr 12 12:24:16 user nova-compute[71321]:     </mode>
Apr 12 12:24:16 user nova-compute[71321]:     <mode name='custom' supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>qemu64</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>qemu32</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>phenom</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>pentium3</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>pentium2</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>pentium</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>n270</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>kvm64</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>kvm32</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>coreduo</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>core2duo</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>athlon</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Westmere-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Westmere</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Snowridge</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Server</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Client</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>SandyBridge</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Penryn</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G5</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G4</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G3</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G2</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G1</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Nehalem-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Nehalem</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>IvyBridge</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Icelake-Server</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Haswell</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>EPYC-Rome</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>EPYC-Milan</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>EPYC</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Dhyana</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Cooperlake</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Conroe</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Broadwell</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>486</model>
Apr 12 12:24:16 user nova-compute[71321]:     </mode>
Apr 12 12:24:16 user nova-compute[71321]:   </cpu>
Apr 12 12:24:16 user nova-compute[71321]:   <memoryBacking supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:     <enum name='sourceType'>
Apr 12 12:24:16 user nova-compute[71321]:       <value>file</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>anonymous</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>memfd</value>
Apr 12 12:24:16 user nova-compute[71321]:     </enum>
Apr 12 12:24:16 user nova-compute[71321]:   </memoryBacking>
Apr 12 12:24:16 user nova-compute[71321]:   <devices>
Apr 12 12:24:16 user nova-compute[71321]:     <disk supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='diskDevice'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>disk</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>cdrom</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>floppy</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>lun</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='bus'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>fdc</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>scsi</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>usb</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>sata</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='model'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio-transitional</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio-non-transitional</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </disk>
Apr 12 12:24:16 user nova-compute[71321]:     <graphics supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='type'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>sdl</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>vnc</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>spice</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>egl-headless</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </graphics>
Apr 12 12:24:16 user nova-compute[71321]:     <video supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='modelType'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>vga</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>cirrus</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>vmvga</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>qxl</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>none</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>bochs</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>ramfb</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </video>
Apr 12 12:24:16 user nova-compute[71321]:     <hostdev supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='mode'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>subsystem</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='startupPolicy'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>default</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>mandatory</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>requisite</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>optional</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='subsysType'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>usb</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>pci</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>scsi</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='capsType'/>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='pciBackend'/>
Apr 12 12:24:16 user nova-compute[71321]:     </hostdev>
Apr 12 12:24:16 user nova-compute[71321]:     <rng supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='model'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio-transitional</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio-non-transitional</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='backendModel'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>random</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>egd</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>builtin</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </rng>
Apr 12 12:24:16 user nova-compute[71321]:     <filesystem supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='driverType'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>path</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>handle</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtiofs</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </filesystem>
Apr 12 12:24:16 user nova-compute[71321]:     <tpm supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='model'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>tpm-tis</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>tpm-crb</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='backendModel'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>passthrough</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>emulator</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </tpm>
Apr 12 12:24:16 user nova-compute[71321]:   </devices>
Apr 12 12:24:16 user nova-compute[71321]:   <features>
Apr 12 12:24:16 user nova-compute[71321]:     <gic supported='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     <vmcoreinfo supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:     <genid supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:     <backingStoreInput supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:     <backup supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:     <sev supported='no'/>
Apr 12 12:24:16 user nova-compute[71321]:   </features>
Apr 12 12:24:16 user nova-compute[71321]: </domainCapabilities>
Apr 12 12:24:16 user nova-compute[71321]:  {{(pid=71321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Apr 12 12:24:16 user nova-compute[71321]: <domainCapabilities>
Apr 12 12:24:16 user nova-compute[71321]:   <path>/usr/bin/qemu-system-i386</path>
Apr 12 12:24:16 user nova-compute[71321]:   <domain>kvm</domain>
Apr 12 12:24:16 user nova-compute[71321]:   <machine>pc-q35-jammy</machine>
Apr 12 12:24:16 user nova-compute[71321]:   <arch>i686</arch>
Apr 12 12:24:16 user nova-compute[71321]:   <vcpu max='288'/>
Apr 12 12:24:16 user nova-compute[71321]:   <iothreads supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:   <os supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:     <enum name='firmware'/>
Apr 12 12:24:16 user nova-compute[71321]:     <loader supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='type'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>rom</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>pflash</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='readonly'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>yes</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>no</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='secure'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>no</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </loader>
Apr 12 12:24:16 user nova-compute[71321]:   </os>
Apr 12 12:24:16 user nova-compute[71321]:   <cpu>
Apr 12 12:24:16 user nova-compute[71321]:     <mode name='host-passthrough' supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='hostPassthroughMigratable'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>off</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </mode>
Apr 12 12:24:16 user nova-compute[71321]:     <mode name='maximum' supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='maximumMigratable'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>on</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>off</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </mode>
Apr 12 12:24:16 user nova-compute[71321]:     <mode name='host-model' supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <vendor>Intel</vendor>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='ss'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='vmx'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='pcid'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='hypervisor'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='arat'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='umip'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='md-clear'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='stibp'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='ssbd'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='ibpb'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='ibrs'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='amd-stibp'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='disable' name='erms'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='disable' name='lm'/>
Apr 12 12:24:16 user nova-compute[71321]:     </mode>
Apr 12 12:24:16 user nova-compute[71321]:     <mode name='custom' supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>qemu64</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>qemu32</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>phenom</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>pentium3</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>pentium2</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>pentium</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>n270</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>kvm64</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>kvm32</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>coreduo</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>core2duo</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>athlon</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Westmere-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Westmere</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Snowridge</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Server</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Client</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>SandyBridge</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Penryn</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G5</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G4</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G3</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G2</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G1</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Nehalem-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Nehalem</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>IvyBridge</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Icelake-Server</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Haswell</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>EPYC-Rome</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>EPYC-Milan</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>EPYC</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Dhyana</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Cooperlake</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Conroe</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Broadwell</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>486</model>
Apr 12 12:24:16 user nova-compute[71321]:     </mode>
Apr 12 12:24:16 user nova-compute[71321]:   </cpu>
Apr 12 12:24:16 user nova-compute[71321]:   <memoryBacking supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:     <enum name='sourceType'>
Apr 12 12:24:16 user nova-compute[71321]:       <value>file</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>anonymous</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>memfd</value>
Apr 12 12:24:16 user nova-compute[71321]:     </enum>
Apr 12 12:24:16 user nova-compute[71321]:   </memoryBacking>
Apr 12 12:24:16 user nova-compute[71321]:   <devices>
Apr 12 12:24:16 user nova-compute[71321]:     <disk supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='diskDevice'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>disk</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>cdrom</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>floppy</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>lun</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='bus'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>fdc</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>scsi</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>usb</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>sata</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='model'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio-transitional</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio-non-transitional</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </disk>
Apr 12 12:24:16 user nova-compute[71321]:     <graphics supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='type'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>sdl</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>vnc</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>spice</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>egl-headless</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </graphics>
Apr 12 12:24:16 user nova-compute[71321]:     <video supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='modelType'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>vga</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>cirrus</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>vmvga</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>qxl</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>none</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>bochs</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>ramfb</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </video>
Apr 12 12:24:16 user nova-compute[71321]:     <hostdev supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='mode'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>subsystem</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='startupPolicy'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>default</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>mandatory</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>requisite</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>optional</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='subsysType'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>usb</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>pci</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>scsi</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='capsType'/>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='pciBackend'/>
Apr 12 12:24:16 user nova-compute[71321]:     </hostdev>
Apr 12 12:24:16 user nova-compute[71321]:     <rng supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='model'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio-transitional</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio-non-transitional</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='backendModel'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>random</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>egd</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>builtin</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </rng>
Apr 12 12:24:16 user nova-compute[71321]:     <filesystem supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='driverType'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>path</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>handle</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtiofs</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </filesystem>
Apr 12 12:24:16 user nova-compute[71321]:     <tpm supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='model'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>tpm-tis</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>tpm-crb</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='backendModel'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>passthrough</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>emulator</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </tpm>
Apr 12 12:24:16 user nova-compute[71321]:   </devices>
Apr 12 12:24:16 user nova-compute[71321]:   <features>
Apr 12 12:24:16 user nova-compute[71321]:     <gic supported='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     <vmcoreinfo supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:     <genid supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:     <backingStoreInput supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:     <backup supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:     <sev supported='no'/>
Apr 12 12:24:16 user nova-compute[71321]:   </features>
Apr 12 12:24:16 user nova-compute[71321]: </domainCapabilities>
Apr 12 12:24:16 user nova-compute[71321]:  {{(pid=71321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=71321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71321) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71321) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=71321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=71321) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=71321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=71321) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Getting domain capabilities for mips via machine types: {None} {{(pid=71321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=71321) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=71321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=71321) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=71321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=71321) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=71321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=71321) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=71321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=71321) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=71321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71321) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71321) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71321) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=71321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71321) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71321) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=71321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=71321) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=71321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=71321) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=71321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=71321) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=71321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=71321) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=71321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=71321) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=71321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=71321) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=71321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=71321) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'pc', 'q35', 'ubuntu-q35'} {{(pid=71321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Apr 12 12:24:16 user nova-compute[71321]: <domainCapabilities>
Apr 12 12:24:16 user nova-compute[71321]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 12 12:24:16 user nova-compute[71321]:   <domain>kvm</domain>
Apr 12 12:24:16 user nova-compute[71321]:   <machine>pc-i440fx-jammy</machine>
Apr 12 12:24:16 user nova-compute[71321]:   <arch>x86_64</arch>
Apr 12 12:24:16 user nova-compute[71321]:   <vcpu max='255'/>
Apr 12 12:24:16 user nova-compute[71321]:   <iothreads supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:   <os supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:     <enum name='firmware'>
Apr 12 12:24:16 user nova-compute[71321]:       <value>efi</value>
Apr 12 12:24:16 user nova-compute[71321]:     </enum>
Apr 12 12:24:16 user nova-compute[71321]:     <loader supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='type'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>rom</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>pflash</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='readonly'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>yes</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>no</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='secure'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>no</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </loader>
Apr 12 12:24:16 user nova-compute[71321]:   </os>
Apr 12 12:24:16 user nova-compute[71321]:   <cpu>
Apr 12 12:24:16 user nova-compute[71321]:     <mode name='host-passthrough' supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='hostPassthroughMigratable'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>on</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>off</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </mode>
Apr 12 12:24:16 user nova-compute[71321]:     <mode name='maximum' supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='maximumMigratable'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>on</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>off</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </mode>
Apr 12 12:24:16 user nova-compute[71321]:     <mode name='host-model' supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <vendor>Intel</vendor>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='ss'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='vmx'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='pcid'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='hypervisor'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='arat'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='umip'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='md-clear'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='stibp'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='ssbd'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='invtsc'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='ibpb'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='ibrs'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='amd-stibp'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='rsba'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='pschange-mc-no'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='disable' name='erms'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 12:24:16 user nova-compute[71321]:     </mode>
Apr 12 12:24:16 user nova-compute[71321]:     <mode name='custom' supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>qemu64</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>qemu32</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>phenom</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>pentium3</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>pentium2</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>pentium</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>n270</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>kvm64</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>kvm32</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>coreduo</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>core2duo</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>athlon</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>Westmere-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>Westmere</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Snowridge</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Server</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Client</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>SandyBridge</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>Penryn</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G5</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G4</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G3</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G2</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>Opteron_G1</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>Nehalem</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>IvyBridge</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Icelake-Server</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Haswell</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>EPYC-Rome</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>EPYC-Milan</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>EPYC</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Dhyana</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Cooperlake</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>Conroe</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Broadwell</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>486</model>
Apr 12 12:24:16 user nova-compute[71321]:     </mode>
Apr 12 12:24:16 user nova-compute[71321]:   </cpu>
Apr 12 12:24:16 user nova-compute[71321]:   <memoryBacking supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:     <enum name='sourceType'>
Apr 12 12:24:16 user nova-compute[71321]:       <value>file</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>anonymous</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>memfd</value>
Apr 12 12:24:16 user nova-compute[71321]:     </enum>
Apr 12 12:24:16 user nova-compute[71321]:   </memoryBacking>
Apr 12 12:24:16 user nova-compute[71321]:   <devices>
Apr 12 12:24:16 user nova-compute[71321]:     <disk supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='diskDevice'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>disk</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>cdrom</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>floppy</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>lun</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='bus'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>ide</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>fdc</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>scsi</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>usb</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>sata</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='model'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio-transitional</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio-non-transitional</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </disk>
Apr 12 12:24:16 user nova-compute[71321]:     <graphics supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='type'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>sdl</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>vnc</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>spice</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>egl-headless</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </graphics>
Apr 12 12:24:16 user nova-compute[71321]:     <video supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='modelType'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>vga</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>cirrus</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>vmvga</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>qxl</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>none</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>bochs</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>ramfb</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </video>
Apr 12 12:24:16 user nova-compute[71321]:     <hostdev supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='mode'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>subsystem</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='startupPolicy'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>default</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>mandatory</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>requisite</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>optional</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='subsysType'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>usb</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>pci</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>scsi</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='capsType'/>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='pciBackend'/>
Apr 12 12:24:16 user nova-compute[71321]:     </hostdev>
Apr 12 12:24:16 user nova-compute[71321]:     <rng supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='model'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio-transitional</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio-non-transitional</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='backendModel'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>random</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>egd</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>builtin</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </rng>
Apr 12 12:24:16 user nova-compute[71321]:     <filesystem supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='driverType'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>path</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>handle</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtiofs</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </filesystem>
Apr 12 12:24:16 user nova-compute[71321]:     <tpm supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='model'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>tpm-tis</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>tpm-crb</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='backendModel'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>passthrough</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>emulator</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </tpm>
Apr 12 12:24:16 user nova-compute[71321]:   </devices>
Apr 12 12:24:16 user nova-compute[71321]:   <features>
Apr 12 12:24:16 user nova-compute[71321]:     <gic supported='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     <vmcoreinfo supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:     <genid supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:     <backingStoreInput supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:     <backup supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:     <sev supported='no'/>
Apr 12 12:24:16 user nova-compute[71321]:   </features>
Apr 12 12:24:16 user nova-compute[71321]: </domainCapabilities>
Apr 12 12:24:16 user nova-compute[71321]:  {{(pid=71321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Apr 12 12:24:16 user nova-compute[71321]: <domainCapabilities>
Apr 12 12:24:16 user nova-compute[71321]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 12 12:24:16 user nova-compute[71321]:   <domain>kvm</domain>
Apr 12 12:24:16 user nova-compute[71321]:   <machine>pc-i440fx-6.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:   <arch>x86_64</arch>
Apr 12 12:24:16 user nova-compute[71321]:   <vcpu max='255'/>
Apr 12 12:24:16 user nova-compute[71321]:   <iothreads supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:   <os supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:     <enum name='firmware'>
Apr 12 12:24:16 user nova-compute[71321]:       <value>efi</value>
Apr 12 12:24:16 user nova-compute[71321]:     </enum>
Apr 12 12:24:16 user nova-compute[71321]:     <loader supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='type'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>rom</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>pflash</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='readonly'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>yes</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>no</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='secure'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>no</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </loader>
Apr 12 12:24:16 user nova-compute[71321]:   </os>
Apr 12 12:24:16 user nova-compute[71321]:   <cpu>
Apr 12 12:24:16 user nova-compute[71321]:     <mode name='host-passthrough' supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='hostPassthroughMigratable'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>on</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>off</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </mode>
Apr 12 12:24:16 user nova-compute[71321]:     <mode name='maximum' supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='maximumMigratable'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>on</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>off</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </mode>
Apr 12 12:24:16 user nova-compute[71321]:     <mode name='host-model' supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <vendor>Intel</vendor>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='ss'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='vmx'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='pcid'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='hypervisor'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='arat'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='umip'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='md-clear'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='stibp'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='ssbd'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='invtsc'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='ibpb'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='ibrs'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='amd-stibp'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='rsba'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='pschange-mc-no'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='disable' name='erms'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 12:24:16 user nova-compute[71321]:     </mode>
Apr 12 12:24:16 user nova-compute[71321]:     <mode name='custom' supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>qemu64</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>qemu32</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>phenom</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>pentium3</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>pentium2</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>pentium</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>n270</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>kvm64</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>kvm32</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>coreduo</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>core2duo</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>athlon</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>Westmere-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>Westmere</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Snowridge</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Server</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Client</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>SandyBridge</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>Penryn</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G5</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G4</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G3</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G2</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>Opteron_G1</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>Nehalem</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>IvyBridge</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Icelake-Server</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Haswell</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>EPYC-Rome</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>EPYC-Milan</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>EPYC</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Dhyana</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Cooperlake</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>Conroe</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Broadwell</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>486</model>
Apr 12 12:24:16 user nova-compute[71321]:     </mode>
Apr 12 12:24:16 user nova-compute[71321]:   </cpu>
Apr 12 12:24:16 user nova-compute[71321]:   <memoryBacking supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:     <enum name='sourceType'>
Apr 12 12:24:16 user nova-compute[71321]:       <value>file</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>anonymous</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>memfd</value>
Apr 12 12:24:16 user nova-compute[71321]:     </enum>
Apr 12 12:24:16 user nova-compute[71321]:   </memoryBacking>
Apr 12 12:24:16 user nova-compute[71321]:   <devices>
Apr 12 12:24:16 user nova-compute[71321]:     <disk supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='diskDevice'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>disk</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>cdrom</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>floppy</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>lun</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='bus'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>ide</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>fdc</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>scsi</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>usb</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>sata</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='model'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio-transitional</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio-non-transitional</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </disk>
Apr 12 12:24:16 user nova-compute[71321]:     <graphics supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='type'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>sdl</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>vnc</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>spice</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>egl-headless</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </graphics>
Apr 12 12:24:16 user nova-compute[71321]:     <video supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='modelType'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>vga</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>cirrus</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>vmvga</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>qxl</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>none</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>bochs</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>ramfb</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </video>
Apr 12 12:24:16 user nova-compute[71321]:     <hostdev supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='mode'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>subsystem</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='startupPolicy'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>default</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>mandatory</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>requisite</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>optional</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='subsysType'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>usb</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>pci</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>scsi</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='capsType'/>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='pciBackend'/>
Apr 12 12:24:16 user nova-compute[71321]:     </hostdev>
Apr 12 12:24:16 user nova-compute[71321]:     <rng supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='model'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio-transitional</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio-non-transitional</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='backendModel'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>random</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>egd</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>builtin</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </rng>
Apr 12 12:24:16 user nova-compute[71321]:     <filesystem supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='driverType'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>path</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>handle</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtiofs</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </filesystem>
Apr 12 12:24:16 user nova-compute[71321]:     <tpm supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='model'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>tpm-tis</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>tpm-crb</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='backendModel'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>passthrough</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>emulator</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </tpm>
Apr 12 12:24:16 user nova-compute[71321]:   </devices>
Apr 12 12:24:16 user nova-compute[71321]:   <features>
Apr 12 12:24:16 user nova-compute[71321]:     <gic supported='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     <vmcoreinfo supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:     <genid supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:     <backingStoreInput supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:     <backup supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:     <sev supported='no'/>
Apr 12 12:24:16 user nova-compute[71321]:   </features>
Apr 12 12:24:16 user nova-compute[71321]: </domainCapabilities>
Apr 12 12:24:16 user nova-compute[71321]:  {{(pid=71321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Apr 12 12:24:16 user nova-compute[71321]: <domainCapabilities>
Apr 12 12:24:16 user nova-compute[71321]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 12 12:24:16 user nova-compute[71321]:   <domain>kvm</domain>
Apr 12 12:24:16 user nova-compute[71321]:   <machine>pc-q35-6.2</machine>
Apr 12 12:24:16 user nova-compute[71321]:   <arch>x86_64</arch>
Apr 12 12:24:16 user nova-compute[71321]:   <vcpu max='288'/>
Apr 12 12:24:16 user nova-compute[71321]:   <iothreads supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:   <os supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:     <enum name='firmware'>
Apr 12 12:24:16 user nova-compute[71321]:       <value>efi</value>
Apr 12 12:24:16 user nova-compute[71321]:     </enum>
Apr 12 12:24:16 user nova-compute[71321]:     <loader supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='type'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>rom</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>pflash</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='readonly'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>yes</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>no</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='secure'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>yes</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>no</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </loader>
Apr 12 12:24:16 user nova-compute[71321]:   </os>
Apr 12 12:24:16 user nova-compute[71321]:   <cpu>
Apr 12 12:24:16 user nova-compute[71321]:     <mode name='host-passthrough' supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='hostPassthroughMigratable'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>on</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>off</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </mode>
Apr 12 12:24:16 user nova-compute[71321]:     <mode name='maximum' supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='maximumMigratable'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>on</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>off</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </mode>
Apr 12 12:24:16 user nova-compute[71321]:     <mode name='host-model' supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <vendor>Intel</vendor>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='ss'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='vmx'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='pcid'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='hypervisor'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='arat'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='umip'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='md-clear'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='stibp'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='ssbd'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='invtsc'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='ibpb'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='ibrs'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='amd-stibp'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='rsba'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='pschange-mc-no'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='disable' name='erms'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 12:24:16 user nova-compute[71321]:     </mode>
Apr 12 12:24:16 user nova-compute[71321]:     <mode name='custom' supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>qemu64</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>qemu32</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>phenom</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>pentium3</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>pentium2</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>pentium</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>n270</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>kvm64</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>kvm32</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>coreduo</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>core2duo</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>athlon</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>Westmere-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>Westmere</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Snowridge</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Server</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Client</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>SandyBridge</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>Penryn</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G5</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G4</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G3</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G2</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>Opteron_G1</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>Nehalem</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>IvyBridge</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Icelake-Server</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Haswell</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>EPYC-Rome</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>EPYC-Milan</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>EPYC</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Dhyana</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Cooperlake</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>Conroe</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Broadwell</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>486</model>
Apr 12 12:24:16 user nova-compute[71321]:     </mode>
Apr 12 12:24:16 user nova-compute[71321]:   </cpu>
Apr 12 12:24:16 user nova-compute[71321]:   <memoryBacking supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:     <enum name='sourceType'>
Apr 12 12:24:16 user nova-compute[71321]:       <value>file</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>anonymous</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>memfd</value>
Apr 12 12:24:16 user nova-compute[71321]:     </enum>
Apr 12 12:24:16 user nova-compute[71321]:   </memoryBacking>
Apr 12 12:24:16 user nova-compute[71321]:   <devices>
Apr 12 12:24:16 user nova-compute[71321]:     <disk supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='diskDevice'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>disk</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>cdrom</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>floppy</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>lun</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='bus'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>fdc</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>scsi</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>usb</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>sata</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='model'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio-transitional</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio-non-transitional</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </disk>
Apr 12 12:24:16 user nova-compute[71321]:     <graphics supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='type'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>sdl</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>vnc</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>spice</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>egl-headless</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </graphics>
Apr 12 12:24:16 user nova-compute[71321]:     <video supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='modelType'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>vga</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>cirrus</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>vmvga</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>qxl</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>none</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>bochs</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>ramfb</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </video>
Apr 12 12:24:16 user nova-compute[71321]:     <hostdev supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='mode'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>subsystem</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='startupPolicy'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>default</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>mandatory</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>requisite</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>optional</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='subsysType'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>usb</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>pci</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>scsi</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='capsType'/>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='pciBackend'/>
Apr 12 12:24:16 user nova-compute[71321]:     </hostdev>
Apr 12 12:24:16 user nova-compute[71321]:     <rng supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='model'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio-transitional</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio-non-transitional</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='backendModel'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>random</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>egd</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>builtin</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </rng>
Apr 12 12:24:16 user nova-compute[71321]:     <filesystem supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='driverType'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>path</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>handle</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtiofs</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </filesystem>
Apr 12 12:24:16 user nova-compute[71321]:     <tpm supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='model'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>tpm-tis</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>tpm-crb</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='backendModel'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>passthrough</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>emulator</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </tpm>
Apr 12 12:24:16 user nova-compute[71321]:   </devices>
Apr 12 12:24:16 user nova-compute[71321]:   <features>
Apr 12 12:24:16 user nova-compute[71321]:     <gic supported='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     <vmcoreinfo supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:     <genid supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:     <backingStoreInput supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:     <backup supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:     <sev supported='no'/>
Apr 12 12:24:16 user nova-compute[71321]:   </features>
Apr 12 12:24:16 user nova-compute[71321]: </domainCapabilities>
Apr 12 12:24:16 user nova-compute[71321]:  {{(pid=71321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Apr 12 12:24:16 user nova-compute[71321]: <domainCapabilities>
Apr 12 12:24:16 user nova-compute[71321]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 12 12:24:16 user nova-compute[71321]:   <domain>kvm</domain>
Apr 12 12:24:16 user nova-compute[71321]:   <machine>pc-q35-jammy</machine>
Apr 12 12:24:16 user nova-compute[71321]:   <arch>x86_64</arch>
Apr 12 12:24:16 user nova-compute[71321]:   <vcpu max='288'/>
Apr 12 12:24:16 user nova-compute[71321]:   <iothreads supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:   <os supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:     <enum name='firmware'>
Apr 12 12:24:16 user nova-compute[71321]:       <value>efi</value>
Apr 12 12:24:16 user nova-compute[71321]:     </enum>
Apr 12 12:24:16 user nova-compute[71321]:     <loader supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='type'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>rom</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>pflash</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='readonly'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>yes</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>no</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='secure'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>yes</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>no</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </loader>
Apr 12 12:24:16 user nova-compute[71321]:   </os>
Apr 12 12:24:16 user nova-compute[71321]:   <cpu>
Apr 12 12:24:16 user nova-compute[71321]:     <mode name='host-passthrough' supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='hostPassthroughMigratable'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>on</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>off</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </mode>
Apr 12 12:24:16 user nova-compute[71321]:     <mode name='maximum' supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='maximumMigratable'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>on</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>off</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </mode>
Apr 12 12:24:16 user nova-compute[71321]:     <mode name='host-model' supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <vendor>Intel</vendor>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='ss'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='vmx'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='pcid'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='hypervisor'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='arat'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='umip'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='md-clear'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='stibp'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='ssbd'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='invtsc'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='ibpb'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='ibrs'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='amd-stibp'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='rsba'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='require' name='pschange-mc-no'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='disable' name='erms'/>
Apr 12 12:24:16 user nova-compute[71321]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 12:24:16 user nova-compute[71321]:     </mode>
Apr 12 12:24:16 user nova-compute[71321]:     <mode name='custom' supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>qemu64</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>qemu32</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>phenom</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>pentium3</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>pentium2</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>pentium</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>n270</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>kvm64</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>kvm32</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>coreduo</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>core2duo</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>athlon</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>Westmere-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>Westmere</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Snowridge</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Server</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Skylake-Client</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>SandyBridge</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>Penryn</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G5</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G4</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G3</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Opteron_G2</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>Opteron_G1</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>Nehalem</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>IvyBridge</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Icelake-Server</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Haswell</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>EPYC-Rome</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>EPYC-Milan</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>EPYC</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Dhyana</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Cooperlake</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>Conroe</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='no'>Broadwell</model>
Apr 12 12:24:16 user nova-compute[71321]:       <model usable='yes'>486</model>
Apr 12 12:24:16 user nova-compute[71321]:     </mode>
Apr 12 12:24:16 user nova-compute[71321]:   </cpu>
Apr 12 12:24:16 user nova-compute[71321]:   <memoryBacking supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:     <enum name='sourceType'>
Apr 12 12:24:16 user nova-compute[71321]:       <value>file</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>anonymous</value>
Apr 12 12:24:16 user nova-compute[71321]:       <value>memfd</value>
Apr 12 12:24:16 user nova-compute[71321]:     </enum>
Apr 12 12:24:16 user nova-compute[71321]:   </memoryBacking>
Apr 12 12:24:16 user nova-compute[71321]:   <devices>
Apr 12 12:24:16 user nova-compute[71321]:     <disk supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='diskDevice'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>disk</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>cdrom</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>floppy</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>lun</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='bus'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>fdc</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>scsi</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>usb</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>sata</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='model'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio-transitional</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio-non-transitional</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </disk>
Apr 12 12:24:16 user nova-compute[71321]:     <graphics supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='type'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>sdl</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>vnc</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>spice</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>egl-headless</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </graphics>
Apr 12 12:24:16 user nova-compute[71321]:     <video supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='modelType'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>vga</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>cirrus</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>vmvga</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>qxl</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>none</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>bochs</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>ramfb</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </video>
Apr 12 12:24:16 user nova-compute[71321]:     <hostdev supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='mode'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>subsystem</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='startupPolicy'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>default</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>mandatory</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>requisite</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>optional</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='subsysType'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>usb</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>pci</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>scsi</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='capsType'/>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='pciBackend'/>
Apr 12 12:24:16 user nova-compute[71321]:     </hostdev>
Apr 12 12:24:16 user nova-compute[71321]:     <rng supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='model'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio-transitional</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtio-non-transitional</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='backendModel'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>random</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>egd</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>builtin</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </rng>
Apr 12 12:24:16 user nova-compute[71321]:     <filesystem supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='driverType'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>path</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>handle</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>virtiofs</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </filesystem>
Apr 12 12:24:16 user nova-compute[71321]:     <tpm supported='yes'>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='model'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>tpm-tis</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>tpm-crb</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:       <enum name='backendModel'>
Apr 12 12:24:16 user nova-compute[71321]:         <value>passthrough</value>
Apr 12 12:24:16 user nova-compute[71321]:         <value>emulator</value>
Apr 12 12:24:16 user nova-compute[71321]:       </enum>
Apr 12 12:24:16 user nova-compute[71321]:     </tpm>
Apr 12 12:24:16 user nova-compute[71321]:   </devices>
Apr 12 12:24:16 user nova-compute[71321]:   <features>
Apr 12 12:24:16 user nova-compute[71321]:     <gic supported='no'/>
Apr 12 12:24:16 user nova-compute[71321]:     <vmcoreinfo supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:     <genid supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:     <backingStoreInput supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:     <backup supported='yes'/>
Apr 12 12:24:16 user nova-compute[71321]:     <sev supported='no'/>
Apr 12 12:24:16 user nova-compute[71321]:   </features>
Apr 12 12:24:16 user nova-compute[71321]: </domainCapabilities>
Apr 12 12:24:16 user nova-compute[71321]:  {{(pid=71321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=71321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=71321) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=71321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=71321) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Checking secure boot support for host arch (x86_64) {{(pid=71321) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Checking secure boot support for host arch (x86_64) {{(pid=71321) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Checking secure boot support for host arch (x86_64) {{(pid=71321) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Checking secure boot support for host arch (x86_64) {{(pid=71321) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Checking secure boot support for host arch (x86_64) {{(pid=71321) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 12 12:24:16 user nova-compute[71321]: INFO nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Secure Boot support detected
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] cpu compare xml: <cpu match="exact">
Apr 12 12:24:16 user nova-compute[71321]:   <model>Nehalem</model>
Apr 12 12:24:16 user nova-compute[71321]: </cpu>
Apr 12 12:24:16 user nova-compute[71321]:  {{(pid=71321) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:9996}}
Apr 12 12:24:16 user nova-compute[71321]: INFO nova.virt.node [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Generated node identity 7ca624fd-d5cc-42af-93e3-9d62256fa231
Apr 12 12:24:16 user nova-compute[71321]: INFO nova.virt.node [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Wrote node identity 7ca624fd-d5cc-42af-93e3-9d62256fa231 to /opt/stack/data/nova/compute_id
Apr 12 12:24:16 user nova-compute[71321]: WARNING nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Compute nodes ['7ca624fd-d5cc-42af-93e3-9d62256fa231'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Apr 12 12:24:16 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Apr 12 12:24:16 user nova-compute[71321]: WARNING nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 12 12:24:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:24:16 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:24:16 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:24:16 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Hypervisor/Node resource view: name=user free_ram=10807MB free_disk=27.162860870361328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:24:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:24:16 user nova-compute[71321]: WARNING nova.compute.resource_tracker [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] No compute node record for user:7ca624fd-d5cc-42af-93e3-9d62256fa231: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 7ca624fd-d5cc-42af-93e3-9d62256fa231 could not be found.
Apr 12 12:24:16 user nova-compute[71321]: INFO nova.compute.resource_tracker [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Compute node record created for user:user with uuid: 7ca624fd-d5cc-42af-93e3-9d62256fa231
Apr 12 12:24:17 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:24:17 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:24:17 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [req-41a0ac98-b32c-4e11-986f-a2763de10d8b] Created resource provider record via placement API for resource provider with UUID 7ca624fd-d5cc-42af-93e3-9d62256fa231 and name user.
Apr 12 12:24:17 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=71321) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1766}}
Apr 12 12:24:17 user nova-compute[71321]: INFO nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] kernel doesn't support AMD SEV
Apr 12 12:24:17 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Updating inventory in ProviderTree for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 with inventory: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 12:24:17 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:24:17 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Libvirt baseline CPU <cpu>
Apr 12 12:24:17 user nova-compute[71321]:   <arch>x86_64</arch>
Apr 12 12:24:17 user nova-compute[71321]:   <model>Nehalem</model>
Apr 12 12:24:17 user nova-compute[71321]:   <vendor>Intel</vendor>
Apr 12 12:24:17 user nova-compute[71321]:   <topology sockets="6" cores="1" threads="1"/>
Apr 12 12:24:17 user nova-compute[71321]: </cpu>
Apr 12 12:24:17 user nova-compute[71321]:  {{(pid=71321) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12486}}
Apr 12 12:24:17 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Updated inventory for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Apr 12 12:24:17 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Updating resource provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 generation from 0 to 1 during operation: update_inventory {{(pid=71321) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 12 12:24:17 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Updating inventory in ProviderTree for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 with inventory: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 12:24:17 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Updating resource provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 generation from 1 to 2 during operation: update_traits {{(pid=71321) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 12 12:24:17 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:24:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.663s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:24:17 user nova-compute[71321]: DEBUG nova.service [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Creating RPC server for service compute {{(pid=71321) start /opt/stack/nova/nova/service.py:182}}
Apr 12 12:24:17 user nova-compute[71321]: DEBUG nova.service [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Join ServiceGroup membership for this service compute {{(pid=71321) start /opt/stack/nova/nova/service.py:199}}
Apr 12 12:24:17 user nova-compute[71321]: DEBUG nova.servicegroup.drivers.db [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=71321) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Apr 12 12:24:32 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:24:32 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:25:08 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:25:08 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:25:08 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:25:08 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Rebuilding the list of instances to heal {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 12:25:08 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Didn't find any instances for network info cache update. {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 12:25:08 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:25:08 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:25:08 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:25:08 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:25:08 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:25:08 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:25:08 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:25:08 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:25:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:25:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:25:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:25:08 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:25:09 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:25:09 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:25:09 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=10195MB free_disk=27.07666015625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:25:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:25:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:25:09 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:25:09 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:25:09 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:25:09 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:25:09 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:25:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:26:09 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:26:09 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:26:09 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:26:09 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Rebuilding the list of instances to heal {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 12:26:09 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Didn't find any instances for network info cache update. {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 12:26:09 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:26:09 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:26:09 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:26:09 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:26:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:26:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:26:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:26:09 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:26:09 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:26:09 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:26:09 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=10153MB free_disk=27.12276840209961GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:26:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:26:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:26:09 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:26:09 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:26:09 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:26:09 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:26:09 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:26:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.122s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:26:10 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:26:10 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:26:10 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:26:10 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:26:10 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:27:09 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:27:09 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:27:09 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Rebuilding the list of instances to heal {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 12:27:09 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Didn't find any instances for network info cache update. {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 12:27:09 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:27:10 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:27:10 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:27:10 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:27:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:27:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:27:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:27:10 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:27:10 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:27:10 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:27:10 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=10164MB free_disk=26.898792266845703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:27:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:27:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:27:10 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:27:10 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:27:10 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:27:10 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:27:10 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:27:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:27:11 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:27:11 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:27:12 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:27:12 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:27:12 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:28:09 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:28:09 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:28:09 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Rebuilding the list of instances to heal {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 12:28:09 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Didn't find any instances for network info cache update. {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 12:28:09 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:28:10 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:28:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:10 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:28:10 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:28:10 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:28:10 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=9414MB free_disk=26.921222686767578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:28:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:10 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:28:10 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:28:10 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:28:10 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:28:11 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:28:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:12 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:28:12 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:28:12 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:28:12 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:28:12 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:28:12 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:28:12 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:28:13 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:28:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "10116da0-785c-41cf-96bb-95721af863db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "10116da0-785c-41cf-96bb-95721af863db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:14 user nova-compute[71321]: DEBUG nova.compute.manager [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:28:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:14 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:28:14 user nova-compute[71321]: INFO nova.compute.claims [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Claim successful on node user
Apr 12 12:28:14 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:28:14 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:28:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.317s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:14 user nova-compute[71321]: DEBUG nova.compute.manager [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:28:15 user nova-compute[71321]: DEBUG nova.compute.manager [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:28:15 user nova-compute[71321]: DEBUG nova.network.neutron [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:28:15 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:28:15 user nova-compute[71321]: DEBUG nova.compute.manager [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:28:15 user nova-compute[71321]: DEBUG nova.compute.manager [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:28:15 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:28:15 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Creating image(s)
Apr 12 12:28:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "/opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "/opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "/opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:15 user nova-compute[71321]: DEBUG nova.policy [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1db0203a6e6f4cc3bccbf19577a0c82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ec9671123c4a00a2880de4b4df8d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:28:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787.part --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787.part --force-share --output=json" returned: 0 in 0.151s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:16 user nova-compute[71321]: DEBUG nova.virt.images [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10cdaa6e-1722-4d2a-835d-7b112d771c50 was qcow2, converting to raw {{(pid=71321) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 12:28:16 user nova-compute[71321]: DEBUG nova.privsep.utils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 12:28:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787.part /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787.converted {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787.part /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787.converted" returned: 0 in 0.152s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787.converted --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787.converted --force-share --output=json" returned: 0 in 0.134s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.303s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:16 user nova-compute[71321]: INFO oslo.privsep.daemon [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpyav33na7/privsep.sock']
Apr 12 12:28:16 user sudo[80274]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpyav33na7/privsep.sock
Apr 12 12:28:16 user sudo[80274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 12:28:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.009s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:17 user nova-compute[71321]: DEBUG nova.compute.manager [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:28:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:17 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:28:17 user nova-compute[71321]: INFO nova.compute.claims [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Claim successful on node user
Apr 12 12:28:17 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:28:17 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:28:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.238s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:17 user nova-compute[71321]: DEBUG nova.compute.manager [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:28:17 user nova-compute[71321]: DEBUG nova.compute.manager [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:28:17 user nova-compute[71321]: DEBUG nova.network.neutron [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:28:17 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:28:17 user nova-compute[71321]: DEBUG nova.compute.manager [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:28:17 user nova-compute[71321]: DEBUG nova.compute.manager [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:28:17 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:28:17 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Creating image(s)
Apr 12 12:28:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "/opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "/opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "/opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:17 user nova-compute[71321]: DEBUG nova.policy [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1db0203a6e6f4cc3bccbf19577a0c82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ec9671123c4a00a2880de4b4df8d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:28:18 user sudo[80274]: pam_unix(sudo:session): session closed for user root
Apr 12 12:28:18 user nova-compute[71321]: INFO oslo.privsep.daemon [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Spawned new privsep daemon via rootwrap
Apr 12 12:28:18 user nova-compute[71321]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 12 12:28:18 user nova-compute[71321]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 12 12:28:18 user nova-compute[71321]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 12 12:28:18 user nova-compute[71321]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80278
Apr 12 12:28:18 user nova-compute[71321]: WARNING oslo_privsep.priv_context [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] privsep daemon already running
Apr 12 12:28:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.163s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.216s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.152s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk 1073741824" returned: 0 in 0.048s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.151s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.139s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:18 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:28:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.153s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk 1073741824" returned: 0 in 0.063s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:19 user nova-compute[71321]: DEBUG nova.network.neutron [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Successfully created port: cbb69638-6a5f-4d12-8737-45850145fa0e {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:28:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:19 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Cannot resize image /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:28:19 user nova-compute[71321]: DEBUG nova.objects.instance [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'migration_context' on Instance uuid a4107f2d-88e4-4846-9ece-cb16ad7ecd02 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:28:19 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:28:19 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Ensure instance console log exists: /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:28:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.141s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:19 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Checking if we can resize image /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:28:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:19 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Cannot resize image /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:28:19 user nova-compute[71321]: DEBUG nova.objects.instance [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'migration_context' on Instance uuid 10116da0-785c-41cf-96bb-95721af863db {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:28:19 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:28:19 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Ensure instance console log exists: /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:28:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:20 user nova-compute[71321]: DEBUG nova.network.neutron [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Successfully created port: 5680054b-9363-4825-ade2-add800d7142b {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:28:22 user nova-compute[71321]: DEBUG nova.network.neutron [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Successfully updated port: cbb69638-6a5f-4d12-8737-45850145fa0e {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:28:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "refresh_cache-10116da0-785c-41cf-96bb-95721af863db" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:28:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquired lock "refresh_cache-10116da0-785c-41cf-96bb-95721af863db" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:28:22 user nova-compute[71321]: DEBUG nova.network.neutron [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:28:22 user nova-compute[71321]: DEBUG nova.network.neutron [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:28:22 user nova-compute[71321]: DEBUG nova.compute.manager [req-9808f7d4-e642-48f4-8434-156858b4521c req-e1c37646-a185-46a3-a9bf-77b2640d8fd6 service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] Received event network-changed-cbb69638-6a5f-4d12-8737-45850145fa0e {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:28:22 user nova-compute[71321]: DEBUG nova.compute.manager [req-9808f7d4-e642-48f4-8434-156858b4521c req-e1c37646-a185-46a3-a9bf-77b2640d8fd6 service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] Refreshing instance network info cache due to event network-changed-cbb69638-6a5f-4d12-8737-45850145fa0e. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:28:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9808f7d4-e642-48f4-8434-156858b4521c req-e1c37646-a185-46a3-a9bf-77b2640d8fd6 service nova] Acquiring lock "refresh_cache-10116da0-785c-41cf-96bb-95721af863db" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG nova.network.neutron [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Updating instance_info_cache with network_info: [{"id": "cbb69638-6a5f-4d12-8737-45850145fa0e", "address": "fa:16:3e:57:7c:99", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb69638-6a", "ovs_interfaceid": "cbb69638-6a5f-4d12-8737-45850145fa0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Releasing lock "refresh_cache-10116da0-785c-41cf-96bb-95721af863db" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG nova.compute.manager [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Instance network_info: |[{"id": "cbb69638-6a5f-4d12-8737-45850145fa0e", "address": "fa:16:3e:57:7c:99", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb69638-6a", "ovs_interfaceid": "cbb69638-6a5f-4d12-8737-45850145fa0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9808f7d4-e642-48f4-8434-156858b4521c req-e1c37646-a185-46a3-a9bf-77b2640d8fd6 service nova] Acquired lock "refresh_cache-10116da0-785c-41cf-96bb-95721af863db" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG nova.network.neutron [req-9808f7d4-e642-48f4-8434-156858b4521c req-e1c37646-a185-46a3-a9bf-77b2640d8fd6 service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] Refreshing network info cache for port cbb69638-6a5f-4d12-8737-45850145fa0e {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Start _get_guest_xml network_info=[{"id": "cbb69638-6a5f-4d12-8737-45850145fa0e", "address": "fa:16:3e:57:7c:99", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb69638-6a", "ovs_interfaceid": "cbb69638-6a5f-4d12-8737-45850145fa0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:28:23 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:28:23 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:28:23 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG nova.privsep.utils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:28:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1720191836',display_name='tempest-ServerRescueNegativeTestJSON-server-1720191836',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1720191836',id=1,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9ec9671123c4a00a2880de4b4df8d3e',ramdisk_id='',reservation_id='r-68hyvfbd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1979263125',owner_user_name='tempest-ServerRescueNegativeTestJSON-1979263125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:28:15Z,user_data=None,user_id='1db0203a6e6f4cc3bccbf19577a0c82f',uuid=10116da0-785c-41cf-96bb-95721af863db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbb69638-6a5f-4d12-8737-45850145fa0e", "address": "fa:16:3e:57:7c:99", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb69638-6a", "ovs_interfaceid": "cbb69638-6a5f-4d12-8737-45850145fa0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Converting VIF {"id": "cbb69638-6a5f-4d12-8737-45850145fa0e", "address": "fa:16:3e:57:7c:99", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb69638-6a", "ovs_interfaceid": "cbb69638-6a5f-4d12-8737-45850145fa0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:7c:99,bridge_name='br-int',has_traffic_filtering=True,id=cbb69638-6a5f-4d12-8737-45850145fa0e,network=Network(0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbb69638-6a') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG nova.objects.instance [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'pci_devices' on Instance uuid 10116da0-785c-41cf-96bb-95721af863db {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:28:23 user nova-compute[71321]:   <uuid>10116da0-785c-41cf-96bb-95721af863db</uuid>
Apr 12 12:28:23 user nova-compute[71321]:   <name>instance-00000001</name>
Apr 12 12:28:23 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:28:23 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:28:23 user nova-compute[71321]:   <metadata>
Apr 12 12:28:23 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:28:23 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:28:23 user nova-compute[71321]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1720191836</nova:name>
Apr 12 12:28:23 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:28:23</nova:creationTime>
Apr 12 12:28:23 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:28:23 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:28:23 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:28:23 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:28:23 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:28:23 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:28:23 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:28:23 user nova-compute[71321]:       <nova:owner>
Apr 12 12:28:23 user nova-compute[71321]:         <nova:user uuid="1db0203a6e6f4cc3bccbf19577a0c82f">tempest-ServerRescueNegativeTestJSON-1979263125-project-member</nova:user>
Apr 12 12:28:23 user nova-compute[71321]:         <nova:project uuid="f9ec9671123c4a00a2880de4b4df8d3e">tempest-ServerRescueNegativeTestJSON-1979263125</nova:project>
Apr 12 12:28:23 user nova-compute[71321]:       </nova:owner>
Apr 12 12:28:23 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:28:23 user nova-compute[71321]:       <nova:ports>
Apr 12 12:28:23 user nova-compute[71321]:         <nova:port uuid="cbb69638-6a5f-4d12-8737-45850145fa0e">
Apr 12 12:28:23 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 12:28:23 user nova-compute[71321]:         </nova:port>
Apr 12 12:28:23 user nova-compute[71321]:       </nova:ports>
Apr 12 12:28:23 user nova-compute[71321]:     </nova:instance>
Apr 12 12:28:23 user nova-compute[71321]:   </metadata>
Apr 12 12:28:23 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:28:23 user nova-compute[71321]:     <system>
Apr 12 12:28:23 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:28:23 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:28:23 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:28:23 user nova-compute[71321]:       <entry name="serial">10116da0-785c-41cf-96bb-95721af863db</entry>
Apr 12 12:28:23 user nova-compute[71321]:       <entry name="uuid">10116da0-785c-41cf-96bb-95721af863db</entry>
Apr 12 12:28:23 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:28:23 user nova-compute[71321]:     </system>
Apr 12 12:28:23 user nova-compute[71321]:   </sysinfo>
Apr 12 12:28:23 user nova-compute[71321]:   <os>
Apr 12 12:28:23 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:28:23 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:28:23 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:28:23 user nova-compute[71321]:   </os>
Apr 12 12:28:23 user nova-compute[71321]:   <features>
Apr 12 12:28:23 user nova-compute[71321]:     <acpi/>
Apr 12 12:28:23 user nova-compute[71321]:     <apic/>
Apr 12 12:28:23 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:28:23 user nova-compute[71321]:   </features>
Apr 12 12:28:23 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:28:23 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:28:23 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:28:23 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:28:23 user nova-compute[71321]:   </clock>
Apr 12 12:28:23 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:28:23 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:28:23 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:28:23 user nova-compute[71321]:   </cpu>
Apr 12 12:28:23 user nova-compute[71321]:   <devices>
Apr 12 12:28:23 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:28:23 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:28:23 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk"/>
Apr 12 12:28:23 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:28:23 user nova-compute[71321]:     </disk>
Apr 12 12:28:23 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:28:23 user nova-compute[71321]:       <mac address="fa:16:3e:57:7c:99"/>
Apr 12 12:28:23 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:28:23 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:28:23 user nova-compute[71321]:       <target dev="tapcbb69638-6a"/>
Apr 12 12:28:23 user nova-compute[71321]:     </interface>
Apr 12 12:28:23 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:28:23 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/console.log" append="off"/>
Apr 12 12:28:23 user nova-compute[71321]:     </serial>
Apr 12 12:28:23 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:28:23 user nova-compute[71321]:     <video>
Apr 12 12:28:23 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:28:23 user nova-compute[71321]:     </video>
Apr 12 12:28:23 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:28:23 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:28:23 user nova-compute[71321]:     </rng>
Apr 12 12:28:23 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:28:23 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:28:23 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:28:23 user nova-compute[71321]:     </memballoon>
Apr 12 12:28:23 user nova-compute[71321]:   </devices>
Apr 12 12:28:23 user nova-compute[71321]: </domain>
Apr 12 12:28:23 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:28:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1720191836',display_name='tempest-ServerRescueNegativeTestJSON-server-1720191836',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1720191836',id=1,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9ec9671123c4a00a2880de4b4df8d3e',ramdisk_id='',reservation_id='r-68hyvfbd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1979263125',owner_user_name='tempest-ServerRescueNegativeTestJSON-1979263125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:28:15Z,user_data=None,user_id='1db0203a6e6f4cc3bccbf19577a0c82f',uuid=10116da0-785c-41cf-96bb-95721af863db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbb69638-6a5f-4d12-8737-45850145fa0e", "address": "fa:16:3e:57:7c:99", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb69638-6a", "ovs_interfaceid": "cbb69638-6a5f-4d12-8737-45850145fa0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Converting VIF {"id": "cbb69638-6a5f-4d12-8737-45850145fa0e", "address": "fa:16:3e:57:7c:99", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb69638-6a", "ovs_interfaceid": "cbb69638-6a5f-4d12-8737-45850145fa0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:7c:99,bridge_name='br-int',has_traffic_filtering=True,id=cbb69638-6a5f-4d12-8737-45850145fa0e,network=Network(0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbb69638-6a') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG os_vif [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:7c:99,bridge_name='br-int',has_traffic_filtering=True,id=cbb69638-6a5f-4d12-8737-45850145fa0e,network=Network(0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbb69638-6a') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Created schema index Interface.name {{(pid=71321) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Created schema index Port.name {{(pid=71321) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Created schema index Bridge.name {{(pid=71321) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [POLLOUT] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:28:23 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:28:23 user nova-compute[71321]: INFO oslo.privsep.daemon [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpkimtyz0h/privsep.sock']
Apr 12 12:28:23 user sudo[80312]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpkimtyz0h/privsep.sock
Apr 12 12:28:23 user sudo[80312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 12:28:24 user nova-compute[71321]: DEBUG nova.network.neutron [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Successfully updated port: 5680054b-9363-4825-ade2-add800d7142b {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:28:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "refresh_cache-a4107f2d-88e4-4846-9ece-cb16ad7ecd02" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:28:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquired lock "refresh_cache-a4107f2d-88e4-4846-9ece-cb16ad7ecd02" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:28:24 user nova-compute[71321]: DEBUG nova.network.neutron [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:28:24 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Acquiring lock "5a054fbb-bfb4-40fa-8a03-a0c201df6857" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "5a054fbb-bfb4-40fa-8a03-a0c201df6857" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:24 user nova-compute[71321]: DEBUG nova.compute.manager [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:28:24 user nova-compute[71321]: DEBUG nova.network.neutron [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:28:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:24 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:28:24 user nova-compute[71321]: INFO nova.compute.claims [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Claim successful on node user
Apr 12 12:28:24 user nova-compute[71321]: DEBUG nova.compute.manager [req-9b65725c-5d24-4afc-8edf-62a196dcd0b0 req-665a040d-4980-4cf4-9803-dcab777b12eb service nova] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Received event network-changed-5680054b-9363-4825-ade2-add800d7142b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:28:24 user nova-compute[71321]: DEBUG nova.compute.manager [req-9b65725c-5d24-4afc-8edf-62a196dcd0b0 req-665a040d-4980-4cf4-9803-dcab777b12eb service nova] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Refreshing instance network info cache due to event network-changed-5680054b-9363-4825-ade2-add800d7142b. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:28:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9b65725c-5d24-4afc-8edf-62a196dcd0b0 req-665a040d-4980-4cf4-9803-dcab777b12eb service nova] Acquiring lock "refresh_cache-a4107f2d-88e4-4846-9ece-cb16ad7ecd02" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:28:24 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:28:24 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:28:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.337s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:24 user nova-compute[71321]: DEBUG nova.compute.manager [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:28:24 user nova-compute[71321]: DEBUG nova.compute.manager [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:28:24 user nova-compute[71321]: DEBUG nova.network.neutron [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:28:25 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:28:25 user nova-compute[71321]: DEBUG nova.compute.manager [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:28:25 user nova-compute[71321]: DEBUG nova.compute.manager [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:28:25 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:28:25 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Creating image(s)
Apr 12 12:28:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a054fbb-bfb4-40fa-8a03-a0c201df6857/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "/opt/stack/data/nova/instances/5a054fbb-bfb4-40fa-8a03-a0c201df6857/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "/opt/stack/data/nova/instances/5a054fbb-bfb4-40fa-8a03-a0c201df6857/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:25 user nova-compute[71321]: DEBUG nova.network.neutron [req-9808f7d4-e642-48f4-8434-156858b4521c req-e1c37646-a185-46a3-a9bf-77b2640d8fd6 service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] Updated VIF entry in instance network info cache for port cbb69638-6a5f-4d12-8737-45850145fa0e. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:28:25 user nova-compute[71321]: DEBUG nova.network.neutron [req-9808f7d4-e642-48f4-8434-156858b4521c req-e1c37646-a185-46a3-a9bf-77b2640d8fd6 service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] Updating instance_info_cache with network_info: [{"id": "cbb69638-6a5f-4d12-8737-45850145fa0e", "address": "fa:16:3e:57:7c:99", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb69638-6a", "ovs_interfaceid": "cbb69638-6a5f-4d12-8737-45850145fa0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:28:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.147s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9808f7d4-e642-48f4-8434-156858b4521c req-e1c37646-a185-46a3-a9bf-77b2640d8fd6 service nova] Releasing lock "refresh_cache-10116da0-785c-41cf-96bb-95721af863db" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:28:25 user nova-compute[71321]: DEBUG nova.policy [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f0d432191ea141a58407f7b21d077b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8ee9df3d2043fb818cc565b1d3e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:28:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.168s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/5a054fbb-bfb4-40fa-8a03-a0c201df6857/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/5a054fbb-bfb4-40fa-8a03-a0c201df6857/disk 1073741824" returned: 0 in 0.095s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:25 user sudo[80312]: pam_unix(sudo:session): session closed for user root
Apr 12 12:28:25 user nova-compute[71321]: INFO oslo.privsep.daemon [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Spawned new privsep daemon via rootwrap
Apr 12 12:28:25 user nova-compute[71321]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 12 12:28:25 user nova-compute[71321]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 12 12:28:25 user nova-compute[71321]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Apr 12 12:28:25 user nova-compute[71321]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80329
Apr 12 12:28:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.191s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:25 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5a054fbb-bfb4-40fa-8a03-a0c201df6857/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:28:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a054fbb-bfb4-40fa-8a03-a0c201df6857/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a054fbb-bfb4-40fa-8a03-a0c201df6857/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:25 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Cannot resize image /opt/stack/data/nova/instances/5a054fbb-bfb4-40fa-8a03-a0c201df6857/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:28:25 user nova-compute[71321]: DEBUG nova.objects.instance [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lazy-loading 'migration_context' on Instance uuid 5a054fbb-bfb4-40fa-8a03-a0c201df6857 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Ensure instance console log exists: /opt/stack/data/nova/instances/5a054fbb-bfb4-40fa-8a03-a0c201df6857/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG nova.network.neutron [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Updating instance_info_cache with network_info: [{"id": "5680054b-9363-4825-ade2-add800d7142b", "address": "fa:16:3e:08:27:b7", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5680054b-93", "ovs_interfaceid": "5680054b-9363-4825-ade2-add800d7142b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Releasing lock "refresh_cache-a4107f2d-88e4-4846-9ece-cb16ad7ecd02" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG nova.compute.manager [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Instance network_info: |[{"id": "5680054b-9363-4825-ade2-add800d7142b", "address": "fa:16:3e:08:27:b7", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5680054b-93", "ovs_interfaceid": "5680054b-9363-4825-ade2-add800d7142b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9b65725c-5d24-4afc-8edf-62a196dcd0b0 req-665a040d-4980-4cf4-9803-dcab777b12eb service nova] Acquired lock "refresh_cache-a4107f2d-88e4-4846-9ece-cb16ad7ecd02" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG nova.network.neutron [req-9b65725c-5d24-4afc-8edf-62a196dcd0b0 req-665a040d-4980-4cf4-9803-dcab777b12eb service nova] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Refreshing network info cache for port 5680054b-9363-4825-ade2-add800d7142b {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Start _get_guest_xml network_info=[{"id": "5680054b-9363-4825-ade2-add800d7142b", "address": "fa:16:3e:08:27:b7", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5680054b-93", "ovs_interfaceid": "5680054b-9363-4825-ade2-add800d7142b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:28:26 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:28:26 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:28:26 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:28:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-633086399',display_name='tempest-ServerRescueNegativeTestJSON-server-633086399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-633086399',id=2,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9ec9671123c4a00a2880de4b4df8d3e',ramdisk_id='',reservation_id='r-s30bwkvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1979263125',owner_user_name='tempest-ServerRescueNegativeTestJSON-1979263125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:28:18Z,user_data=None,user_id='1db0203a6e6f4cc3bccbf19577a0c82f',uuid=a4107f2d-88e4-4846-9ece-cb16ad7ecd02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5680054b-9363-4825-ade2-add800d7142b", "address": "fa:16:3e:08:27:b7", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5680054b-93", "ovs_interfaceid": "5680054b-9363-4825-ade2-add800d7142b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Converting VIF {"id": "5680054b-9363-4825-ade2-add800d7142b", "address": "fa:16:3e:08:27:b7", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5680054b-93", "ovs_interfaceid": "5680054b-9363-4825-ade2-add800d7142b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:27:b7,bridge_name='br-int',has_traffic_filtering=True,id=5680054b-9363-4825-ade2-add800d7142b,network=Network(0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5680054b-93') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG nova.objects.instance [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'pci_devices' on Instance uuid a4107f2d-88e4-4846-9ece-cb16ad7ecd02 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:28:26 user nova-compute[71321]:   <uuid>a4107f2d-88e4-4846-9ece-cb16ad7ecd02</uuid>
Apr 12 12:28:26 user nova-compute[71321]:   <name>instance-00000002</name>
Apr 12 12:28:26 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:28:26 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:28:26 user nova-compute[71321]:   <metadata>
Apr 12 12:28:26 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:28:26 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:28:26 user nova-compute[71321]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-633086399</nova:name>
Apr 12 12:28:26 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:28:26</nova:creationTime>
Apr 12 12:28:26 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:28:26 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:28:26 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:28:26 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:28:26 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:28:26 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:28:26 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:28:26 user nova-compute[71321]:       <nova:owner>
Apr 12 12:28:26 user nova-compute[71321]:         <nova:user uuid="1db0203a6e6f4cc3bccbf19577a0c82f">tempest-ServerRescueNegativeTestJSON-1979263125-project-member</nova:user>
Apr 12 12:28:26 user nova-compute[71321]:         <nova:project uuid="f9ec9671123c4a00a2880de4b4df8d3e">tempest-ServerRescueNegativeTestJSON-1979263125</nova:project>
Apr 12 12:28:26 user nova-compute[71321]:       </nova:owner>
Apr 12 12:28:26 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:28:26 user nova-compute[71321]:       <nova:ports>
Apr 12 12:28:26 user nova-compute[71321]:         <nova:port uuid="5680054b-9363-4825-ade2-add800d7142b">
Apr 12 12:28:26 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 12:28:26 user nova-compute[71321]:         </nova:port>
Apr 12 12:28:26 user nova-compute[71321]:       </nova:ports>
Apr 12 12:28:26 user nova-compute[71321]:     </nova:instance>
Apr 12 12:28:26 user nova-compute[71321]:   </metadata>
Apr 12 12:28:26 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:28:26 user nova-compute[71321]:     <system>
Apr 12 12:28:26 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:28:26 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:28:26 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:28:26 user nova-compute[71321]:       <entry name="serial">a4107f2d-88e4-4846-9ece-cb16ad7ecd02</entry>
Apr 12 12:28:26 user nova-compute[71321]:       <entry name="uuid">a4107f2d-88e4-4846-9ece-cb16ad7ecd02</entry>
Apr 12 12:28:26 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:28:26 user nova-compute[71321]:     </system>
Apr 12 12:28:26 user nova-compute[71321]:   </sysinfo>
Apr 12 12:28:26 user nova-compute[71321]:   <os>
Apr 12 12:28:26 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:28:26 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:28:26 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:28:26 user nova-compute[71321]:   </os>
Apr 12 12:28:26 user nova-compute[71321]:   <features>
Apr 12 12:28:26 user nova-compute[71321]:     <acpi/>
Apr 12 12:28:26 user nova-compute[71321]:     <apic/>
Apr 12 12:28:26 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:28:26 user nova-compute[71321]:   </features>
Apr 12 12:28:26 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:28:26 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:28:26 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:28:26 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:28:26 user nova-compute[71321]:   </clock>
Apr 12 12:28:26 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:28:26 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:28:26 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:28:26 user nova-compute[71321]:   </cpu>
Apr 12 12:28:26 user nova-compute[71321]:   <devices>
Apr 12 12:28:26 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:28:26 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:28:26 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk"/>
Apr 12 12:28:26 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:28:26 user nova-compute[71321]:     </disk>
Apr 12 12:28:26 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:28:26 user nova-compute[71321]:       <mac address="fa:16:3e:08:27:b7"/>
Apr 12 12:28:26 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:28:26 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:28:26 user nova-compute[71321]:       <target dev="tap5680054b-93"/>
Apr 12 12:28:26 user nova-compute[71321]:     </interface>
Apr 12 12:28:26 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:28:26 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/console.log" append="off"/>
Apr 12 12:28:26 user nova-compute[71321]:     </serial>
Apr 12 12:28:26 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:28:26 user nova-compute[71321]:     <video>
Apr 12 12:28:26 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:28:26 user nova-compute[71321]:     </video>
Apr 12 12:28:26 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:28:26 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:28:26 user nova-compute[71321]:     </rng>
Apr 12 12:28:26 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:28:26 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:28:26 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:28:26 user nova-compute[71321]:     </memballoon>
Apr 12 12:28:26 user nova-compute[71321]:   </devices>
Apr 12 12:28:26 user nova-compute[71321]: </domain>
Apr 12 12:28:26 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:28:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-633086399',display_name='tempest-ServerRescueNegativeTestJSON-server-633086399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-633086399',id=2,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9ec9671123c4a00a2880de4b4df8d3e',ramdisk_id='',reservation_id='r-s30bwkvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1979263125',owner_user_name='tempest-ServerRescueNegativeTestJSON-1979263125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:28:18Z,user_data=None,user_id='1db0203a6e6f4cc3bccbf19577a0c82f',uuid=a4107f2d-88e4-4846-9ece-cb16ad7ecd02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5680054b-9363-4825-ade2-add800d7142b", "address": "fa:16:3e:08:27:b7", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5680054b-93", "ovs_interfaceid": "5680054b-9363-4825-ade2-add800d7142b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Converting VIF {"id": "5680054b-9363-4825-ade2-add800d7142b", "address": "fa:16:3e:08:27:b7", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5680054b-93", "ovs_interfaceid": "5680054b-9363-4825-ade2-add800d7142b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:27:b7,bridge_name='br-int',has_traffic_filtering=True,id=5680054b-9363-4825-ade2-add800d7142b,network=Network(0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5680054b-93') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG os_vif [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:27:b7,bridge_name='br-int',has_traffic_filtering=True,id=5680054b-9363-4825-ade2-add800d7142b,network=Network(0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5680054b-93') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcbb69638-6a, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcbb69638-6a, col_values=(('external_ids', {'iface-id': 'cbb69638-6a5f-4d12-8737-45850145fa0e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:7c:99', 'vm-uuid': '10116da0-785c-41cf-96bb-95721af863db'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:26 user nova-compute[71321]: INFO os_vif [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:7c:99,bridge_name='br-int',has_traffic_filtering=True,id=cbb69638-6a5f-4d12-8737-45850145fa0e,network=Network(0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbb69638-6a')
Apr 12 12:28:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5680054b-93, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5680054b-93, col_values=(('external_ids', {'iface-id': '5680054b-9363-4825-ade2-add800d7142b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:27:b7', 'vm-uuid': 'a4107f2d-88e4-4846-9ece-cb16ad7ecd02'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:26 user nova-compute[71321]: INFO os_vif [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:27:b7,bridge_name='br-int',has_traffic_filtering=True,id=5680054b-9363-4825-ade2-add800d7142b,network=Network(0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5680054b-93')
Apr 12 12:28:26 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] No VIF found with MAC fa:16:3e:57:7c:99, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:28:26 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] No VIF found with MAC fa:16:3e:08:27:b7, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:28:28 user nova-compute[71321]: DEBUG nova.network.neutron [req-9b65725c-5d24-4afc-8edf-62a196dcd0b0 req-665a040d-4980-4cf4-9803-dcab777b12eb service nova] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Updated VIF entry in instance network info cache for port 5680054b-9363-4825-ade2-add800d7142b. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:28:28 user nova-compute[71321]: DEBUG nova.network.neutron [req-9b65725c-5d24-4afc-8edf-62a196dcd0b0 req-665a040d-4980-4cf4-9803-dcab777b12eb service nova] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Updating instance_info_cache with network_info: [{"id": "5680054b-9363-4825-ade2-add800d7142b", "address": "fa:16:3e:08:27:b7", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5680054b-93", "ovs_interfaceid": "5680054b-9363-4825-ade2-add800d7142b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:28:28 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9b65725c-5d24-4afc-8edf-62a196dcd0b0 req-665a040d-4980-4cf4-9803-dcab777b12eb service nova] Releasing lock "refresh_cache-a4107f2d-88e4-4846-9ece-cb16ad7ecd02" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:28:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "546c0c08-35f1-4043-ac30-56d49bc86af1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:29 user nova-compute[71321]: DEBUG nova.compute.manager [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:28:29 user nova-compute[71321]: DEBUG nova.network.neutron [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Successfully created port: bea9db47-d43e-4df8-a5f2-e934e855cfa5 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:28:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:29 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:28:29 user nova-compute[71321]: INFO nova.compute.claims [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Claim successful on node user
Apr 12 12:28:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:29 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:28:29 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:28:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:29 user nova-compute[71321]: DEBUG nova.compute.manager [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:28:29 user nova-compute[71321]: DEBUG nova.compute.manager [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:28:29 user nova-compute[71321]: DEBUG nova.network.neutron [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:28:29 user nova-compute[71321]: DEBUG nova.compute.manager [req-ae09a925-d48f-4455-97af-e1567fb58b33 req-32f8cd15-349f-422b-bb43-41dfba319663 service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] Received event network-vif-plugged-cbb69638-6a5f-4d12-8737-45850145fa0e {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:28:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ae09a925-d48f-4455-97af-e1567fb58b33 req-32f8cd15-349f-422b-bb43-41dfba319663 service nova] Acquiring lock "10116da0-785c-41cf-96bb-95721af863db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ae09a925-d48f-4455-97af-e1567fb58b33 req-32f8cd15-349f-422b-bb43-41dfba319663 service nova] Lock "10116da0-785c-41cf-96bb-95721af863db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ae09a925-d48f-4455-97af-e1567fb58b33 req-32f8cd15-349f-422b-bb43-41dfba319663 service nova] Lock "10116da0-785c-41cf-96bb-95721af863db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:29 user nova-compute[71321]: DEBUG nova.compute.manager [req-ae09a925-d48f-4455-97af-e1567fb58b33 req-32f8cd15-349f-422b-bb43-41dfba319663 service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] No waiting events found dispatching network-vif-plugged-cbb69638-6a5f-4d12-8737-45850145fa0e {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:28:29 user nova-compute[71321]: WARNING nova.compute.manager [req-ae09a925-d48f-4455-97af-e1567fb58b33 req-32f8cd15-349f-422b-bb43-41dfba319663 service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] Received unexpected event network-vif-plugged-cbb69638-6a5f-4d12-8737-45850145fa0e for instance with vm_state building and task_state spawning.
Apr 12 12:28:29 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:28:29 user nova-compute[71321]: DEBUG nova.compute.manager [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:28:29 user nova-compute[71321]: DEBUG nova.compute.manager [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:28:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:28:29 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Creating image(s)
Apr 12 12:28:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "/opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "/opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "/opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:30 user nova-compute[71321]: DEBUG nova.policy [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:28:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.179s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.203s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk 1073741824" returned: 0 in 0.091s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.311s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.143s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:30 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Checking if we can resize image /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:28:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:30 user nova-compute[71321]: DEBUG nova.compute.manager [req-53fbceaf-2935-491a-a698-1df2202cdb18 req-5b480fad-0d3c-42a7-8dda-dd679ad608b4 service nova] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Received event network-vif-plugged-5680054b-9363-4825-ade2-add800d7142b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:28:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-53fbceaf-2935-491a-a698-1df2202cdb18 req-5b480fad-0d3c-42a7-8dda-dd679ad608b4 service nova] Acquiring lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-53fbceaf-2935-491a-a698-1df2202cdb18 req-5b480fad-0d3c-42a7-8dda-dd679ad608b4 service nova] Lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-53fbceaf-2935-491a-a698-1df2202cdb18 req-5b480fad-0d3c-42a7-8dda-dd679ad608b4 service nova] Lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:30 user nova-compute[71321]: DEBUG nova.compute.manager [req-53fbceaf-2935-491a-a698-1df2202cdb18 req-5b480fad-0d3c-42a7-8dda-dd679ad608b4 service nova] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] No waiting events found dispatching network-vif-plugged-5680054b-9363-4825-ade2-add800d7142b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:28:30 user nova-compute[71321]: WARNING nova.compute.manager [req-53fbceaf-2935-491a-a698-1df2202cdb18 req-5b480fad-0d3c-42a7-8dda-dd679ad608b4 service nova] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Received unexpected event network-vif-plugged-5680054b-9363-4825-ade2-add800d7142b for instance with vm_state building and task_state spawning.
Apr 12 12:28:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:30 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Cannot resize image /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:28:30 user nova-compute[71321]: DEBUG nova.objects.instance [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lazy-loading 'migration_context' on Instance uuid 546c0c08-35f1-4043-ac30-56d49bc86af1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:28:30 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:28:30 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Ensure instance console log exists: /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:28:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:31 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302511.3116312, 10116da0-785c-41cf-96bb-95721af863db => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:28:31 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] VM Resumed (Lifecycle Event)
Apr 12 12:28:31 user nova-compute[71321]: DEBUG nova.compute.manager [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:28:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:28:31 user nova-compute[71321]: DEBUG nova.compute.manager [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:28:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:28:31 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 10116da0-785c-41cf-96bb-95721af863db] Instance spawned successfully.
Apr 12 12:28:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:28:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:31 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Instance spawned successfully.
Apr 12 12:28:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:28:31 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:28:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:28:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:28:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:28:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:28:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:28:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:28:31 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:28:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:28:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:28:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:28:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:28:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:28:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:28:31 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:28:31 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302511.3168502, 10116da0-785c-41cf-96bb-95721af863db => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:28:31 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] VM Started (Lifecycle Event)
Apr 12 12:28:31 user nova-compute[71321]: INFO nova.compute.manager [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Took 16.32 seconds to spawn the instance on the hypervisor.
Apr 12 12:28:31 user nova-compute[71321]: DEBUG nova.compute.manager [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:28:31 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:28:31 user nova-compute[71321]: INFO nova.compute.manager [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Took 13.87 seconds to spawn the instance on the hypervisor.
Apr 12 12:28:31 user nova-compute[71321]: DEBUG nova.compute.manager [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:28:31 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:28:31 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:28:31 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302511.3645415, a4107f2d-88e4-4846-9ece-cb16ad7ecd02 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:28:31 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] VM Resumed (Lifecycle Event)
Apr 12 12:28:31 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:28:31 user nova-compute[71321]: INFO nova.compute.manager [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Took 17.29 seconds to build instance.
Apr 12 12:28:31 user nova-compute[71321]: INFO nova.compute.manager [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Took 14.59 seconds to build instance.
Apr 12 12:28:31 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:28:31 user nova-compute[71321]: DEBUG nova.compute.manager [req-493d790f-f9f9-43ba-a1c9-f2bae6d564a4 req-a6db1ac0-1662-48dd-987a-f58426b0edf0 service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] Received event network-vif-plugged-cbb69638-6a5f-4d12-8737-45850145fa0e {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:28:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-493d790f-f9f9-43ba-a1c9-f2bae6d564a4 req-a6db1ac0-1662-48dd-987a-f58426b0edf0 service nova] Acquiring lock "10116da0-785c-41cf-96bb-95721af863db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-493d790f-f9f9-43ba-a1c9-f2bae6d564a4 req-a6db1ac0-1662-48dd-987a-f58426b0edf0 service nova] Lock "10116da0-785c-41cf-96bb-95721af863db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-493d790f-f9f9-43ba-a1c9-f2bae6d564a4 req-a6db1ac0-1662-48dd-987a-f58426b0edf0 service nova] Lock "10116da0-785c-41cf-96bb-95721af863db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.010s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:31 user nova-compute[71321]: DEBUG nova.compute.manager [req-493d790f-f9f9-43ba-a1c9-f2bae6d564a4 req-a6db1ac0-1662-48dd-987a-f58426b0edf0 service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] No waiting events found dispatching network-vif-plugged-cbb69638-6a5f-4d12-8737-45850145fa0e {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:28:31 user nova-compute[71321]: WARNING nova.compute.manager [req-493d790f-f9f9-43ba-a1c9-f2bae6d564a4 req-a6db1ac0-1662-48dd-987a-f58426b0edf0 service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] Received unexpected event network-vif-plugged-cbb69638-6a5f-4d12-8737-45850145fa0e for instance with vm_state active and task_state None.
Apr 12 12:28:31 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302511.3663235, a4107f2d-88e4-4846-9ece-cb16ad7ecd02 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:28:31 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] VM Started (Lifecycle Event)
Apr 12 12:28:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.816s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "10116da0-785c-41cf-96bb-95721af863db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.557s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:28:32 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:28:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "839e85a2-f7af-482d-a5e6-09195888300e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "839e85a2-f7af-482d-a5e6-09195888300e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:28:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:32 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:28:32 user nova-compute[71321]: INFO nova.compute.claims [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Claim successful on node user
Apr 12 12:28:32 user nova-compute[71321]: DEBUG nova.compute.manager [req-9f7fa6f2-72db-4962-bebe-97f08f75ce65 req-dc9410fe-fa14-4033-a0ef-61d6a2686d2a service nova] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Received event network-vif-plugged-5680054b-9363-4825-ade2-add800d7142b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:28:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9f7fa6f2-72db-4962-bebe-97f08f75ce65 req-dc9410fe-fa14-4033-a0ef-61d6a2686d2a service nova] Acquiring lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9f7fa6f2-72db-4962-bebe-97f08f75ce65 req-dc9410fe-fa14-4033-a0ef-61d6a2686d2a service nova] Lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9f7fa6f2-72db-4962-bebe-97f08f75ce65 req-dc9410fe-fa14-4033-a0ef-61d6a2686d2a service nova] Lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:32 user nova-compute[71321]: DEBUG nova.compute.manager [req-9f7fa6f2-72db-4962-bebe-97f08f75ce65 req-dc9410fe-fa14-4033-a0ef-61d6a2686d2a service nova] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] No waiting events found dispatching network-vif-plugged-5680054b-9363-4825-ade2-add800d7142b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:28:32 user nova-compute[71321]: WARNING nova.compute.manager [req-9f7fa6f2-72db-4962-bebe-97f08f75ce65 req-dc9410fe-fa14-4033-a0ef-61d6a2686d2a service nova] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Received unexpected event network-vif-plugged-5680054b-9363-4825-ade2-add800d7142b for instance with vm_state active and task_state None.
Apr 12 12:28:32 user nova-compute[71321]: DEBUG nova.network.neutron [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Successfully updated port: bea9db47-d43e-4df8-a5f2-e934e855cfa5 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:28:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Acquiring lock "refresh_cache-5a054fbb-bfb4-40fa-8a03-a0c201df6857" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:28:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Acquired lock "refresh_cache-5a054fbb-bfb4-40fa-8a03-a0c201df6857" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:28:32 user nova-compute[71321]: DEBUG nova.network.neutron [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:28:32 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:28:32 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:28:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:33 user nova-compute[71321]: DEBUG nova.compute.manager [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:28:33 user nova-compute[71321]: DEBUG nova.network.neutron [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:28:33 user nova-compute[71321]: DEBUG nova.compute.manager [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:28:33 user nova-compute[71321]: DEBUG nova.network.neutron [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:28:33 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:28:33 user nova-compute[71321]: DEBUG nova.network.neutron [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Successfully created port: 6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:28:33 user nova-compute[71321]: DEBUG nova.compute.manager [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:28:33 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:33 user nova-compute[71321]: DEBUG nova.compute.manager [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:28:33 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:28:33 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Creating image(s)
Apr 12 12:28:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "/opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "/opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "/opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.015s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.183s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.181s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:33 user nova-compute[71321]: DEBUG nova.policy [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd76f02dd70664dfea34586abbc213526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1faa529d424800900e10a7ceaa63d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:28:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk 1073741824" returned: 0 in 0.086s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.229s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Checking if we can resize image /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Cannot resize image /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG nova.objects.instance [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lazy-loading 'migration_context' on Instance uuid 839e85a2-f7af-482d-a5e6-09195888300e {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Ensure instance console log exists: /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG nova.network.neutron [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Updating instance_info_cache with network_info: [{"id": "bea9db47-d43e-4df8-a5f2-e934e855cfa5", "address": "fa:16:3e:72:15:77", "network": {"id": "92e6cafe-3321-4251-bb51-8cd4315282b7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2087616823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c8ee9df3d2043fb818cc565b1d3e9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbea9db47-d4", "ovs_interfaceid": "bea9db47-d43e-4df8-a5f2-e934e855cfa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Releasing lock "refresh_cache-5a054fbb-bfb4-40fa-8a03-a0c201df6857" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG nova.compute.manager [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Instance network_info: |[{"id": "bea9db47-d43e-4df8-a5f2-e934e855cfa5", "address": "fa:16:3e:72:15:77", "network": {"id": "92e6cafe-3321-4251-bb51-8cd4315282b7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2087616823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c8ee9df3d2043fb818cc565b1d3e9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbea9db47-d4", "ovs_interfaceid": "bea9db47-d43e-4df8-a5f2-e934e855cfa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Start _get_guest_xml network_info=[{"id": "bea9db47-d43e-4df8-a5f2-e934e855cfa5", "address": "fa:16:3e:72:15:77", "network": {"id": "92e6cafe-3321-4251-bb51-8cd4315282b7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2087616823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c8ee9df3d2043fb818cc565b1d3e9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbea9db47-d4", "ovs_interfaceid": "bea9db47-d43e-4df8-a5f2-e934e855cfa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:28:34 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:28:34 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:28:34 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:28:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1808317084',display_name='tempest-DeleteServersTestJSON-server-1808317084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1808317084',id=3,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c8ee9df3d2043fb818cc565b1d3e9d2',ramdisk_id='',reservation_id='r-xo51kons',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-2075182425',owner_user_name='tempest-DeleteServersTestJSON-2075182425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:28:25Z,user_data=None,user_id='f0d432191ea141a58407f7b21d077b58',uuid=5a054fbb-bfb4-40fa-8a03-a0c201df6857,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bea9db47-d43e-4df8-a5f2-e934e855cfa5", "address": "fa:16:3e:72:15:77", "network": {"id": "92e6cafe-3321-4251-bb51-8cd4315282b7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2087616823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c8ee9df3d2043fb818cc565b1d3e9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbea9db47-d4", "ovs_interfaceid": "bea9db47-d43e-4df8-a5f2-e934e855cfa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Converting VIF {"id": "bea9db47-d43e-4df8-a5f2-e934e855cfa5", "address": "fa:16:3e:72:15:77", "network": {"id": "92e6cafe-3321-4251-bb51-8cd4315282b7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2087616823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c8ee9df3d2043fb818cc565b1d3e9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbea9db47-d4", "ovs_interfaceid": "bea9db47-d43e-4df8-a5f2-e934e855cfa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:15:77,bridge_name='br-int',has_traffic_filtering=True,id=bea9db47-d43e-4df8-a5f2-e934e855cfa5,network=Network(92e6cafe-3321-4251-bb51-8cd4315282b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbea9db47-d4') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG nova.objects.instance [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a054fbb-bfb4-40fa-8a03-a0c201df6857 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:28:34 user nova-compute[71321]:   <uuid>5a054fbb-bfb4-40fa-8a03-a0c201df6857</uuid>
Apr 12 12:28:34 user nova-compute[71321]:   <name>instance-00000003</name>
Apr 12 12:28:34 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:28:34 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:28:34 user nova-compute[71321]:   <metadata>
Apr 12 12:28:34 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:28:34 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:28:34 user nova-compute[71321]:       <nova:name>tempest-DeleteServersTestJSON-server-1808317084</nova:name>
Apr 12 12:28:34 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:28:34</nova:creationTime>
Apr 12 12:28:34 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:28:34 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:28:34 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:28:34 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:28:34 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:28:34 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:28:34 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:28:34 user nova-compute[71321]:       <nova:owner>
Apr 12 12:28:34 user nova-compute[71321]:         <nova:user uuid="f0d432191ea141a58407f7b21d077b58">tempest-DeleteServersTestJSON-2075182425-project-member</nova:user>
Apr 12 12:28:34 user nova-compute[71321]:         <nova:project uuid="5c8ee9df3d2043fb818cc565b1d3e9d2">tempest-DeleteServersTestJSON-2075182425</nova:project>
Apr 12 12:28:34 user nova-compute[71321]:       </nova:owner>
Apr 12 12:28:34 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:28:34 user nova-compute[71321]:       <nova:ports>
Apr 12 12:28:34 user nova-compute[71321]:         <nova:port uuid="bea9db47-d43e-4df8-a5f2-e934e855cfa5">
Apr 12 12:28:34 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 12:28:34 user nova-compute[71321]:         </nova:port>
Apr 12 12:28:34 user nova-compute[71321]:       </nova:ports>
Apr 12 12:28:34 user nova-compute[71321]:     </nova:instance>
Apr 12 12:28:34 user nova-compute[71321]:   </metadata>
Apr 12 12:28:34 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:28:34 user nova-compute[71321]:     <system>
Apr 12 12:28:34 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:28:34 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:28:34 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:28:34 user nova-compute[71321]:       <entry name="serial">5a054fbb-bfb4-40fa-8a03-a0c201df6857</entry>
Apr 12 12:28:34 user nova-compute[71321]:       <entry name="uuid">5a054fbb-bfb4-40fa-8a03-a0c201df6857</entry>
Apr 12 12:28:34 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:28:34 user nova-compute[71321]:     </system>
Apr 12 12:28:34 user nova-compute[71321]:   </sysinfo>
Apr 12 12:28:34 user nova-compute[71321]:   <os>
Apr 12 12:28:34 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:28:34 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:28:34 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:28:34 user nova-compute[71321]:   </os>
Apr 12 12:28:34 user nova-compute[71321]:   <features>
Apr 12 12:28:34 user nova-compute[71321]:     <acpi/>
Apr 12 12:28:34 user nova-compute[71321]:     <apic/>
Apr 12 12:28:34 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:28:34 user nova-compute[71321]:   </features>
Apr 12 12:28:34 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:28:34 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:28:34 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:28:34 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:28:34 user nova-compute[71321]:   </clock>
Apr 12 12:28:34 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:28:34 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:28:34 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:28:34 user nova-compute[71321]:   </cpu>
Apr 12 12:28:34 user nova-compute[71321]:   <devices>
Apr 12 12:28:34 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:28:34 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:28:34 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/5a054fbb-bfb4-40fa-8a03-a0c201df6857/disk"/>
Apr 12 12:28:34 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:28:34 user nova-compute[71321]:     </disk>
Apr 12 12:28:34 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:28:34 user nova-compute[71321]:       <mac address="fa:16:3e:72:15:77"/>
Apr 12 12:28:34 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:28:34 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:28:34 user nova-compute[71321]:       <target dev="tapbea9db47-d4"/>
Apr 12 12:28:34 user nova-compute[71321]:     </interface>
Apr 12 12:28:34 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:28:34 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/5a054fbb-bfb4-40fa-8a03-a0c201df6857/console.log" append="off"/>
Apr 12 12:28:34 user nova-compute[71321]:     </serial>
Apr 12 12:28:34 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:28:34 user nova-compute[71321]:     <video>
Apr 12 12:28:34 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:28:34 user nova-compute[71321]:     </video>
Apr 12 12:28:34 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:28:34 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:28:34 user nova-compute[71321]:     </rng>
Apr 12 12:28:34 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:28:34 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:28:34 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:28:34 user nova-compute[71321]:     </memballoon>
Apr 12 12:28:34 user nova-compute[71321]:   </devices>
Apr 12 12:28:34 user nova-compute[71321]: </domain>
Apr 12 12:28:34 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:28:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1808317084',display_name='tempest-DeleteServersTestJSON-server-1808317084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1808317084',id=3,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c8ee9df3d2043fb818cc565b1d3e9d2',ramdisk_id='',reservation_id='r-xo51kons',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-2075182425',owner_user_name='tempest-DeleteServersTestJSON-2075182425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:28:25Z,user_data=None,user_id='f0d432191ea141a58407f7b21d077b58',uuid=5a054fbb-bfb4-40fa-8a03-a0c201df6857,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bea9db47-d43e-4df8-a5f2-e934e855cfa5", "address": "fa:16:3e:72:15:77", "network": {"id": "92e6cafe-3321-4251-bb51-8cd4315282b7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2087616823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c8ee9df3d2043fb818cc565b1d3e9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbea9db47-d4", "ovs_interfaceid": "bea9db47-d43e-4df8-a5f2-e934e855cfa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Converting VIF {"id": "bea9db47-d43e-4df8-a5f2-e934e855cfa5", "address": "fa:16:3e:72:15:77", "network": {"id": "92e6cafe-3321-4251-bb51-8cd4315282b7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2087616823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c8ee9df3d2043fb818cc565b1d3e9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbea9db47-d4", "ovs_interfaceid": "bea9db47-d43e-4df8-a5f2-e934e855cfa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:15:77,bridge_name='br-int',has_traffic_filtering=True,id=bea9db47-d43e-4df8-a5f2-e934e855cfa5,network=Network(92e6cafe-3321-4251-bb51-8cd4315282b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbea9db47-d4') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG os_vif [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:15:77,bridge_name='br-int',has_traffic_filtering=True,id=bea9db47-d43e-4df8-a5f2-e934e855cfa5,network=Network(92e6cafe-3321-4251-bb51-8cd4315282b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbea9db47-d4') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbea9db47-d4, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbea9db47-d4, col_values=(('external_ids', {'iface-id': 'bea9db47-d43e-4df8-a5f2-e934e855cfa5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:15:77', 'vm-uuid': '5a054fbb-bfb4-40fa-8a03-a0c201df6857'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:34 user nova-compute[71321]: INFO os_vif [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:15:77,bridge_name='br-int',has_traffic_filtering=True,id=bea9db47-d43e-4df8-a5f2-e934e855cfa5,network=Network(92e6cafe-3321-4251-bb51-8cd4315282b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbea9db47-d4')
Apr 12 12:28:34 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] No VIF found with MAC fa:16:3e:72:15:77, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG nova.compute.manager [req-4e4ca30b-6ebc-42c8-9b8f-8585b61d9c9a req-bf6fae40-1ac9-423f-8198-fd687fdb1c7b service nova] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Received event network-changed-bea9db47-d43e-4df8-a5f2-e934e855cfa5 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG nova.compute.manager [req-4e4ca30b-6ebc-42c8-9b8f-8585b61d9c9a req-bf6fae40-1ac9-423f-8198-fd687fdb1c7b service nova] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Refreshing instance network info cache due to event network-changed-bea9db47-d43e-4df8-a5f2-e934e855cfa5. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4e4ca30b-6ebc-42c8-9b8f-8585b61d9c9a req-bf6fae40-1ac9-423f-8198-fd687fdb1c7b service nova] Acquiring lock "refresh_cache-5a054fbb-bfb4-40fa-8a03-a0c201df6857" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4e4ca30b-6ebc-42c8-9b8f-8585b61d9c9a req-bf6fae40-1ac9-423f-8198-fd687fdb1c7b service nova] Acquired lock "refresh_cache-5a054fbb-bfb4-40fa-8a03-a0c201df6857" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:28:34 user nova-compute[71321]: DEBUG nova.network.neutron [req-4e4ca30b-6ebc-42c8-9b8f-8585b61d9c9a req-bf6fae40-1ac9-423f-8198-fd687fdb1c7b service nova] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Refreshing network info cache for port bea9db47-d43e-4df8-a5f2-e934e855cfa5 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:28:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:36 user nova-compute[71321]: DEBUG nova.network.neutron [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Successfully updated port: 6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:28:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "refresh_cache-546c0c08-35f1-4043-ac30-56d49bc86af1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:28:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquired lock "refresh_cache-546c0c08-35f1-4043-ac30-56d49bc86af1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:28:36 user nova-compute[71321]: DEBUG nova.network.neutron [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:28:36 user nova-compute[71321]: DEBUG nova.network.neutron [req-4e4ca30b-6ebc-42c8-9b8f-8585b61d9c9a req-bf6fae40-1ac9-423f-8198-fd687fdb1c7b service nova] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Updated VIF entry in instance network info cache for port bea9db47-d43e-4df8-a5f2-e934e855cfa5. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:28:36 user nova-compute[71321]: DEBUG nova.network.neutron [req-4e4ca30b-6ebc-42c8-9b8f-8585b61d9c9a req-bf6fae40-1ac9-423f-8198-fd687fdb1c7b service nova] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Updating instance_info_cache with network_info: [{"id": "bea9db47-d43e-4df8-a5f2-e934e855cfa5", "address": "fa:16:3e:72:15:77", "network": {"id": "92e6cafe-3321-4251-bb51-8cd4315282b7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2087616823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c8ee9df3d2043fb818cc565b1d3e9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbea9db47-d4", "ovs_interfaceid": "bea9db47-d43e-4df8-a5f2-e934e855cfa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:28:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4e4ca30b-6ebc-42c8-9b8f-8585b61d9c9a req-bf6fae40-1ac9-423f-8198-fd687fdb1c7b service nova] Releasing lock "refresh_cache-5a054fbb-bfb4-40fa-8a03-a0c201df6857" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:28:36 user nova-compute[71321]: DEBUG nova.network.neutron [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:28:37 user nova-compute[71321]: DEBUG nova.compute.manager [req-fbd8b21d-139c-4e63-a9ab-287f260e9887 req-c2959611-8c02-45ce-b3ef-6a8149482a19 service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received event network-changed-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:28:37 user nova-compute[71321]: DEBUG nova.compute.manager [req-fbd8b21d-139c-4e63-a9ab-287f260e9887 req-c2959611-8c02-45ce-b3ef-6a8149482a19 service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Refreshing instance network info cache due to event network-changed-6f21df63-1895-4500-b119-c4670a7f3569. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:28:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-fbd8b21d-139c-4e63-a9ab-287f260e9887 req-c2959611-8c02-45ce-b3ef-6a8149482a19 service nova] Acquiring lock "refresh_cache-546c0c08-35f1-4043-ac30-56d49bc86af1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:28:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:37 user nova-compute[71321]: DEBUG nova.compute.manager [req-612e571b-13b2-4b59-9664-ac825cc07632 req-33b0ebaf-6a6a-4b47-b8dc-3a8e1253c6b4 service nova] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Received event network-vif-plugged-bea9db47-d43e-4df8-a5f2-e934e855cfa5 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:28:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-612e571b-13b2-4b59-9664-ac825cc07632 req-33b0ebaf-6a6a-4b47-b8dc-3a8e1253c6b4 service nova] Acquiring lock "5a054fbb-bfb4-40fa-8a03-a0c201df6857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-612e571b-13b2-4b59-9664-ac825cc07632 req-33b0ebaf-6a6a-4b47-b8dc-3a8e1253c6b4 service nova] Lock "5a054fbb-bfb4-40fa-8a03-a0c201df6857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-612e571b-13b2-4b59-9664-ac825cc07632 req-33b0ebaf-6a6a-4b47-b8dc-3a8e1253c6b4 service nova] Lock "5a054fbb-bfb4-40fa-8a03-a0c201df6857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:37 user nova-compute[71321]: DEBUG nova.compute.manager [req-612e571b-13b2-4b59-9664-ac825cc07632 req-33b0ebaf-6a6a-4b47-b8dc-3a8e1253c6b4 service nova] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] No waiting events found dispatching network-vif-plugged-bea9db47-d43e-4df8-a5f2-e934e855cfa5 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:28:37 user nova-compute[71321]: WARNING nova.compute.manager [req-612e571b-13b2-4b59-9664-ac825cc07632 req-33b0ebaf-6a6a-4b47-b8dc-3a8e1253c6b4 service nova] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Received unexpected event network-vif-plugged-bea9db47-d43e-4df8-a5f2-e934e855cfa5 for instance with vm_state building and task_state spawning.
Apr 12 12:28:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:37 user nova-compute[71321]: DEBUG nova.network.neutron [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Successfully created port: b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:28:37 user nova-compute[71321]: DEBUG nova.network.neutron [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Updating instance_info_cache with network_info: [{"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:28:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Releasing lock "refresh_cache-546c0c08-35f1-4043-ac30-56d49bc86af1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:28:37 user nova-compute[71321]: DEBUG nova.compute.manager [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Instance network_info: |[{"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:28:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-fbd8b21d-139c-4e63-a9ab-287f260e9887 req-c2959611-8c02-45ce-b3ef-6a8149482a19 service nova] Acquired lock "refresh_cache-546c0c08-35f1-4043-ac30-56d49bc86af1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:28:37 user nova-compute[71321]: DEBUG nova.network.neutron [req-fbd8b21d-139c-4e63-a9ab-287f260e9887 req-c2959611-8c02-45ce-b3ef-6a8149482a19 service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Refreshing network info cache for port 6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:28:37 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Start _get_guest_xml network_info=[{"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:28:37 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:28:37 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:28:37 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:28:37 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:28:37 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:28:37 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:28:37 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:28:37 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:28:37 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:28:37 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:28:37 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:28:37 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:28:37 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:28:37 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:28:37 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1139912608',display_name='tempest-ServerActionsTestJSON-server-1139912608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1139912608',id=4,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9e64miZ/iyVASS4OS8AZthMPT8KBHm0byN/8NFP7U1AgI9/hOw/R+BSPozX14usgKt+VEqTE1BPs7aRGcfyuCZ/K0LBkD7enTbPYgw3NHHlO3PWScCWY1ae7IFb2uJEw==',key_name='tempest-keypair-1245622558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ba5375005114c8594e0ae86b2f19093',ramdisk_id='',reservation_id='r-kvv9k7th',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1233797030',owner_user_name='tempest-ServerActionsTestJSON-1233797030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:28:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29f7f46d32f4465ba3e8b504c645c22f',uuid=546c0c08-35f1-4043-ac30-56d49bc86af1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:28:37 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converting VIF {"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:28:37 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f21df63-1895-4500-b119-c4670a7f3569,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21df63-18') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:28:37 user nova-compute[71321]: DEBUG nova.objects.instance [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lazy-loading 'pci_devices' on Instance uuid 546c0c08-35f1-4043-ac30-56d49bc86af1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:28:38 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:28:38 user nova-compute[71321]:   <uuid>546c0c08-35f1-4043-ac30-56d49bc86af1</uuid>
Apr 12 12:28:38 user nova-compute[71321]:   <name>instance-00000004</name>
Apr 12 12:28:38 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:28:38 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:28:38 user nova-compute[71321]:   <metadata>
Apr 12 12:28:38 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:28:38 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:28:38 user nova-compute[71321]:       <nova:name>tempest-ServerActionsTestJSON-server-1139912608</nova:name>
Apr 12 12:28:38 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:28:37</nova:creationTime>
Apr 12 12:28:38 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:28:38 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:28:38 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:28:38 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:28:38 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:28:38 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:28:38 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:28:38 user nova-compute[71321]:       <nova:owner>
Apr 12 12:28:38 user nova-compute[71321]:         <nova:user uuid="29f7f46d32f4465ba3e8b504c645c22f">tempest-ServerActionsTestJSON-1233797030-project-member</nova:user>
Apr 12 12:28:38 user nova-compute[71321]:         <nova:project uuid="7ba5375005114c8594e0ae86b2f19093">tempest-ServerActionsTestJSON-1233797030</nova:project>
Apr 12 12:28:38 user nova-compute[71321]:       </nova:owner>
Apr 12 12:28:38 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:28:38 user nova-compute[71321]:       <nova:ports>
Apr 12 12:28:38 user nova-compute[71321]:         <nova:port uuid="6f21df63-1895-4500-b119-c4670a7f3569">
Apr 12 12:28:38 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 12:28:38 user nova-compute[71321]:         </nova:port>
Apr 12 12:28:38 user nova-compute[71321]:       </nova:ports>
Apr 12 12:28:38 user nova-compute[71321]:     </nova:instance>
Apr 12 12:28:38 user nova-compute[71321]:   </metadata>
Apr 12 12:28:38 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:28:38 user nova-compute[71321]:     <system>
Apr 12 12:28:38 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:28:38 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:28:38 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:28:38 user nova-compute[71321]:       <entry name="serial">546c0c08-35f1-4043-ac30-56d49bc86af1</entry>
Apr 12 12:28:38 user nova-compute[71321]:       <entry name="uuid">546c0c08-35f1-4043-ac30-56d49bc86af1</entry>
Apr 12 12:28:38 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:28:38 user nova-compute[71321]:     </system>
Apr 12 12:28:38 user nova-compute[71321]:   </sysinfo>
Apr 12 12:28:38 user nova-compute[71321]:   <os>
Apr 12 12:28:38 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:28:38 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:28:38 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:28:38 user nova-compute[71321]:   </os>
Apr 12 12:28:38 user nova-compute[71321]:   <features>
Apr 12 12:28:38 user nova-compute[71321]:     <acpi/>
Apr 12 12:28:38 user nova-compute[71321]:     <apic/>
Apr 12 12:28:38 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:28:38 user nova-compute[71321]:   </features>
Apr 12 12:28:38 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:28:38 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:28:38 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:28:38 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:28:38 user nova-compute[71321]:   </clock>
Apr 12 12:28:38 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:28:38 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:28:38 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:28:38 user nova-compute[71321]:   </cpu>
Apr 12 12:28:38 user nova-compute[71321]:   <devices>
Apr 12 12:28:38 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:28:38 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:28:38 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk"/>
Apr 12 12:28:38 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:28:38 user nova-compute[71321]:     </disk>
Apr 12 12:28:38 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:28:38 user nova-compute[71321]:       <mac address="fa:16:3e:14:16:c4"/>
Apr 12 12:28:38 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:28:38 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:28:38 user nova-compute[71321]:       <target dev="tap6f21df63-18"/>
Apr 12 12:28:38 user nova-compute[71321]:     </interface>
Apr 12 12:28:38 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:28:38 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/console.log" append="off"/>
Apr 12 12:28:38 user nova-compute[71321]:     </serial>
Apr 12 12:28:38 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:28:38 user nova-compute[71321]:     <video>
Apr 12 12:28:38 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:28:38 user nova-compute[71321]:     </video>
Apr 12 12:28:38 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:28:38 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:28:38 user nova-compute[71321]:     </rng>
Apr 12 12:28:38 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:28:38 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:28:38 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:28:38 user nova-compute[71321]:     </memballoon>
Apr 12 12:28:38 user nova-compute[71321]:   </devices>
Apr 12 12:28:38 user nova-compute[71321]: </domain>
Apr 12 12:28:38 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:28:38 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1139912608',display_name='tempest-ServerActionsTestJSON-server-1139912608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1139912608',id=4,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9e64miZ/iyVASS4OS8AZthMPT8KBHm0byN/8NFP7U1AgI9/hOw/R+BSPozX14usgKt+VEqTE1BPs7aRGcfyuCZ/K0LBkD7enTbPYgw3NHHlO3PWScCWY1ae7IFb2uJEw==',key_name='tempest-keypair-1245622558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ba5375005114c8594e0ae86b2f19093',ramdisk_id='',reservation_id='r-kvv9k7th',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1233797030',owner_user_name='tempest-ServerActionsTestJSON-1233797030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:28:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29f7f46d32f4465ba3e8b504c645c22f',uuid=546c0c08-35f1-4043-ac30-56d49bc86af1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:28:38 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converting VIF {"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:28:38 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f21df63-1895-4500-b119-c4670a7f3569,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21df63-18') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:28:38 user nova-compute[71321]: DEBUG os_vif [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f21df63-1895-4500-b119-c4670a7f3569,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21df63-18') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:28:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:28:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:28:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f21df63-18, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:28:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6f21df63-18, col_values=(('external_ids', {'iface-id': '6f21df63-1895-4500-b119-c4670a7f3569', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:16:c4', 'vm-uuid': '546c0c08-35f1-4043-ac30-56d49bc86af1'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:28:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:28:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:38 user nova-compute[71321]: INFO os_vif [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f21df63-1895-4500-b119-c4670a7f3569,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21df63-18')
Apr 12 12:28:38 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:28:38 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] No VIF found with MAC fa:16:3e:14:16:c4, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:28:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:38 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302518.8975585, 5a054fbb-bfb4-40fa-8a03-a0c201df6857 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:28:38 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] VM Resumed (Lifecycle Event)
Apr 12 12:28:38 user nova-compute[71321]: DEBUG nova.compute.manager [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:28:38 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:28:38 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Instance spawned successfully.
Apr 12 12:28:38 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:28:38 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:28:38 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:28:38 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:28:38 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:28:38 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:28:38 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:28:38 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:28:38 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:28:39 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:28:39 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302518.8999155, 5a054fbb-bfb4-40fa-8a03-a0c201df6857 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:28:39 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] VM Started (Lifecycle Event)
Apr 12 12:28:39 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:28:39 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:28:39 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:28:39 user nova-compute[71321]: INFO nova.compute.manager [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Took 14.00 seconds to spawn the instance on the hypervisor.
Apr 12 12:28:39 user nova-compute[71321]: DEBUG nova.compute.manager [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:28:39 user nova-compute[71321]: INFO nova.compute.manager [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Took 14.75 seconds to build instance.
Apr 12 12:28:39 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "5a054fbb-bfb4-40fa-8a03-a0c201df6857" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.876s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:39 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:39 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:39 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:39 user nova-compute[71321]: DEBUG nova.network.neutron [req-fbd8b21d-139c-4e63-a9ab-287f260e9887 req-c2959611-8c02-45ce-b3ef-6a8149482a19 service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Updated VIF entry in instance network info cache for port 6f21df63-1895-4500-b119-c4670a7f3569. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:28:39 user nova-compute[71321]: DEBUG nova.network.neutron [req-fbd8b21d-139c-4e63-a9ab-287f260e9887 req-c2959611-8c02-45ce-b3ef-6a8149482a19 service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Updating instance_info_cache with network_info: [{"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:28:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-fbd8b21d-139c-4e63-a9ab-287f260e9887 req-c2959611-8c02-45ce-b3ef-6a8149482a19 service nova] Releasing lock "refresh_cache-546c0c08-35f1-4043-ac30-56d49bc86af1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:28:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-f29a01c4-2662-43b5-8e2d-32c49ecb9c61 req-a577905d-a3a3-41a4-b60e-fe33d569fb82 service nova] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Received event network-vif-plugged-bea9db47-d43e-4df8-a5f2-e934e855cfa5 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:28:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f29a01c4-2662-43b5-8e2d-32c49ecb9c61 req-a577905d-a3a3-41a4-b60e-fe33d569fb82 service nova] Acquiring lock "5a054fbb-bfb4-40fa-8a03-a0c201df6857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f29a01c4-2662-43b5-8e2d-32c49ecb9c61 req-a577905d-a3a3-41a4-b60e-fe33d569fb82 service nova] Lock "5a054fbb-bfb4-40fa-8a03-a0c201df6857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f29a01c4-2662-43b5-8e2d-32c49ecb9c61 req-a577905d-a3a3-41a4-b60e-fe33d569fb82 service nova] Lock "5a054fbb-bfb4-40fa-8a03-a0c201df6857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-f29a01c4-2662-43b5-8e2d-32c49ecb9c61 req-a577905d-a3a3-41a4-b60e-fe33d569fb82 service nova] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] No waiting events found dispatching network-vif-plugged-bea9db47-d43e-4df8-a5f2-e934e855cfa5 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:28:39 user nova-compute[71321]: WARNING nova.compute.manager [req-f29a01c4-2662-43b5-8e2d-32c49ecb9c61 req-a577905d-a3a3-41a4-b60e-fe33d569fb82 service nova] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Received unexpected event network-vif-plugged-bea9db47-d43e-4df8-a5f2-e934e855cfa5 for instance with vm_state active and task_state None.
Apr 12 12:28:40 user nova-compute[71321]: DEBUG nova.compute.manager [req-d2b421d0-5f69-4b5c-8a8e-cb662ade6152 req-6d9cb073-4ad2-4833-b491-734f3e4e9d9d service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received event network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:28:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d2b421d0-5f69-4b5c-8a8e-cb662ade6152 req-6d9cb073-4ad2-4833-b491-734f3e4e9d9d service nova] Acquiring lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d2b421d0-5f69-4b5c-8a8e-cb662ade6152 req-6d9cb073-4ad2-4833-b491-734f3e4e9d9d service nova] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d2b421d0-5f69-4b5c-8a8e-cb662ade6152 req-6d9cb073-4ad2-4833-b491-734f3e4e9d9d service nova] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:40 user nova-compute[71321]: DEBUG nova.compute.manager [req-d2b421d0-5f69-4b5c-8a8e-cb662ade6152 req-6d9cb073-4ad2-4833-b491-734f3e4e9d9d service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] No waiting events found dispatching network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:28:40 user nova-compute[71321]: WARNING nova.compute.manager [req-d2b421d0-5f69-4b5c-8a8e-cb662ade6152 req-6d9cb073-4ad2-4833-b491-734f3e4e9d9d service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received unexpected event network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 for instance with vm_state building and task_state spawning.
Apr 12 12:28:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:41 user nova-compute[71321]: DEBUG nova.network.neutron [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Successfully updated port: b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:28:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "refresh_cache-839e85a2-f7af-482d-a5e6-09195888300e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:28:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquired lock "refresh_cache-839e85a2-f7af-482d-a5e6-09195888300e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:28:41 user nova-compute[71321]: DEBUG nova.network.neutron [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:28:41 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:41 user nova-compute[71321]: DEBUG nova.compute.manager [req-730f0880-ff44-477c-be12-9120529922d1 req-3ff38035-31e9-4186-a615-f6a8c58c5864 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Received event network-changed-b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:28:41 user nova-compute[71321]: DEBUG nova.compute.manager [req-730f0880-ff44-477c-be12-9120529922d1 req-3ff38035-31e9-4186-a615-f6a8c58c5864 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Refreshing instance network info cache due to event network-changed-b5f18af0-544d-4978-b20e-85da7e880834. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:28:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-730f0880-ff44-477c-be12-9120529922d1 req-3ff38035-31e9-4186-a615-f6a8c58c5864 service nova] Acquiring lock "refresh_cache-839e85a2-f7af-482d-a5e6-09195888300e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:28:41 user nova-compute[71321]: DEBUG nova.network.neutron [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:28:42 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302522.1845431, 546c0c08-35f1-4043-ac30-56d49bc86af1 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:28:42 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] VM Resumed (Lifecycle Event)
Apr 12 12:28:42 user nova-compute[71321]: DEBUG nova.compute.manager [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:28:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:28:42 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Instance spawned successfully.
Apr 12 12:28:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:28:42 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:28:42 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:28:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:28:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:28:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:28:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:28:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:28:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:28:42 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:28:42 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302522.190269, 546c0c08-35f1-4043-ac30-56d49bc86af1 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:28:42 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] VM Started (Lifecycle Event)
Apr 12 12:28:42 user nova-compute[71321]: DEBUG nova.compute.manager [req-e8642269-bf2f-4005-aa47-ee32e488dd15 req-7ea60977-ba41-444f-a2ad-782bb97e2702 service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received event network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:28:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e8642269-bf2f-4005-aa47-ee32e488dd15 req-7ea60977-ba41-444f-a2ad-782bb97e2702 service nova] Acquiring lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e8642269-bf2f-4005-aa47-ee32e488dd15 req-7ea60977-ba41-444f-a2ad-782bb97e2702 service nova] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e8642269-bf2f-4005-aa47-ee32e488dd15 req-7ea60977-ba41-444f-a2ad-782bb97e2702 service nova] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:42 user nova-compute[71321]: DEBUG nova.compute.manager [req-e8642269-bf2f-4005-aa47-ee32e488dd15 req-7ea60977-ba41-444f-a2ad-782bb97e2702 service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] No waiting events found dispatching network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:28:42 user nova-compute[71321]: WARNING nova.compute.manager [req-e8642269-bf2f-4005-aa47-ee32e488dd15 req-7ea60977-ba41-444f-a2ad-782bb97e2702 service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received unexpected event network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 for instance with vm_state building and task_state spawning.
Apr 12 12:28:42 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:28:42 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:28:42 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:28:42 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:42 user nova-compute[71321]: INFO nova.compute.manager [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Took 12.51 seconds to spawn the instance on the hypervisor.
Apr 12 12:28:42 user nova-compute[71321]: DEBUG nova.compute.manager [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:28:42 user nova-compute[71321]: INFO nova.compute.manager [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Took 13.48 seconds to build instance.
Apr 12 12:28:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.637s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG nova.network.neutron [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Updating instance_info_cache with network_info: [{"id": "b5f18af0-544d-4978-b20e-85da7e880834", "address": "fa:16:3e:f7:93:c8", "network": {"id": "b6e89fad-c9f7-473e-ab76-3f005281cc95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-175129642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1faa529d424800900e10a7ceaa63d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f18af0-54", "ovs_interfaceid": "b5f18af0-544d-4978-b20e-85da7e880834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Releasing lock "refresh_cache-839e85a2-f7af-482d-a5e6-09195888300e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG nova.compute.manager [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Instance network_info: |[{"id": "b5f18af0-544d-4978-b20e-85da7e880834", "address": "fa:16:3e:f7:93:c8", "network": {"id": "b6e89fad-c9f7-473e-ab76-3f005281cc95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-175129642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1faa529d424800900e10a7ceaa63d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f18af0-54", "ovs_interfaceid": "b5f18af0-544d-4978-b20e-85da7e880834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-730f0880-ff44-477c-be12-9120529922d1 req-3ff38035-31e9-4186-a615-f6a8c58c5864 service nova] Acquired lock "refresh_cache-839e85a2-f7af-482d-a5e6-09195888300e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG nova.network.neutron [req-730f0880-ff44-477c-be12-9120529922d1 req-3ff38035-31e9-4186-a615-f6a8c58c5864 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Refreshing network info cache for port b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Start _get_guest_xml network_info=[{"id": "b5f18af0-544d-4978-b20e-85da7e880834", "address": "fa:16:3e:f7:93:c8", "network": {"id": "b6e89fad-c9f7-473e-ab76-3f005281cc95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-175129642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1faa529d424800900e10a7ceaa63d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f18af0-54", "ovs_interfaceid": "b5f18af0-544d-4978-b20e-85da7e880834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:28:43 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:28:43 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:28:43 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:28:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-880464121',display_name='tempest-ServerStableDeviceRescueTest-server-880464121',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-880464121',id=5,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbjsmMAk7TgSJuVPAPMbe+S9lCblPJCLl74ltjr7B+GvM2NkPL65YFl6sPwYL2BIrtM9phc+NecEtUrIGkGO+1xCyg6wipPFufRoi6dOJI6CI4+oKRDt9+nYbnf0HP/Kw==',key_name='tempest-keypair-1613417814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b1faa529d424800900e10a7ceaa63d4',ramdisk_id='',reservation_id='r-9f4j5h8u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1967261752',owner_user_name='tempest-ServerStableDeviceRescueTest-1967261752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:28:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d76f02dd70664dfea34586abbc213526',uuid=839e85a2-f7af-482d-a5e6-09195888300e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5f18af0-544d-4978-b20e-85da7e880834", "address": "fa:16:3e:f7:93:c8", "network": {"id": "b6e89fad-c9f7-473e-ab76-3f005281cc95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-175129642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1faa529d424800900e10a7ceaa63d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f18af0-54", "ovs_interfaceid": "b5f18af0-544d-4978-b20e-85da7e880834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Converting VIF {"id": "b5f18af0-544d-4978-b20e-85da7e880834", "address": "fa:16:3e:f7:93:c8", "network": {"id": "b6e89fad-c9f7-473e-ab76-3f005281cc95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-175129642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1faa529d424800900e10a7ceaa63d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f18af0-54", "ovs_interfaceid": "b5f18af0-544d-4978-b20e-85da7e880834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:93:c8,bridge_name='br-int',has_traffic_filtering=True,id=b5f18af0-544d-4978-b20e-85da7e880834,network=Network(b6e89fad-c9f7-473e-ab76-3f005281cc95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f18af0-54') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG nova.objects.instance [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lazy-loading 'pci_devices' on Instance uuid 839e85a2-f7af-482d-a5e6-09195888300e {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:28:43 user nova-compute[71321]:   <uuid>839e85a2-f7af-482d-a5e6-09195888300e</uuid>
Apr 12 12:28:43 user nova-compute[71321]:   <name>instance-00000005</name>
Apr 12 12:28:43 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:28:43 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:28:43 user nova-compute[71321]:   <metadata>
Apr 12 12:28:43 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:28:43 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:28:43 user nova-compute[71321]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-880464121</nova:name>
Apr 12 12:28:43 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:28:43</nova:creationTime>
Apr 12 12:28:43 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:28:43 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:28:43 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:28:43 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:28:43 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:28:43 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:28:43 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:28:43 user nova-compute[71321]:       <nova:owner>
Apr 12 12:28:43 user nova-compute[71321]:         <nova:user uuid="d76f02dd70664dfea34586abbc213526">tempest-ServerStableDeviceRescueTest-1967261752-project-member</nova:user>
Apr 12 12:28:43 user nova-compute[71321]:         <nova:project uuid="3b1faa529d424800900e10a7ceaa63d4">tempest-ServerStableDeviceRescueTest-1967261752</nova:project>
Apr 12 12:28:43 user nova-compute[71321]:       </nova:owner>
Apr 12 12:28:43 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:28:43 user nova-compute[71321]:       <nova:ports>
Apr 12 12:28:43 user nova-compute[71321]:         <nova:port uuid="b5f18af0-544d-4978-b20e-85da7e880834">
Apr 12 12:28:43 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 12:28:43 user nova-compute[71321]:         </nova:port>
Apr 12 12:28:43 user nova-compute[71321]:       </nova:ports>
Apr 12 12:28:43 user nova-compute[71321]:     </nova:instance>
Apr 12 12:28:43 user nova-compute[71321]:   </metadata>
Apr 12 12:28:43 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:28:43 user nova-compute[71321]:     <system>
Apr 12 12:28:43 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:28:43 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:28:43 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:28:43 user nova-compute[71321]:       <entry name="serial">839e85a2-f7af-482d-a5e6-09195888300e</entry>
Apr 12 12:28:43 user nova-compute[71321]:       <entry name="uuid">839e85a2-f7af-482d-a5e6-09195888300e</entry>
Apr 12 12:28:43 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:28:43 user nova-compute[71321]:     </system>
Apr 12 12:28:43 user nova-compute[71321]:   </sysinfo>
Apr 12 12:28:43 user nova-compute[71321]:   <os>
Apr 12 12:28:43 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:28:43 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:28:43 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:28:43 user nova-compute[71321]:   </os>
Apr 12 12:28:43 user nova-compute[71321]:   <features>
Apr 12 12:28:43 user nova-compute[71321]:     <acpi/>
Apr 12 12:28:43 user nova-compute[71321]:     <apic/>
Apr 12 12:28:43 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:28:43 user nova-compute[71321]:   </features>
Apr 12 12:28:43 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:28:43 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:28:43 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:28:43 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:28:43 user nova-compute[71321]:   </clock>
Apr 12 12:28:43 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:28:43 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:28:43 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:28:43 user nova-compute[71321]:   </cpu>
Apr 12 12:28:43 user nova-compute[71321]:   <devices>
Apr 12 12:28:43 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:28:43 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:28:43 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk"/>
Apr 12 12:28:43 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:28:43 user nova-compute[71321]:     </disk>
Apr 12 12:28:43 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:28:43 user nova-compute[71321]:       <mac address="fa:16:3e:f7:93:c8"/>
Apr 12 12:28:43 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:28:43 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:28:43 user nova-compute[71321]:       <target dev="tapb5f18af0-54"/>
Apr 12 12:28:43 user nova-compute[71321]:     </interface>
Apr 12 12:28:43 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:28:43 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/console.log" append="off"/>
Apr 12 12:28:43 user nova-compute[71321]:     </serial>
Apr 12 12:28:43 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:28:43 user nova-compute[71321]:     <video>
Apr 12 12:28:43 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:28:43 user nova-compute[71321]:     </video>
Apr 12 12:28:43 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:28:43 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:28:43 user nova-compute[71321]:     </rng>
Apr 12 12:28:43 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:28:43 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:28:43 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:28:43 user nova-compute[71321]:     </memballoon>
Apr 12 12:28:43 user nova-compute[71321]:   </devices>
Apr 12 12:28:43 user nova-compute[71321]: </domain>
Apr 12 12:28:43 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:28:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-880464121',display_name='tempest-ServerStableDeviceRescueTest-server-880464121',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-880464121',id=5,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbjsmMAk7TgSJuVPAPMbe+S9lCblPJCLl74ltjr7B+GvM2NkPL65YFl6sPwYL2BIrtM9phc+NecEtUrIGkGO+1xCyg6wipPFufRoi6dOJI6CI4+oKRDt9+nYbnf0HP/Kw==',key_name='tempest-keypair-1613417814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b1faa529d424800900e10a7ceaa63d4',ramdisk_id='',reservation_id='r-9f4j5h8u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1967261752',owner_user_name='tempest-ServerStableDeviceRescueTest-1967261752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:28:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d76f02dd70664dfea34586abbc213526',uuid=839e85a2-f7af-482d-a5e6-09195888300e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5f18af0-544d-4978-b20e-85da7e880834", "address": "fa:16:3e:f7:93:c8", "network": {"id": "b6e89fad-c9f7-473e-ab76-3f005281cc95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-175129642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1faa529d424800900e10a7ceaa63d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f18af0-54", "ovs_interfaceid": "b5f18af0-544d-4978-b20e-85da7e880834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Converting VIF {"id": "b5f18af0-544d-4978-b20e-85da7e880834", "address": "fa:16:3e:f7:93:c8", "network": {"id": "b6e89fad-c9f7-473e-ab76-3f005281cc95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-175129642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1faa529d424800900e10a7ceaa63d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f18af0-54", "ovs_interfaceid": "b5f18af0-544d-4978-b20e-85da7e880834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:93:c8,bridge_name='br-int',has_traffic_filtering=True,id=b5f18af0-544d-4978-b20e-85da7e880834,network=Network(b6e89fad-c9f7-473e-ab76-3f005281cc95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f18af0-54') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG os_vif [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:93:c8,bridge_name='br-int',has_traffic_filtering=True,id=b5f18af0-544d-4978-b20e-85da7e880834,network=Network(b6e89fad-c9f7-473e-ab76-3f005281cc95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f18af0-54') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5f18af0-54, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb5f18af0-54, col_values=(('external_ids', {'iface-id': 'b5f18af0-544d-4978-b20e-85da7e880834', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:93:c8', 'vm-uuid': '839e85a2-f7af-482d-a5e6-09195888300e'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:43 user nova-compute[71321]: INFO os_vif [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:93:c8,bridge_name='br-int',has_traffic_filtering=True,id=b5f18af0-544d-4978-b20e-85da7e880834,network=Network(b6e89fad-c9f7-473e-ab76-3f005281cc95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f18af0-54')
Apr 12 12:28:43 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] No VIF found with MAC fa:16:3e:f7:93:c8, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:28:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:44 user nova-compute[71321]: DEBUG nova.network.neutron [req-730f0880-ff44-477c-be12-9120529922d1 req-3ff38035-31e9-4186-a615-f6a8c58c5864 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Updated VIF entry in instance network info cache for port b5f18af0-544d-4978-b20e-85da7e880834. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:28:44 user nova-compute[71321]: DEBUG nova.network.neutron [req-730f0880-ff44-477c-be12-9120529922d1 req-3ff38035-31e9-4186-a615-f6a8c58c5864 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Updating instance_info_cache with network_info: [{"id": "b5f18af0-544d-4978-b20e-85da7e880834", "address": "fa:16:3e:f7:93:c8", "network": {"id": "b6e89fad-c9f7-473e-ab76-3f005281cc95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-175129642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1faa529d424800900e10a7ceaa63d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f18af0-54", "ovs_interfaceid": "b5f18af0-544d-4978-b20e-85da7e880834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:28:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-730f0880-ff44-477c-be12-9120529922d1 req-3ff38035-31e9-4186-a615-f6a8c58c5864 service nova] Releasing lock "refresh_cache-839e85a2-f7af-482d-a5e6-09195888300e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:28:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:45 user nova-compute[71321]: DEBUG nova.compute.manager [req-bcd9ca6c-78a3-4f00-a73a-a3966ad0ff53 req-e22689b7-6ab3-4817-9d7f-3d61a19d6d35 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Received event network-vif-plugged-b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:28:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-bcd9ca6c-78a3-4f00-a73a-a3966ad0ff53 req-e22689b7-6ab3-4817-9d7f-3d61a19d6d35 service nova] Acquiring lock "839e85a2-f7af-482d-a5e6-09195888300e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-bcd9ca6c-78a3-4f00-a73a-a3966ad0ff53 req-e22689b7-6ab3-4817-9d7f-3d61a19d6d35 service nova] Lock "839e85a2-f7af-482d-a5e6-09195888300e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-bcd9ca6c-78a3-4f00-a73a-a3966ad0ff53 req-e22689b7-6ab3-4817-9d7f-3d61a19d6d35 service nova] Lock "839e85a2-f7af-482d-a5e6-09195888300e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:45 user nova-compute[71321]: DEBUG nova.compute.manager [req-bcd9ca6c-78a3-4f00-a73a-a3966ad0ff53 req-e22689b7-6ab3-4817-9d7f-3d61a19d6d35 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] No waiting events found dispatching network-vif-plugged-b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:28:45 user nova-compute[71321]: WARNING nova.compute.manager [req-bcd9ca6c-78a3-4f00-a73a-a3966ad0ff53 req-e22689b7-6ab3-4817-9d7f-3d61a19d6d35 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Received unexpected event network-vif-plugged-b5f18af0-544d-4978-b20e-85da7e880834 for instance with vm_state building and task_state spawning.
Apr 12 12:28:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:47 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302527.697563, 839e85a2-f7af-482d-a5e6-09195888300e => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:28:47 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] VM Resumed (Lifecycle Event)
Apr 12 12:28:47 user nova-compute[71321]: DEBUG nova.compute.manager [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:28:47 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:28:47 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Instance spawned successfully.
Apr 12 12:28:47 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:28:47 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:28:47 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:28:47 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:28:47 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:28:47 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:28:47 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:28:47 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:28:47 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:28:47 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:28:47 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302527.7030478, 839e85a2-f7af-482d-a5e6-09195888300e => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:28:47 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] VM Started (Lifecycle Event)
Apr 12 12:28:47 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:28:47 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:28:47 user nova-compute[71321]: INFO nova.compute.manager [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Took 14.55 seconds to spawn the instance on the hypervisor.
Apr 12 12:28:47 user nova-compute[71321]: DEBUG nova.compute.manager [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:28:47 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:28:47 user nova-compute[71321]: DEBUG nova.compute.manager [req-58d5f3fb-d174-4208-a671-bdee7bad54a0 req-34bba52d-cd3a-40b2-88ef-46463b4528a0 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Received event network-vif-plugged-b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:28:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-58d5f3fb-d174-4208-a671-bdee7bad54a0 req-34bba52d-cd3a-40b2-88ef-46463b4528a0 service nova] Acquiring lock "839e85a2-f7af-482d-a5e6-09195888300e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-58d5f3fb-d174-4208-a671-bdee7bad54a0 req-34bba52d-cd3a-40b2-88ef-46463b4528a0 service nova] Lock "839e85a2-f7af-482d-a5e6-09195888300e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-58d5f3fb-d174-4208-a671-bdee7bad54a0 req-34bba52d-cd3a-40b2-88ef-46463b4528a0 service nova] Lock "839e85a2-f7af-482d-a5e6-09195888300e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:47 user nova-compute[71321]: DEBUG nova.compute.manager [req-58d5f3fb-d174-4208-a671-bdee7bad54a0 req-34bba52d-cd3a-40b2-88ef-46463b4528a0 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] No waiting events found dispatching network-vif-plugged-b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:28:47 user nova-compute[71321]: WARNING nova.compute.manager [req-58d5f3fb-d174-4208-a671-bdee7bad54a0 req-34bba52d-cd3a-40b2-88ef-46463b4528a0 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Received unexpected event network-vif-plugged-b5f18af0-544d-4978-b20e-85da7e880834 for instance with vm_state building and task_state spawning.
Apr 12 12:28:48 user nova-compute[71321]: INFO nova.compute.manager [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Took 15.63 seconds to build instance.
Apr 12 12:28:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "839e85a2-f7af-482d-a5e6-09195888300e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.850s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "540a69c0-488f-40cb-bdde-3e410029d4c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "540a69c0-488f-40cb-bdde-3e410029d4c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:53 user nova-compute[71321]: DEBUG nova.compute.manager [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:28:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:53 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:28:53 user nova-compute[71321]: INFO nova.compute.claims [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Claim successful on node user
Apr 12 12:28:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "2f3ff25a-522c-431b-a177-85177401c7a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "2f3ff25a-522c-431b-a177-85177401c7a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:53 user nova-compute[71321]: DEBUG nova.compute.manager [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:28:53 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:28:53 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:28:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.625s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:53 user nova-compute[71321]: DEBUG nova.compute.manager [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:28:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.050s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:53 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:28:53 user nova-compute[71321]: INFO nova.compute.claims [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Claim successful on node user
Apr 12 12:28:53 user nova-compute[71321]: DEBUG nova.compute.manager [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:28:53 user nova-compute[71321]: DEBUG nova.network.neutron [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:28:53 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:28:54 user nova-compute[71321]: DEBUG nova.compute.manager [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:28:54 user nova-compute[71321]: DEBUG nova.policy [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2991a85234e046698761e54b1f203861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c4688a3b0b429fb12d12ab7bd14e43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:28:54 user nova-compute[71321]: DEBUG nova.compute.manager [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:28:54 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:28:54 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Creating image(s)
Apr 12 12:28:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "/opt/stack/data/nova/instances/540a69c0-488f-40cb-bdde-3e410029d4c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "/opt/stack/data/nova/instances/540a69c0-488f-40cb-bdde-3e410029d4c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "/opt/stack/data/nova/instances/540a69c0-488f-40cb-bdde-3e410029d4c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:54 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:28:54 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:28:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.161s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:54 user nova-compute[71321]: DEBUG nova.compute.manager [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:28:54 user nova-compute[71321]: DEBUG nova.compute.manager [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:28:54 user nova-compute[71321]: DEBUG nova.network.neutron [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:28:54 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Apr 12 12:28:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.160s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/540a69c0-488f-40cb-bdde-3e410029d4c8/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:54 user nova-compute[71321]: DEBUG nova.compute.manager [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:28:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/540a69c0-488f-40cb-bdde-3e410029d4c8/disk 1073741824" returned: 0 in 0.060s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:54 user nova-compute[71321]: DEBUG nova.policy [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '66e3fb7903c94cd6a2a709ca0e133ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f3f538463546f9a0eab47df52e2f56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:28:54 user nova-compute[71321]: DEBUG nova.compute.manager [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:28:54 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:28:54 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Creating image(s)
Apr 12 12:28:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f3ff25a-522c-431b-a177-85177401c7a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "/opt/stack/data/nova/instances/2f3ff25a-522c-431b-a177-85177401c7a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "/opt/stack/data/nova/instances/2f3ff25a-522c-431b-a177-85177401c7a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "8ca9ae49b87a30deaf28664377c1bb558cbc59fa" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "8ca9ae49b87a30deaf28664377c1bb558cbc59fa" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.159s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:54 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Checking if we can resize image /opt/stack/data/nova/instances/540a69c0-488f-40cb-bdde-3e410029d4c8/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:28:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a69c0-488f-40cb-bdde-3e410029d4c8/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ca9ae49b87a30deaf28664377c1bb558cbc59fa.part --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a69c0-488f-40cb-bdde-3e410029d4c8/disk --force-share --output=json" returned: 0 in 0.462s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:55 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Cannot resize image /opt/stack/data/nova/instances/540a69c0-488f-40cb-bdde-3e410029d4c8/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:28:55 user nova-compute[71321]: DEBUG nova.objects.instance [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lazy-loading 'migration_context' on Instance uuid 540a69c0-488f-40cb-bdde-3e410029d4c8 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:28:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:28:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Ensure instance console log exists: /opt/stack/data/nova/instances/540a69c0-488f-40cb-bdde-3e410029d4c8/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:28:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ca9ae49b87a30deaf28664377c1bb558cbc59fa.part --force-share --output=json" returned: 0 in 0.155s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:55 user nova-compute[71321]: DEBUG nova.virt.images [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] 875251de-7186-4c31-a652-86e2ae4f852c was qcow2, converting to raw {{(pid=71321) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 12:28:55 user nova-compute[71321]: DEBUG nova.privsep.utils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 12:28:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8ca9ae49b87a30deaf28664377c1bb558cbc59fa.part /opt/stack/data/nova/instances/_base/8ca9ae49b87a30deaf28664377c1bb558cbc59fa.converted {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8ca9ae49b87a30deaf28664377c1bb558cbc59fa.part /opt/stack/data/nova/instances/_base/8ca9ae49b87a30deaf28664377c1bb558cbc59fa.converted" returned: 0 in 0.189s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ca9ae49b87a30deaf28664377c1bb558cbc59fa.converted --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:55 user nova-compute[71321]: DEBUG nova.network.neutron [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Successfully created port: 69203d15-c034-4d74-915d-1fc13c89ee40 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:28:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ca9ae49b87a30deaf28664377c1bb558cbc59fa.converted --force-share --output=json" returned: 0 in 0.147s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "8ca9ae49b87a30deaf28664377c1bb558cbc59fa" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.939s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ca9ae49b87a30deaf28664377c1bb558cbc59fa --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ca9ae49b87a30deaf28664377c1bb558cbc59fa --force-share --output=json" returned: 0 in 0.139s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "8ca9ae49b87a30deaf28664377c1bb558cbc59fa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "8ca9ae49b87a30deaf28664377c1bb558cbc59fa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ca9ae49b87a30deaf28664377c1bb558cbc59fa --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "79bee3fe-3300-4a28-b079-1bafaa1033c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "79bee3fe-3300-4a28-b079-1bafaa1033c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:55 user nova-compute[71321]: DEBUG nova.network.neutron [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Successfully created port: 7db9ebe7-8544-46eb-8d75-929d0422278f {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:28:55 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ca9ae49b87a30deaf28664377c1bb558cbc59fa --force-share --output=json" returned: 0 in 0.176s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8ca9ae49b87a30deaf28664377c1bb558cbc59fa,backing_fmt=raw /opt/stack/data/nova/instances/2f3ff25a-522c-431b-a177-85177401c7a9/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8ca9ae49b87a30deaf28664377c1bb558cbc59fa,backing_fmt=raw /opt/stack/data/nova/instances/2f3ff25a-522c-431b-a177-85177401c7a9/disk 1073741824" returned: 0 in 0.076s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "8ca9ae49b87a30deaf28664377c1bb558cbc59fa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ca9ae49b87a30deaf28664377c1bb558cbc59fa --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:28:56 user nova-compute[71321]: INFO nova.compute.claims [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Claim successful on node user
Apr 12 12:28:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ca9ae49b87a30deaf28664377c1bb558cbc59fa --force-share --output=json" returned: 0 in 0.172s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f3ff25a-522c-431b-a177-85177401c7a9/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f3ff25a-522c-431b-a177-85177401c7a9/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f3ff25a-522c-431b-a177-85177401c7a9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Cannot resize image /opt/stack/data/nova/instances/2f3ff25a-522c-431b-a177-85177401c7a9/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG nova.objects.instance [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lazy-loading 'migration_context' on Instance uuid 2f3ff25a-522c-431b-a177-85177401c7a9 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Ensure instance console log exists: /opt/stack/data/nova/instances/2f3ff25a-522c-431b-a177-85177401c7a9/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG nova.network.neutron [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Successfully updated port: 69203d15-c034-4d74-915d-1fc13c89ee40 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "refresh_cache-540a69c0-488f-40cb-bdde-3e410029d4c8" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquired lock "refresh_cache-540a69c0-488f-40cb-bdde-3e410029d4c8" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG nova.network.neutron [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG nova.compute.manager [req-8c177b09-67bf-4de4-b611-d101f101cd52 req-639fc216-195d-48a8-926c-05e39e5f08b0 service nova] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Received event network-changed-69203d15-c034-4d74-915d-1fc13c89ee40 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG nova.compute.manager [req-8c177b09-67bf-4de4-b611-d101f101cd52 req-639fc216-195d-48a8-926c-05e39e5f08b0 service nova] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Refreshing instance network info cache due to event network-changed-69203d15-c034-4d74-915d-1fc13c89ee40. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-8c177b09-67bf-4de4-b611-d101f101cd52 req-639fc216-195d-48a8-926c-05e39e5f08b0 service nova] Acquiring lock "refresh_cache-540a69c0-488f-40cb-bdde-3e410029d4c8" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG nova.network.neutron [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.611s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG nova.network.neutron [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:28:56 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:28:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG nova.network.neutron [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Successfully updated port: 7db9ebe7-8544-46eb-8d75-929d0422278f {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "refresh_cache-2f3ff25a-522c-431b-a177-85177401c7a9" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquired lock "refresh_cache-2f3ff25a-522c-431b-a177-85177401c7a9" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:28:56 user nova-compute[71321]: DEBUG nova.network.neutron [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.compute.manager [req-220d1cf3-7fcc-4785-9965-e2722bf12e51 req-4865239a-923c-4c60-b378-8592da967ced service nova] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Received event network-changed-7db9ebe7-8544-46eb-8d75-929d0422278f {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.compute.manager [req-220d1cf3-7fcc-4785-9965-e2722bf12e51 req-4865239a-923c-4c60-b378-8592da967ced service nova] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Refreshing instance network info cache due to event network-changed-7db9ebe7-8544-46eb-8d75-929d0422278f. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-220d1cf3-7fcc-4785-9965-e2722bf12e51 req-4865239a-923c-4c60-b378-8592da967ced service nova] Acquiring lock "refresh_cache-2f3ff25a-522c-431b-a177-85177401c7a9" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.policy [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2ff191ffb9604795bab6ada1eafd41ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd2a4a665514d0eb31653775b67356a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.network.neutron [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:28:57 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Creating image(s)
Apr 12 12:28:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "/opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "/opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "/opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.network.neutron [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Updating instance_info_cache with network_info: [{"id": "69203d15-c034-4d74-915d-1fc13c89ee40", "address": "fa:16:3e:1b:12:96", "network": {"id": "7e291b14-2505-4769-a423-3025cafb6fbc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-752511885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c4688a3b0b429fb12d12ab7bd14e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69203d15-c0", "ovs_interfaceid": "69203d15-c034-4d74-915d-1fc13c89ee40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Releasing lock "refresh_cache-540a69c0-488f-40cb-bdde-3e410029d4c8" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.compute.manager [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Instance network_info: |[{"id": "69203d15-c034-4d74-915d-1fc13c89ee40", "address": "fa:16:3e:1b:12:96", "network": {"id": "7e291b14-2505-4769-a423-3025cafb6fbc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-752511885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c4688a3b0b429fb12d12ab7bd14e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69203d15-c0", "ovs_interfaceid": "69203d15-c034-4d74-915d-1fc13c89ee40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-8c177b09-67bf-4de4-b611-d101f101cd52 req-639fc216-195d-48a8-926c-05e39e5f08b0 service nova] Acquired lock "refresh_cache-540a69c0-488f-40cb-bdde-3e410029d4c8" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.network.neutron [req-8c177b09-67bf-4de4-b611-d101f101cd52 req-639fc216-195d-48a8-926c-05e39e5f08b0 service nova] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Refreshing network info cache for port 69203d15-c034-4d74-915d-1fc13c89ee40 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Start _get_guest_xml network_info=[{"id": "69203d15-c034-4d74-915d-1fc13c89ee40", "address": "fa:16:3e:1b:12:96", "network": {"id": "7e291b14-2505-4769-a423-3025cafb6fbc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-752511885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c4688a3b0b429fb12d12ab7bd14e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69203d15-c0", "ovs_interfaceid": "69203d15-c034-4d74-915d-1fc13c89ee40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:28:57 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:28:57 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:28:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1796205714',display_name='tempest-TestVolumeSwap-server-1796205714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1796205714',id=6,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYnP1AePrADpa6JilldYtpPDptoIe9CTMXo+FcAEyhImA2xpG2q/0PpsCiqXJ220TNxIISIHyWrM0NQBvRGn3XwfGqZw4o8/KRoBf74FQaJ9aKltnL+xfRvmZLxzK5W4Q==',key_name='tempest-keypair-1155106394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5c4688a3b0b429fb12d12ab7bd14e43',ramdisk_id='',reservation_id='r-orqq3dql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1492117268',owner_user_name='tempest-TestVolumeSwap-1492117268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:28:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2991a85234e046698761e54b1f203861',uuid=540a69c0-488f-40cb-bdde-3e410029d4c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69203d15-c034-4d74-915d-1fc13c89ee40", "address": "fa:16:3e:1b:12:96", "network": {"id": "7e291b14-2505-4769-a423-3025cafb6fbc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-752511885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c4688a3b0b429fb12d12ab7bd14e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69203d15-c0", "ovs_interfaceid": "69203d15-c034-4d74-915d-1fc13c89ee40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Converting VIF {"id": "69203d15-c034-4d74-915d-1fc13c89ee40", "address": "fa:16:3e:1b:12:96", "network": {"id": "7e291b14-2505-4769-a423-3025cafb6fbc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-752511885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c4688a3b0b429fb12d12ab7bd14e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69203d15-c0", "ovs_interfaceid": "69203d15-c034-4d74-915d-1fc13c89ee40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:12:96,bridge_name='br-int',has_traffic_filtering=True,id=69203d15-c034-4d74-915d-1fc13c89ee40,network=Network(7e291b14-2505-4769-a423-3025cafb6fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69203d15-c0') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.objects.instance [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lazy-loading 'pci_devices' on Instance uuid 540a69c0-488f-40cb-bdde-3e410029d4c8 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.208s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:28:57 user nova-compute[71321]:   <uuid>540a69c0-488f-40cb-bdde-3e410029d4c8</uuid>
Apr 12 12:28:57 user nova-compute[71321]:   <name>instance-00000006</name>
Apr 12 12:28:57 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:28:57 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:28:57 user nova-compute[71321]:   <metadata>
Apr 12 12:28:57 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:28:57 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:28:57 user nova-compute[71321]:       <nova:name>tempest-TestVolumeSwap-server-1796205714</nova:name>
Apr 12 12:28:57 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:28:57</nova:creationTime>
Apr 12 12:28:57 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:28:57 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:28:57 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:28:57 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:28:57 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:28:57 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:28:57 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:28:57 user nova-compute[71321]:       <nova:owner>
Apr 12 12:28:57 user nova-compute[71321]:         <nova:user uuid="2991a85234e046698761e54b1f203861">tempest-TestVolumeSwap-1492117268-project-member</nova:user>
Apr 12 12:28:57 user nova-compute[71321]:         <nova:project uuid="d5c4688a3b0b429fb12d12ab7bd14e43">tempest-TestVolumeSwap-1492117268</nova:project>
Apr 12 12:28:57 user nova-compute[71321]:       </nova:owner>
Apr 12 12:28:57 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:28:57 user nova-compute[71321]:       <nova:ports>
Apr 12 12:28:57 user nova-compute[71321]:         <nova:port uuid="69203d15-c034-4d74-915d-1fc13c89ee40">
Apr 12 12:28:57 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 12:28:57 user nova-compute[71321]:         </nova:port>
Apr 12 12:28:57 user nova-compute[71321]:       </nova:ports>
Apr 12 12:28:57 user nova-compute[71321]:     </nova:instance>
Apr 12 12:28:57 user nova-compute[71321]:   </metadata>
Apr 12 12:28:57 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:28:57 user nova-compute[71321]:     <system>
Apr 12 12:28:57 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:28:57 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:28:57 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:28:57 user nova-compute[71321]:       <entry name="serial">540a69c0-488f-40cb-bdde-3e410029d4c8</entry>
Apr 12 12:28:57 user nova-compute[71321]:       <entry name="uuid">540a69c0-488f-40cb-bdde-3e410029d4c8</entry>
Apr 12 12:28:57 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:28:57 user nova-compute[71321]:     </system>
Apr 12 12:28:57 user nova-compute[71321]:   </sysinfo>
Apr 12 12:28:57 user nova-compute[71321]:   <os>
Apr 12 12:28:57 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:28:57 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:28:57 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:28:57 user nova-compute[71321]:   </os>
Apr 12 12:28:57 user nova-compute[71321]:   <features>
Apr 12 12:28:57 user nova-compute[71321]:     <acpi/>
Apr 12 12:28:57 user nova-compute[71321]:     <apic/>
Apr 12 12:28:57 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:28:57 user nova-compute[71321]:   </features>
Apr 12 12:28:57 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:28:57 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:28:57 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:28:57 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:28:57 user nova-compute[71321]:   </clock>
Apr 12 12:28:57 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:28:57 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:28:57 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:28:57 user nova-compute[71321]:   </cpu>
Apr 12 12:28:57 user nova-compute[71321]:   <devices>
Apr 12 12:28:57 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:28:57 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:28:57 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/540a69c0-488f-40cb-bdde-3e410029d4c8/disk"/>
Apr 12 12:28:57 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:28:57 user nova-compute[71321]:     </disk>
Apr 12 12:28:57 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:28:57 user nova-compute[71321]:       <mac address="fa:16:3e:1b:12:96"/>
Apr 12 12:28:57 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:28:57 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:28:57 user nova-compute[71321]:       <target dev="tap69203d15-c0"/>
Apr 12 12:28:57 user nova-compute[71321]:     </interface>
Apr 12 12:28:57 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:28:57 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/540a69c0-488f-40cb-bdde-3e410029d4c8/console.log" append="off"/>
Apr 12 12:28:57 user nova-compute[71321]:     </serial>
Apr 12 12:28:57 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:28:57 user nova-compute[71321]:     <video>
Apr 12 12:28:57 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:28:57 user nova-compute[71321]:     </video>
Apr 12 12:28:57 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:28:57 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:28:57 user nova-compute[71321]:     </rng>
Apr 12 12:28:57 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:28:57 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:28:57 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:28:57 user nova-compute[71321]:     </memballoon>
Apr 12 12:28:57 user nova-compute[71321]:   </devices>
Apr 12 12:28:57 user nova-compute[71321]: </domain>
Apr 12 12:28:57 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:28:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1796205714',display_name='tempest-TestVolumeSwap-server-1796205714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1796205714',id=6,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYnP1AePrADpa6JilldYtpPDptoIe9CTMXo+FcAEyhImA2xpG2q/0PpsCiqXJ220TNxIISIHyWrM0NQBvRGn3XwfGqZw4o8/KRoBf74FQaJ9aKltnL+xfRvmZLxzK5W4Q==',key_name='tempest-keypair-1155106394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5c4688a3b0b429fb12d12ab7bd14e43',ramdisk_id='',reservation_id='r-orqq3dql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1492117268',owner_user_name='tempest-TestVolumeSwap-1492117268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:28:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2991a85234e046698761e54b1f203861',uuid=540a69c0-488f-40cb-bdde-3e410029d4c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69203d15-c034-4d74-915d-1fc13c89ee40", "address": "fa:16:3e:1b:12:96", "network": {"id": "7e291b14-2505-4769-a423-3025cafb6fbc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-752511885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c4688a3b0b429fb12d12ab7bd14e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69203d15-c0", "ovs_interfaceid": "69203d15-c034-4d74-915d-1fc13c89ee40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Converting VIF {"id": "69203d15-c034-4d74-915d-1fc13c89ee40", "address": "fa:16:3e:1b:12:96", "network": {"id": "7e291b14-2505-4769-a423-3025cafb6fbc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-752511885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c4688a3b0b429fb12d12ab7bd14e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69203d15-c0", "ovs_interfaceid": "69203d15-c034-4d74-915d-1fc13c89ee40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:12:96,bridge_name='br-int',has_traffic_filtering=True,id=69203d15-c034-4d74-915d-1fc13c89ee40,network=Network(7e291b14-2505-4769-a423-3025cafb6fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69203d15-c0') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG os_vif [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:12:96,bridge_name='br-int',has_traffic_filtering=True,id=69203d15-c034-4d74-915d-1fc13c89ee40,network=Network(7e291b14-2505-4769-a423-3025cafb6fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69203d15-c0') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69203d15-c0, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap69203d15-c0, col_values=(('external_ids', {'iface-id': '69203d15-c034-4d74-915d-1fc13c89ee40', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:12:96', 'vm-uuid': '540a69c0-488f-40cb-bdde-3e410029d4c8'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:57 user nova-compute[71321]: INFO os_vif [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:12:96,bridge_name='br-int',has_traffic_filtering=True,id=69203d15-c034-4d74-915d-1fc13c89ee40,network=Network(7e291b14-2505-4769-a423-3025cafb6fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69203d15-c0')
Apr 12 12:28:57 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.146s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/disk 1073741824" returned: 0 in 0.080s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] No VIF found with MAC fa:16:3e:1b:12:96, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.148s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Checking if we can resize image /opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.network.neutron [req-8c177b09-67bf-4de4-b611-d101f101cd52 req-639fc216-195d-48a8-926c-05e39e5f08b0 service nova] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Updated VIF entry in instance network info cache for port 69203d15-c034-4d74-915d-1fc13c89ee40. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.network.neutron [req-8c177b09-67bf-4de4-b611-d101f101cd52 req-639fc216-195d-48a8-926c-05e39e5f08b0 service nova] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Updating instance_info_cache with network_info: [{"id": "69203d15-c034-4d74-915d-1fc13c89ee40", "address": "fa:16:3e:1b:12:96", "network": {"id": "7e291b14-2505-4769-a423-3025cafb6fbc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-752511885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c4688a3b0b429fb12d12ab7bd14e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69203d15-c0", "ovs_interfaceid": "69203d15-c034-4d74-915d-1fc13c89ee40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Cannot resize image /opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.objects.instance [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lazy-loading 'migration_context' on Instance uuid 79bee3fe-3300-4a28-b079-1bafaa1033c4 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Ensure instance console log exists: /opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:28:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-8c177b09-67bf-4de4-b611-d101f101cd52 req-639fc216-195d-48a8-926c-05e39e5f08b0 service nova] Releasing lock "refresh_cache-540a69c0-488f-40cb-bdde-3e410029d4c8" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG nova.network.neutron [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Updating instance_info_cache with network_info: [{"id": "7db9ebe7-8544-46eb-8d75-929d0422278f", "address": "fa:16:3e:aa:c6:e9", "network": {"id": "ed1e01b0-282c-4171-88ab-4f0eb80724e2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-826776752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02f3f538463546f9a0eab47df52e2f56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7db9ebe7-85", "ovs_interfaceid": "7db9ebe7-8544-46eb-8d75-929d0422278f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Releasing lock "refresh_cache-2f3ff25a-522c-431b-a177-85177401c7a9" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG nova.compute.manager [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Instance network_info: |[{"id": "7db9ebe7-8544-46eb-8d75-929d0422278f", "address": "fa:16:3e:aa:c6:e9", "network": {"id": "ed1e01b0-282c-4171-88ab-4f0eb80724e2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-826776752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02f3f538463546f9a0eab47df52e2f56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7db9ebe7-85", "ovs_interfaceid": "7db9ebe7-8544-46eb-8d75-929d0422278f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-220d1cf3-7fcc-4785-9965-e2722bf12e51 req-4865239a-923c-4c60-b378-8592da967ced service nova] Acquired lock "refresh_cache-2f3ff25a-522c-431b-a177-85177401c7a9" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG nova.network.neutron [req-220d1cf3-7fcc-4785-9965-e2722bf12e51 req-4865239a-923c-4c60-b378-8592da967ced service nova] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Refreshing network info cache for port 7db9ebe7-8544-46eb-8d75-929d0422278f {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Start _get_guest_xml network_info=[{"id": "7db9ebe7-8544-46eb-8d75-929d0422278f", "address": "fa:16:3e:aa:c6:e9", "network": {"id": "ed1e01b0-282c-4171-88ab-4f0eb80724e2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-826776752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02f3f538463546f9a0eab47df52e2f56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7db9ebe7-85", "ovs_interfaceid": "7db9ebe7-8544-46eb-8d75-929d0422278f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:28:44Z,direct_url=<?>,disk_format='qcow2',id=875251de-7186-4c31-a652-86e2ae4f852c,min_disk=0,min_ram=0,name='',owner='5c782de404e84ecbad43b60fde57b7c8',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:28:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/sda', 'disk_bus': 'scsi', 'image_id': '875251de-7186-4c31-a652-86e2ae4f852c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:28:58 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:28:58 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:28:58 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:28:44Z,direct_url=<?>,disk_format='qcow2',id=875251de-7186-4c31-a652-86e2ae4f852c,min_disk=0,min_ram=0,name='',owner='5c782de404e84ecbad43b60fde57b7c8',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:28:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:28:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-662121220',display_name='tempest-AttachSCSIVolumeTestJSON-server-662121220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-662121220',id=7,image_ref='875251de-7186-4c31-a652-86e2ae4f852c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGoVgvWo88zPXxgfw7yjbHEryzhu42eYfncF0zIc/WtRssu6+d2LdfKHNGIeYY5Ua3QamFBJReIJokD0D4DEooB6gLRQnf+LJjd3K8nLB1AaWWi0tP4V51n7O7M9NtNegg==',key_name='tempest-keypair-817895902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02f3f538463546f9a0eab47df52e2f56',ramdisk_id='',reservation_id='r-cwyrgmo6',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='875251de-7186-4c31-a652-86e2ae4f852c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2004507714',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2004507714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:28:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66e3fb7903c94cd6a2a709ca0e133ce2',uuid=2f3ff25a-522c-431b-a177-85177401c7a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7db9ebe7-8544-46eb-8d75-929d0422278f", "address": "fa:16:3e:aa:c6:e9", "network": {"id": "ed1e01b0-282c-4171-88ab-4f0eb80724e2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-826776752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02f3f538463546f9a0eab47df52e2f56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7db9ebe7-85", "ovs_interfaceid": "7db9ebe7-8544-46eb-8d75-929d0422278f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Converting VIF {"id": "7db9ebe7-8544-46eb-8d75-929d0422278f", "address": "fa:16:3e:aa:c6:e9", "network": {"id": "ed1e01b0-282c-4171-88ab-4f0eb80724e2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-826776752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02f3f538463546f9a0eab47df52e2f56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7db9ebe7-85", "ovs_interfaceid": "7db9ebe7-8544-46eb-8d75-929d0422278f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:c6:e9,bridge_name='br-int',has_traffic_filtering=True,id=7db9ebe7-8544-46eb-8d75-929d0422278f,network=Network(ed1e01b0-282c-4171-88ab-4f0eb80724e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7db9ebe7-85') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG nova.objects.instance [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f3ff25a-522c-431b-a177-85177401c7a9 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:28:58 user nova-compute[71321]:   <uuid>2f3ff25a-522c-431b-a177-85177401c7a9</uuid>
Apr 12 12:28:58 user nova-compute[71321]:   <name>instance-00000007</name>
Apr 12 12:28:58 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:28:58 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:28:58 user nova-compute[71321]:   <metadata>
Apr 12 12:28:58 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:28:58 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:28:58 user nova-compute[71321]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-662121220</nova:name>
Apr 12 12:28:58 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:28:58</nova:creationTime>
Apr 12 12:28:58 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:28:58 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:28:58 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:28:58 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:28:58 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:28:58 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:28:58 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:28:58 user nova-compute[71321]:       <nova:owner>
Apr 12 12:28:58 user nova-compute[71321]:         <nova:user uuid="66e3fb7903c94cd6a2a709ca0e133ce2">tempest-AttachSCSIVolumeTestJSON-2004507714-project-member</nova:user>
Apr 12 12:28:58 user nova-compute[71321]:         <nova:project uuid="02f3f538463546f9a0eab47df52e2f56">tempest-AttachSCSIVolumeTestJSON-2004507714</nova:project>
Apr 12 12:28:58 user nova-compute[71321]:       </nova:owner>
Apr 12 12:28:58 user nova-compute[71321]:       <nova:root type="image" uuid="875251de-7186-4c31-a652-86e2ae4f852c"/>
Apr 12 12:28:58 user nova-compute[71321]:       <nova:ports>
Apr 12 12:28:58 user nova-compute[71321]:         <nova:port uuid="7db9ebe7-8544-46eb-8d75-929d0422278f">
Apr 12 12:28:58 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 12:28:58 user nova-compute[71321]:         </nova:port>
Apr 12 12:28:58 user nova-compute[71321]:       </nova:ports>
Apr 12 12:28:58 user nova-compute[71321]:     </nova:instance>
Apr 12 12:28:58 user nova-compute[71321]:   </metadata>
Apr 12 12:28:58 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:28:58 user nova-compute[71321]:     <system>
Apr 12 12:28:58 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:28:58 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:28:58 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:28:58 user nova-compute[71321]:       <entry name="serial">2f3ff25a-522c-431b-a177-85177401c7a9</entry>
Apr 12 12:28:58 user nova-compute[71321]:       <entry name="uuid">2f3ff25a-522c-431b-a177-85177401c7a9</entry>
Apr 12 12:28:58 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:28:58 user nova-compute[71321]:     </system>
Apr 12 12:28:58 user nova-compute[71321]:   </sysinfo>
Apr 12 12:28:58 user nova-compute[71321]:   <os>
Apr 12 12:28:58 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:28:58 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:28:58 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:28:58 user nova-compute[71321]:   </os>
Apr 12 12:28:58 user nova-compute[71321]:   <features>
Apr 12 12:28:58 user nova-compute[71321]:     <acpi/>
Apr 12 12:28:58 user nova-compute[71321]:     <apic/>
Apr 12 12:28:58 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:28:58 user nova-compute[71321]:   </features>
Apr 12 12:28:58 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:28:58 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:28:58 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:28:58 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:28:58 user nova-compute[71321]:   </clock>
Apr 12 12:28:58 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:28:58 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:28:58 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:28:58 user nova-compute[71321]:   </cpu>
Apr 12 12:28:58 user nova-compute[71321]:   <devices>
Apr 12 12:28:58 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:28:58 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:28:58 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/2f3ff25a-522c-431b-a177-85177401c7a9/disk"/>
Apr 12 12:28:58 user nova-compute[71321]:       <target dev="sda" bus="scsi"/>
Apr 12 12:28:58 user nova-compute[71321]:       <address type="drive" controller="0" unit="0"/>
Apr 12 12:28:58 user nova-compute[71321]:     </disk>
Apr 12 12:28:58 user nova-compute[71321]:     <disk type="file" device="cdrom">
Apr 12 12:28:58 user nova-compute[71321]:       <driver name="qemu" type="raw" cache="none"/>
Apr 12 12:28:58 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/2f3ff25a-522c-431b-a177-85177401c7a9/disk.config"/>
Apr 12 12:28:58 user nova-compute[71321]:       <target dev="sdb" bus="scsi"/>
Apr 12 12:28:58 user nova-compute[71321]:       <address type="drive" controller="0" unit="1"/>
Apr 12 12:28:58 user nova-compute[71321]:     </disk>
Apr 12 12:28:58 user nova-compute[71321]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Apr 12 12:28:58 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:28:58 user nova-compute[71321]:       <mac address="fa:16:3e:aa:c6:e9"/>
Apr 12 12:28:58 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:28:58 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:28:58 user nova-compute[71321]:       <target dev="tap7db9ebe7-85"/>
Apr 12 12:28:58 user nova-compute[71321]:     </interface>
Apr 12 12:28:58 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:28:58 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/2f3ff25a-522c-431b-a177-85177401c7a9/console.log" append="off"/>
Apr 12 12:28:58 user nova-compute[71321]:     </serial>
Apr 12 12:28:58 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:28:58 user nova-compute[71321]:     <video>
Apr 12 12:28:58 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:28:58 user nova-compute[71321]:     </video>
Apr 12 12:28:58 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:28:58 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:28:58 user nova-compute[71321]:     </rng>
Apr 12 12:28:58 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:28:58 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:28:58 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:28:58 user nova-compute[71321]:     </memballoon>
Apr 12 12:28:58 user nova-compute[71321]:   </devices>
Apr 12 12:28:58 user nova-compute[71321]: </domain>
Apr 12 12:28:58 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:28:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-662121220',display_name='tempest-AttachSCSIVolumeTestJSON-server-662121220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-662121220',id=7,image_ref='875251de-7186-4c31-a652-86e2ae4f852c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGoVgvWo88zPXxgfw7yjbHEryzhu42eYfncF0zIc/WtRssu6+d2LdfKHNGIeYY5Ua3QamFBJReIJokD0D4DEooB6gLRQnf+LJjd3K8nLB1AaWWi0tP4V51n7O7M9NtNegg==',key_name='tempest-keypair-817895902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02f3f538463546f9a0eab47df52e2f56',ramdisk_id='',reservation_id='r-cwyrgmo6',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='875251de-7186-4c31-a652-86e2ae4f852c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2004507714',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2004507714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:28:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66e3fb7903c94cd6a2a709ca0e133ce2',uuid=2f3ff25a-522c-431b-a177-85177401c7a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7db9ebe7-8544-46eb-8d75-929d0422278f", "address": "fa:16:3e:aa:c6:e9", "network": {"id": "ed1e01b0-282c-4171-88ab-4f0eb80724e2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-826776752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02f3f538463546f9a0eab47df52e2f56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7db9ebe7-85", "ovs_interfaceid": "7db9ebe7-8544-46eb-8d75-929d0422278f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Converting VIF {"id": "7db9ebe7-8544-46eb-8d75-929d0422278f", "address": "fa:16:3e:aa:c6:e9", "network": {"id": "ed1e01b0-282c-4171-88ab-4f0eb80724e2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-826776752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02f3f538463546f9a0eab47df52e2f56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7db9ebe7-85", "ovs_interfaceid": "7db9ebe7-8544-46eb-8d75-929d0422278f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:c6:e9,bridge_name='br-int',has_traffic_filtering=True,id=7db9ebe7-8544-46eb-8d75-929d0422278f,network=Network(ed1e01b0-282c-4171-88ab-4f0eb80724e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7db9ebe7-85') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG os_vif [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:c6:e9,bridge_name='br-int',has_traffic_filtering=True,id=7db9ebe7-8544-46eb-8d75-929d0422278f,network=Network(ed1e01b0-282c-4171-88ab-4f0eb80724e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7db9ebe7-85') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7db9ebe7-85, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7db9ebe7-85, col_values=(('external_ids', {'iface-id': '7db9ebe7-8544-46eb-8d75-929d0422278f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:c6:e9', 'vm-uuid': '2f3ff25a-522c-431b-a177-85177401c7a9'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:58 user nova-compute[71321]: INFO os_vif [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:c6:e9,bridge_name='br-int',has_traffic_filtering=True,id=7db9ebe7-8544-46eb-8d75-929d0422278f,network=Network(ed1e01b0-282c-4171-88ab-4f0eb80724e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7db9ebe7-85')
Apr 12 12:28:58 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] No BDM found with device name sda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] No VIF found with MAC fa:16:3e:aa:c6:e9, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:28:58 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Using config drive
Apr 12 12:28:58 user nova-compute[71321]: DEBUG nova.network.neutron [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Successfully created port: 201eadd8-c760-4862-bcce-bcff996371f9 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:28:58 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Creating config drive at /opt/stack/data/nova/instances/2f3ff25a-522c-431b-a177-85177401c7a9/disk.config
Apr 12 12:28:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2f3ff25a-522c-431b-a177-85177401c7a9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpchrpyi0e {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2f3ff25a-522c-431b-a177-85177401c7a9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpchrpyi0e" returned: 0 in 0.069s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:28:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:59 user nova-compute[71321]: DEBUG nova.network.neutron [req-220d1cf3-7fcc-4785-9965-e2722bf12e51 req-4865239a-923c-4c60-b378-8592da967ced service nova] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Updated VIF entry in instance network info cache for port 7db9ebe7-8544-46eb-8d75-929d0422278f. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:28:59 user nova-compute[71321]: DEBUG nova.network.neutron [req-220d1cf3-7fcc-4785-9965-e2722bf12e51 req-4865239a-923c-4c60-b378-8592da967ced service nova] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Updating instance_info_cache with network_info: [{"id": "7db9ebe7-8544-46eb-8d75-929d0422278f", "address": "fa:16:3e:aa:c6:e9", "network": {"id": "ed1e01b0-282c-4171-88ab-4f0eb80724e2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-826776752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02f3f538463546f9a0eab47df52e2f56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7db9ebe7-85", "ovs_interfaceid": "7db9ebe7-8544-46eb-8d75-929d0422278f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:28:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-220d1cf3-7fcc-4785-9965-e2722bf12e51 req-4865239a-923c-4c60-b378-8592da967ced service nova] Releasing lock "refresh_cache-2f3ff25a-522c-431b-a177-85177401c7a9" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:28:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:28:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:00 user nova-compute[71321]: DEBUG nova.compute.manager [req-999aee71-77f4-44ff-ae24-9a0f5c68e444 req-44c26820-b750-4613-8731-938f0f55d087 service nova] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Received event network-vif-plugged-69203d15-c034-4d74-915d-1fc13c89ee40 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:29:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-999aee71-77f4-44ff-ae24-9a0f5c68e444 req-44c26820-b750-4613-8731-938f0f55d087 service nova] Acquiring lock "540a69c0-488f-40cb-bdde-3e410029d4c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-999aee71-77f4-44ff-ae24-9a0f5c68e444 req-44c26820-b750-4613-8731-938f0f55d087 service nova] Lock "540a69c0-488f-40cb-bdde-3e410029d4c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-999aee71-77f4-44ff-ae24-9a0f5c68e444 req-44c26820-b750-4613-8731-938f0f55d087 service nova] Lock "540a69c0-488f-40cb-bdde-3e410029d4c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:00 user nova-compute[71321]: DEBUG nova.compute.manager [req-999aee71-77f4-44ff-ae24-9a0f5c68e444 req-44c26820-b750-4613-8731-938f0f55d087 service nova] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] No waiting events found dispatching network-vif-plugged-69203d15-c034-4d74-915d-1fc13c89ee40 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:29:00 user nova-compute[71321]: WARNING nova.compute.manager [req-999aee71-77f4-44ff-ae24-9a0f5c68e444 req-44c26820-b750-4613-8731-938f0f55d087 service nova] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Received unexpected event network-vif-plugged-69203d15-c034-4d74-915d-1fc13c89ee40 for instance with vm_state building and task_state spawning.
Apr 12 12:29:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:01 user nova-compute[71321]: DEBUG nova.network.neutron [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Successfully updated port: 201eadd8-c760-4862-bcce-bcff996371f9 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:29:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "refresh_cache-79bee3fe-3300-4a28-b079-1bafaa1033c4" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:29:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquired lock "refresh_cache-79bee3fe-3300-4a28-b079-1bafaa1033c4" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:29:01 user nova-compute[71321]: DEBUG nova.network.neutron [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:29:01 user nova-compute[71321]: DEBUG nova.network.neutron [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:29:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:01 user nova-compute[71321]: DEBUG nova.network.neutron [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Updating instance_info_cache with network_info: [{"id": "201eadd8-c760-4862-bcce-bcff996371f9", "address": "fa:16:3e:4a:27:fd", "network": {"id": "a751f1e2-998e-4446-b94e-4bab0dc80db7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-990400052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dd2a4a665514d0eb31653775b67356a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201eadd8-c7", "ovs_interfaceid": "201eadd8-c760-4862-bcce-bcff996371f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:29:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Releasing lock "refresh_cache-79bee3fe-3300-4a28-b079-1bafaa1033c4" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:29:01 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Instance network_info: |[{"id": "201eadd8-c760-4862-bcce-bcff996371f9", "address": "fa:16:3e:4a:27:fd", "network": {"id": "a751f1e2-998e-4446-b94e-4bab0dc80db7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-990400052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dd2a4a665514d0eb31653775b67356a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201eadd8-c7", "ovs_interfaceid": "201eadd8-c760-4862-bcce-bcff996371f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:29:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Start _get_guest_xml network_info=[{"id": "201eadd8-c760-4862-bcce-bcff996371f9", "address": "fa:16:3e:4a:27:fd", "network": {"id": "a751f1e2-998e-4446-b94e-4bab0dc80db7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-990400052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dd2a4a665514d0eb31653775b67356a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201eadd8-c7", "ovs_interfaceid": "201eadd8-c760-4862-bcce-bcff996371f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:29:01 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:29:01 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:29:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:29:01 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:29:01 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:29:01 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:29:01 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:29:01 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:29:01 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:29:01 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:29:01 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:29:01 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:29:01 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:29:01 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:29:02 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:28:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-656063872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-656063872',id=8,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxGfNEhwxyml0RYHshQIBVlikZPUICMVOtWr1cX5kE9lM3qDUztZplY9zWTLExsTj4Jyt4GyZTZtlPvLt0Z2/a5v2pzKXPmtIr/OlOJ6S/2MsrCvF+uqljaJkNsq+Gqvw==',key_name='tempest-keypair-134546144',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0dd2a4a665514d0eb31653775b67356a',ramdisk_id='',reservation_id='r-u0qzq363',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1949865572',owner_user_name='tempest-TaggedAttachmentsTest-1949865572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:28:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ff191ffb9604795bab6ada1eafd41ff',uuid=79bee3fe-3300-4a28-b079-1bafaa1033c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "201eadd8-c760-4862-bcce-bcff996371f9", "address": "fa:16:3e:4a:27:fd", "network": {"id": "a751f1e2-998e-4446-b94e-4bab0dc80db7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-990400052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dd2a4a665514d0eb31653775b67356a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201eadd8-c7", "ovs_interfaceid": "201eadd8-c760-4862-bcce-bcff996371f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:29:02 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Converting VIF {"id": "201eadd8-c760-4862-bcce-bcff996371f9", "address": "fa:16:3e:4a:27:fd", "network": {"id": "a751f1e2-998e-4446-b94e-4bab0dc80db7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-990400052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dd2a4a665514d0eb31653775b67356a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201eadd8-c7", "ovs_interfaceid": "201eadd8-c760-4862-bcce-bcff996371f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:29:02 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:27:fd,bridge_name='br-int',has_traffic_filtering=True,id=201eadd8-c760-4862-bcce-bcff996371f9,network=Network(a751f1e2-998e-4446-b94e-4bab0dc80db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201eadd8-c7') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:29:02 user nova-compute[71321]: DEBUG nova.objects.instance [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lazy-loading 'pci_devices' on Instance uuid 79bee3fe-3300-4a28-b079-1bafaa1033c4 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:29:02 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:29:02 user nova-compute[71321]:   <uuid>79bee3fe-3300-4a28-b079-1bafaa1033c4</uuid>
Apr 12 12:29:02 user nova-compute[71321]:   <name>instance-00000008</name>
Apr 12 12:29:02 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:29:02 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:29:02 user nova-compute[71321]:   <metadata>
Apr 12 12:29:02 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:29:02 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:29:02 user nova-compute[71321]:       <nova:name>tempest-device-tagging-server-656063872</nova:name>
Apr 12 12:29:02 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:29:01</nova:creationTime>
Apr 12 12:29:02 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:29:02 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:29:02 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:29:02 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:29:02 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:29:02 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:29:02 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:29:02 user nova-compute[71321]:       <nova:owner>
Apr 12 12:29:02 user nova-compute[71321]:         <nova:user uuid="2ff191ffb9604795bab6ada1eafd41ff">tempest-TaggedAttachmentsTest-1949865572-project-member</nova:user>
Apr 12 12:29:02 user nova-compute[71321]:         <nova:project uuid="0dd2a4a665514d0eb31653775b67356a">tempest-TaggedAttachmentsTest-1949865572</nova:project>
Apr 12 12:29:02 user nova-compute[71321]:       </nova:owner>
Apr 12 12:29:02 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:29:02 user nova-compute[71321]:       <nova:ports>
Apr 12 12:29:02 user nova-compute[71321]:         <nova:port uuid="201eadd8-c760-4862-bcce-bcff996371f9">
Apr 12 12:29:02 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 12:29:02 user nova-compute[71321]:         </nova:port>
Apr 12 12:29:02 user nova-compute[71321]:       </nova:ports>
Apr 12 12:29:02 user nova-compute[71321]:     </nova:instance>
Apr 12 12:29:02 user nova-compute[71321]:   </metadata>
Apr 12 12:29:02 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:29:02 user nova-compute[71321]:     <system>
Apr 12 12:29:02 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:29:02 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:29:02 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:29:02 user nova-compute[71321]:       <entry name="serial">79bee3fe-3300-4a28-b079-1bafaa1033c4</entry>
Apr 12 12:29:02 user nova-compute[71321]:       <entry name="uuid">79bee3fe-3300-4a28-b079-1bafaa1033c4</entry>
Apr 12 12:29:02 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:29:02 user nova-compute[71321]:     </system>
Apr 12 12:29:02 user nova-compute[71321]:   </sysinfo>
Apr 12 12:29:02 user nova-compute[71321]:   <os>
Apr 12 12:29:02 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:29:02 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:29:02 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:29:02 user nova-compute[71321]:   </os>
Apr 12 12:29:02 user nova-compute[71321]:   <features>
Apr 12 12:29:02 user nova-compute[71321]:     <acpi/>
Apr 12 12:29:02 user nova-compute[71321]:     <apic/>
Apr 12 12:29:02 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:29:02 user nova-compute[71321]:   </features>
Apr 12 12:29:02 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:29:02 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:29:02 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:29:02 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:29:02 user nova-compute[71321]:   </clock>
Apr 12 12:29:02 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:29:02 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:29:02 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:29:02 user nova-compute[71321]:   </cpu>
Apr 12 12:29:02 user nova-compute[71321]:   <devices>
Apr 12 12:29:02 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:29:02 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:29:02 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/disk"/>
Apr 12 12:29:02 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:29:02 user nova-compute[71321]:     </disk>
Apr 12 12:29:02 user nova-compute[71321]:     <disk type="file" device="cdrom">
Apr 12 12:29:02 user nova-compute[71321]:       <driver name="qemu" type="raw" cache="none"/>
Apr 12 12:29:02 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/disk.config"/>
Apr 12 12:29:02 user nova-compute[71321]:       <target dev="hda" bus="ide"/>
Apr 12 12:29:02 user nova-compute[71321]:     </disk>
Apr 12 12:29:02 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:29:02 user nova-compute[71321]:       <mac address="fa:16:3e:4a:27:fd"/>
Apr 12 12:29:02 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:29:02 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:29:02 user nova-compute[71321]:       <target dev="tap201eadd8-c7"/>
Apr 12 12:29:02 user nova-compute[71321]:     </interface>
Apr 12 12:29:02 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:29:02 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/console.log" append="off"/>
Apr 12 12:29:02 user nova-compute[71321]:     </serial>
Apr 12 12:29:02 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:29:02 user nova-compute[71321]:     <video>
Apr 12 12:29:02 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:29:02 user nova-compute[71321]:     </video>
Apr 12 12:29:02 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:29:02 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:29:02 user nova-compute[71321]:     </rng>
Apr 12 12:29:02 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:29:02 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:29:02 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:29:02 user nova-compute[71321]:     </memballoon>
Apr 12 12:29:02 user nova-compute[71321]:   </devices>
Apr 12 12:29:02 user nova-compute[71321]: </domain>
Apr 12 12:29:02 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:29:02 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:28:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-656063872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-656063872',id=8,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxGfNEhwxyml0RYHshQIBVlikZPUICMVOtWr1cX5kE9lM3qDUztZplY9zWTLExsTj4Jyt4GyZTZtlPvLt0Z2/a5v2pzKXPmtIr/OlOJ6S/2MsrCvF+uqljaJkNsq+Gqvw==',key_name='tempest-keypair-134546144',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0dd2a4a665514d0eb31653775b67356a',ramdisk_id='',reservation_id='r-u0qzq363',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1949865572',owner_user_name='tempest-TaggedAttachmentsTest-1949865572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:28:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ff191ffb9604795bab6ada1eafd41ff',uuid=79bee3fe-3300-4a28-b079-1bafaa1033c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "201eadd8-c760-4862-bcce-bcff996371f9", "address": "fa:16:3e:4a:27:fd", "network": {"id": "a751f1e2-998e-4446-b94e-4bab0dc80db7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-990400052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dd2a4a665514d0eb31653775b67356a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201eadd8-c7", "ovs_interfaceid": "201eadd8-c760-4862-bcce-bcff996371f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:29:02 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Converting VIF {"id": "201eadd8-c760-4862-bcce-bcff996371f9", "address": "fa:16:3e:4a:27:fd", "network": {"id": "a751f1e2-998e-4446-b94e-4bab0dc80db7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-990400052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dd2a4a665514d0eb31653775b67356a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201eadd8-c7", "ovs_interfaceid": "201eadd8-c760-4862-bcce-bcff996371f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:29:02 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:27:fd,bridge_name='br-int',has_traffic_filtering=True,id=201eadd8-c760-4862-bcce-bcff996371f9,network=Network(a751f1e2-998e-4446-b94e-4bab0dc80db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201eadd8-c7') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:29:02 user nova-compute[71321]: DEBUG os_vif [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:27:fd,bridge_name='br-int',has_traffic_filtering=True,id=201eadd8-c760-4862-bcce-bcff996371f9,network=Network(a751f1e2-998e-4446-b94e-4bab0dc80db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201eadd8-c7') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:29:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:29:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:29:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap201eadd8-c7, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:29:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap201eadd8-c7, col_values=(('external_ids', {'iface-id': '201eadd8-c760-4862-bcce-bcff996371f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:27:fd', 'vm-uuid': '79bee3fe-3300-4a28-b079-1bafaa1033c4'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:29:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:29:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:02 user nova-compute[71321]: INFO os_vif [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:27:fd,bridge_name='br-int',has_traffic_filtering=True,id=201eadd8-c760-4862-bcce-bcff996371f9,network=Network(a751f1e2-998e-4446-b94e-4bab0dc80db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201eadd8-c7')
Apr 12 12:29:02 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:29:02 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] No BDM found with device name hda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:29:02 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] No VIF found with MAC fa:16:3e:4a:27:fd, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:29:02 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Using config drive
Apr 12 12:29:02 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Creating config drive at /opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/disk.config
Apr 12 12:29:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpd4c3mh0x {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpd4c3mh0x" returned: 0 in 0.058s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:02 user nova-compute[71321]: DEBUG nova.compute.manager [req-3d8e2065-ea9b-4564-964c-6b7a70892642 req-aa76821d-7fb0-49a5-ac1f-de59fcc2d590 service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Received event network-changed-201eadd8-c760-4862-bcce-bcff996371f9 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:29:02 user nova-compute[71321]: DEBUG nova.compute.manager [req-3d8e2065-ea9b-4564-964c-6b7a70892642 req-aa76821d-7fb0-49a5-ac1f-de59fcc2d590 service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Refreshing instance network info cache due to event network-changed-201eadd8-c760-4862-bcce-bcff996371f9. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:29:02 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3d8e2065-ea9b-4564-964c-6b7a70892642 req-aa76821d-7fb0-49a5-ac1f-de59fcc2d590 service nova] Acquiring lock "refresh_cache-79bee3fe-3300-4a28-b079-1bafaa1033c4" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:29:02 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3d8e2065-ea9b-4564-964c-6b7a70892642 req-aa76821d-7fb0-49a5-ac1f-de59fcc2d590 service nova] Acquired lock "refresh_cache-79bee3fe-3300-4a28-b079-1bafaa1033c4" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:29:02 user nova-compute[71321]: DEBUG nova.network.neutron [req-3d8e2065-ea9b-4564-964c-6b7a70892642 req-aa76821d-7fb0-49a5-ac1f-de59fcc2d590 service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Refreshing network info cache for port 201eadd8-c760-4862-bcce-bcff996371f9 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:29:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:02 user nova-compute[71321]: DEBUG nova.compute.manager [req-967d7f1f-fc07-4418-b5a4-41898df00ae6 req-3adf0dd6-46b5-4651-960b-c300d4282c1e service nova] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Received event network-vif-plugged-7db9ebe7-8544-46eb-8d75-929d0422278f {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:29:02 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-967d7f1f-fc07-4418-b5a4-41898df00ae6 req-3adf0dd6-46b5-4651-960b-c300d4282c1e service nova] Acquiring lock "2f3ff25a-522c-431b-a177-85177401c7a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:02 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-967d7f1f-fc07-4418-b5a4-41898df00ae6 req-3adf0dd6-46b5-4651-960b-c300d4282c1e service nova] Lock "2f3ff25a-522c-431b-a177-85177401c7a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:02 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-967d7f1f-fc07-4418-b5a4-41898df00ae6 req-3adf0dd6-46b5-4651-960b-c300d4282c1e service nova] Lock "2f3ff25a-522c-431b-a177-85177401c7a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:02 user nova-compute[71321]: DEBUG nova.compute.manager [req-967d7f1f-fc07-4418-b5a4-41898df00ae6 req-3adf0dd6-46b5-4651-960b-c300d4282c1e service nova] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] No waiting events found dispatching network-vif-plugged-7db9ebe7-8544-46eb-8d75-929d0422278f {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:29:02 user nova-compute[71321]: WARNING nova.compute.manager [req-967d7f1f-fc07-4418-b5a4-41898df00ae6 req-3adf0dd6-46b5-4651-960b-c300d4282c1e service nova] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Received unexpected event network-vif-plugged-7db9ebe7-8544-46eb-8d75-929d0422278f for instance with vm_state building and task_state spawning.
Apr 12 12:29:03 user nova-compute[71321]: DEBUG nova.network.neutron [req-3d8e2065-ea9b-4564-964c-6b7a70892642 req-aa76821d-7fb0-49a5-ac1f-de59fcc2d590 service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Updated VIF entry in instance network info cache for port 201eadd8-c760-4862-bcce-bcff996371f9. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:29:03 user nova-compute[71321]: DEBUG nova.network.neutron [req-3d8e2065-ea9b-4564-964c-6b7a70892642 req-aa76821d-7fb0-49a5-ac1f-de59fcc2d590 service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Updating instance_info_cache with network_info: [{"id": "201eadd8-c760-4862-bcce-bcff996371f9", "address": "fa:16:3e:4a:27:fd", "network": {"id": "a751f1e2-998e-4446-b94e-4bab0dc80db7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-990400052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dd2a4a665514d0eb31653775b67356a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201eadd8-c7", "ovs_interfaceid": "201eadd8-c760-4862-bcce-bcff996371f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:29:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3d8e2065-ea9b-4564-964c-6b7a70892642 req-aa76821d-7fb0-49a5-ac1f-de59fcc2d590 service nova] Releasing lock "refresh_cache-79bee3fe-3300-4a28-b079-1bafaa1033c4" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:29:03 user nova-compute[71321]: DEBUG nova.compute.manager [req-3d8e2065-ea9b-4564-964c-6b7a70892642 req-aa76821d-7fb0-49a5-ac1f-de59fcc2d590 service nova] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Received event network-vif-plugged-69203d15-c034-4d74-915d-1fc13c89ee40 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:29:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3d8e2065-ea9b-4564-964c-6b7a70892642 req-aa76821d-7fb0-49a5-ac1f-de59fcc2d590 service nova] Acquiring lock "540a69c0-488f-40cb-bdde-3e410029d4c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3d8e2065-ea9b-4564-964c-6b7a70892642 req-aa76821d-7fb0-49a5-ac1f-de59fcc2d590 service nova] Lock "540a69c0-488f-40cb-bdde-3e410029d4c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3d8e2065-ea9b-4564-964c-6b7a70892642 req-aa76821d-7fb0-49a5-ac1f-de59fcc2d590 service nova] Lock "540a69c0-488f-40cb-bdde-3e410029d4c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:03 user nova-compute[71321]: DEBUG nova.compute.manager [req-3d8e2065-ea9b-4564-964c-6b7a70892642 req-aa76821d-7fb0-49a5-ac1f-de59fcc2d590 service nova] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] No waiting events found dispatching network-vif-plugged-69203d15-c034-4d74-915d-1fc13c89ee40 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:29:03 user nova-compute[71321]: WARNING nova.compute.manager [req-3d8e2065-ea9b-4564-964c-6b7a70892642 req-aa76821d-7fb0-49a5-ac1f-de59fcc2d590 service nova] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Received unexpected event network-vif-plugged-69203d15-c034-4d74-915d-1fc13c89ee40 for instance with vm_state building and task_state spawning.
Apr 12 12:29:03 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302543.3318646, 2f3ff25a-522c-431b-a177-85177401c7a9 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:29:03 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] VM Resumed (Lifecycle Event)
Apr 12 12:29:03 user nova-compute[71321]: DEBUG nova.compute.manager [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:29:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:29:03 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Instance spawned successfully.
Apr 12 12:29:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:29:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:29:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:29:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:29:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:29:03 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:29:03 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:29:03 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:29:03 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302543.3479812, 2f3ff25a-522c-431b-a177-85177401c7a9 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:29:03 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] VM Started (Lifecycle Event)
Apr 12 12:29:03 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:29:03 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:29:03 user nova-compute[71321]: INFO nova.compute.manager [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Took 8.71 seconds to spawn the instance on the hypervisor.
Apr 12 12:29:03 user nova-compute[71321]: DEBUG nova.compute.manager [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:29:03 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:29:03 user nova-compute[71321]: DEBUG nova.compute.manager [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:29:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:29:03 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302543.4952898, 540a69c0-488f-40cb-bdde-3e410029d4c8 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:29:03 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] VM Resumed (Lifecycle Event)
Apr 12 12:29:03 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:29:03 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Instance spawned successfully.
Apr 12 12:29:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:29:03 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:29:03 user nova-compute[71321]: INFO nova.compute.manager [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Took 9.76 seconds to build instance.
Apr 12 12:29:03 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:29:03 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302543.5003474, 540a69c0-488f-40cb-bdde-3e410029d4c8 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:29:03 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] VM Started (Lifecycle Event)
Apr 12 12:29:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:29:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:29:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:29:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:29:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:29:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:29:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "2f3ff25a-522c-431b-a177-85177401c7a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.005s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:03 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:29:03 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:29:03 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:29:03 user nova-compute[71321]: INFO nova.compute.manager [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Took 9.53 seconds to spawn the instance on the hypervisor.
Apr 12 12:29:03 user nova-compute[71321]: DEBUG nova.compute.manager [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:29:03 user nova-compute[71321]: INFO nova.compute.manager [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Took 10.59 seconds to build instance.
Apr 12 12:29:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "540a69c0-488f-40cb-bdde-3e410029d4c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.720s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:04 user nova-compute[71321]: DEBUG nova.compute.manager [req-62eb13e7-2cb6-4229-8f20-75a79188a15a req-2428fd42-0014-42d7-95a7-221255f78495 service nova] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Received event network-vif-plugged-7db9ebe7-8544-46eb-8d75-929d0422278f {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:29:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-62eb13e7-2cb6-4229-8f20-75a79188a15a req-2428fd42-0014-42d7-95a7-221255f78495 service nova] Acquiring lock "2f3ff25a-522c-431b-a177-85177401c7a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-62eb13e7-2cb6-4229-8f20-75a79188a15a req-2428fd42-0014-42d7-95a7-221255f78495 service nova] Lock "2f3ff25a-522c-431b-a177-85177401c7a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-62eb13e7-2cb6-4229-8f20-75a79188a15a req-2428fd42-0014-42d7-95a7-221255f78495 service nova] Lock "2f3ff25a-522c-431b-a177-85177401c7a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:04 user nova-compute[71321]: DEBUG nova.compute.manager [req-62eb13e7-2cb6-4229-8f20-75a79188a15a req-2428fd42-0014-42d7-95a7-221255f78495 service nova] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] No waiting events found dispatching network-vif-plugged-7db9ebe7-8544-46eb-8d75-929d0422278f {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:29:04 user nova-compute[71321]: WARNING nova.compute.manager [req-62eb13e7-2cb6-4229-8f20-75a79188a15a req-2428fd42-0014-42d7-95a7-221255f78495 service nova] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Received unexpected event network-vif-plugged-7db9ebe7-8544-46eb-8d75-929d0422278f for instance with vm_state active and task_state None.
Apr 12 12:29:04 user nova-compute[71321]: DEBUG nova.compute.manager [req-62eb13e7-2cb6-4229-8f20-75a79188a15a req-2428fd42-0014-42d7-95a7-221255f78495 service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Received event network-vif-plugged-201eadd8-c760-4862-bcce-bcff996371f9 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:29:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-62eb13e7-2cb6-4229-8f20-75a79188a15a req-2428fd42-0014-42d7-95a7-221255f78495 service nova] Acquiring lock "79bee3fe-3300-4a28-b079-1bafaa1033c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-62eb13e7-2cb6-4229-8f20-75a79188a15a req-2428fd42-0014-42d7-95a7-221255f78495 service nova] Lock "79bee3fe-3300-4a28-b079-1bafaa1033c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-62eb13e7-2cb6-4229-8f20-75a79188a15a req-2428fd42-0014-42d7-95a7-221255f78495 service nova] Lock "79bee3fe-3300-4a28-b079-1bafaa1033c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:04 user nova-compute[71321]: DEBUG nova.compute.manager [req-62eb13e7-2cb6-4229-8f20-75a79188a15a req-2428fd42-0014-42d7-95a7-221255f78495 service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] No waiting events found dispatching network-vif-plugged-201eadd8-c760-4862-bcce-bcff996371f9 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:29:04 user nova-compute[71321]: WARNING nova.compute.manager [req-62eb13e7-2cb6-4229-8f20-75a79188a15a req-2428fd42-0014-42d7-95a7-221255f78495 service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Received unexpected event network-vif-plugged-201eadd8-c760-4862-bcce-bcff996371f9 for instance with vm_state building and task_state spawning.
Apr 12 12:29:04 user nova-compute[71321]: DEBUG nova.compute.manager [req-62eb13e7-2cb6-4229-8f20-75a79188a15a req-2428fd42-0014-42d7-95a7-221255f78495 service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Received event network-vif-plugged-201eadd8-c760-4862-bcce-bcff996371f9 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:29:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-62eb13e7-2cb6-4229-8f20-75a79188a15a req-2428fd42-0014-42d7-95a7-221255f78495 service nova] Acquiring lock "79bee3fe-3300-4a28-b079-1bafaa1033c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-62eb13e7-2cb6-4229-8f20-75a79188a15a req-2428fd42-0014-42d7-95a7-221255f78495 service nova] Lock "79bee3fe-3300-4a28-b079-1bafaa1033c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-62eb13e7-2cb6-4229-8f20-75a79188a15a req-2428fd42-0014-42d7-95a7-221255f78495 service nova] Lock "79bee3fe-3300-4a28-b079-1bafaa1033c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:04 user nova-compute[71321]: DEBUG nova.compute.manager [req-62eb13e7-2cb6-4229-8f20-75a79188a15a req-2428fd42-0014-42d7-95a7-221255f78495 service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] No waiting events found dispatching network-vif-plugged-201eadd8-c760-4862-bcce-bcff996371f9 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:29:04 user nova-compute[71321]: WARNING nova.compute.manager [req-62eb13e7-2cb6-4229-8f20-75a79188a15a req-2428fd42-0014-42d7-95a7-221255f78495 service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Received unexpected event network-vif-plugged-201eadd8-c760-4862-bcce-bcff996371f9 for instance with vm_state building and task_state spawning.
Apr 12 12:29:06 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302546.7724376, 79bee3fe-3300-4a28-b079-1bafaa1033c4 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:29:06 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] VM Resumed (Lifecycle Event)
Apr 12 12:29:06 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:29:06 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:29:06 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Instance spawned successfully.
Apr 12 12:29:06 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:29:06 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:29:06 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:29:06 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:29:06 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:29:06 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:29:06 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:29:06 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:29:06 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:29:06 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:29:06 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302546.7800727, 79bee3fe-3300-4a28-b079-1bafaa1033c4 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:29:06 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] VM Started (Lifecycle Event)
Apr 12 12:29:06 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:29:06 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:29:06 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:29:06 user nova-compute[71321]: INFO nova.compute.manager [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Took 9.88 seconds to spawn the instance on the hypervisor.
Apr 12 12:29:06 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:29:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:07 user nova-compute[71321]: INFO nova.compute.manager [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Took 11.01 seconds to build instance.
Apr 12 12:29:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "79bee3fe-3300-4a28-b079-1bafaa1033c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.193s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:08 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:29:08 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Cleaning up deleted instances {{(pid=71321) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 12:29:08 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] There are 0 instances to clean {{(pid=71321) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 12:29:08 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:29:08 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71321) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 12:29:08 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:29:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:09 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:29:09 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:29:09 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Rebuilding the list of instances to heal {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 12:29:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-10116da0-785c-41cf-96bb-95721af863db" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:29:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-10116da0-785c-41cf-96bb-95721af863db" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:29:09 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 12:29:09 user nova-compute[71321]: DEBUG nova.objects.instance [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lazy-loading 'info_cache' on Instance uuid 10116da0-785c-41cf-96bb-95721af863db {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:29:10 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] Updating instance_info_cache with network_info: [{"id": "cbb69638-6a5f-4d12-8737-45850145fa0e", "address": "fa:16:3e:57:7c:99", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb69638-6a", "ovs_interfaceid": "cbb69638-6a5f-4d12-8737-45850145fa0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:29:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-10116da0-785c-41cf-96bb-95721af863db" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:29:10 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 12:29:10 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:29:10 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:29:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:10 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:29:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f3ff25a-522c-431b-a177-85177401c7a9/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f3ff25a-522c-431b-a177-85177401c7a9/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f3ff25a-522c-431b-a177-85177401c7a9/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f3ff25a-522c-431b-a177-85177401c7a9/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:12 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "64589bd5-2688-4224-ba3e-8a26f9ffafaf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "64589bd5-2688-4224-ba3e-8a26f9ffafaf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:12 user nova-compute[71321]: DEBUG nova.compute.manager [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:29:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:12 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:29:12 user nova-compute[71321]: INFO nova.compute.claims [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Claim successful on node user
Apr 12 12:29:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a69c0-488f-40cb-bdde-3e410029d4c8/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a69c0-488f-40cb-bdde-3e410029d4c8/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a69c0-488f-40cb-bdde-3e410029d4c8/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a69c0-488f-40cb-bdde-3e410029d4c8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:13 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:13 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:13 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:29:13 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:29:13 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:13 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.074s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:13 user nova-compute[71321]: DEBUG nova.compute.manager [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:29:13 user nova-compute[71321]: DEBUG nova.compute.manager [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:29:13 user nova-compute[71321]: DEBUG nova.network.neutron [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:29:13 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:29:13 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:13 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:13 user nova-compute[71321]: DEBUG nova.compute.manager [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:29:13 user nova-compute[71321]: INFO nova.virt.block_device [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Booting with volume snapshot 407eecd9-4bb0-4a47-9111-1ee218d6272c at /dev/vda
Apr 12 12:29:13 user nova-compute[71321]: DEBUG nova.policy [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '076e65b43f664765ad1d48be6e814f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ada441da2124adda751365952320e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:29:13 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:13 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a054fbb-bfb4-40fa-8a03-a0c201df6857/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a054fbb-bfb4-40fa-8a03-a0c201df6857/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a054fbb-bfb4-40fa-8a03-a0c201df6857/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a054fbb-bfb4-40fa-8a03-a0c201df6857/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:14 user nova-compute[71321]: DEBUG nova.network.neutron [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Successfully created port: a3d4da82-f4ab-410c-8692-f14de0e43ef5 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:29:14 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:29:14 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:29:14 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=7761MB free_disk=26.70809555053711GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:29:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.003s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:15 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 2f3ff25a-522c-431b-a177-85177401c7a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:29:15 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:29:15 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 839e85a2-f7af-482d-a5e6-09195888300e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:29:15 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 64589bd5-2688-4224-ba3e-8a26f9ffafaf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:29:15 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 5a054fbb-bfb4-40fa-8a03-a0c201df6857 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:29:15 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:29:15 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 540a69c0-488f-40cb-bdde-3e410029d4c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:29:15 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 10116da0-785c-41cf-96bb-95721af863db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:29:15 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance a4107f2d-88e4-4846-9ece-cb16ad7ecd02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:29:15 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:29:15 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:29:15 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:29:15 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:29:15 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:29:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.749s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:15 user nova-compute[71321]: DEBUG nova.network.neutron [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Successfully updated port: a3d4da82-f4ab-410c-8692-f14de0e43ef5 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:29:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "refresh_cache-64589bd5-2688-4224-ba3e-8a26f9ffafaf" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:29:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquired lock "refresh_cache-64589bd5-2688-4224-ba3e-8a26f9ffafaf" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:29:15 user nova-compute[71321]: DEBUG nova.network.neutron [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:29:15 user nova-compute[71321]: DEBUG nova.compute.manager [req-02336c52-d31c-4579-ba63-1425a52e03f2 req-d91e85f1-3cf5-412c-a9f3-112fc2951074 service nova] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Received event network-changed-a3d4da82-f4ab-410c-8692-f14de0e43ef5 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:29:15 user nova-compute[71321]: DEBUG nova.compute.manager [req-02336c52-d31c-4579-ba63-1425a52e03f2 req-d91e85f1-3cf5-412c-a9f3-112fc2951074 service nova] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Refreshing instance network info cache due to event network-changed-a3d4da82-f4ab-410c-8692-f14de0e43ef5. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:29:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-02336c52-d31c-4579-ba63-1425a52e03f2 req-d91e85f1-3cf5-412c-a9f3-112fc2951074 service nova] Acquiring lock "refresh_cache-64589bd5-2688-4224-ba3e-8a26f9ffafaf" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:29:15 user nova-compute[71321]: DEBUG nova.network.neutron [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:29:16 user nova-compute[71321]: DEBUG nova.network.neutron [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Updating instance_info_cache with network_info: [{"id": "a3d4da82-f4ab-410c-8692-f14de0e43ef5", "address": "fa:16:3e:cc:ba:ed", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3d4da82-f4", "ovs_interfaceid": "a3d4da82-f4ab-410c-8692-f14de0e43ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:29:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Releasing lock "refresh_cache-64589bd5-2688-4224-ba3e-8a26f9ffafaf" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:29:16 user nova-compute[71321]: DEBUG nova.compute.manager [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Instance network_info: |[{"id": "a3d4da82-f4ab-410c-8692-f14de0e43ef5", "address": "fa:16:3e:cc:ba:ed", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3d4da82-f4", "ovs_interfaceid": "a3d4da82-f4ab-410c-8692-f14de0e43ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:29:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-02336c52-d31c-4579-ba63-1425a52e03f2 req-d91e85f1-3cf5-412c-a9f3-112fc2951074 service nova] Acquired lock "refresh_cache-64589bd5-2688-4224-ba3e-8a26f9ffafaf" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:29:16 user nova-compute[71321]: DEBUG nova.network.neutron [req-02336c52-d31c-4579-ba63-1425a52e03f2 req-d91e85f1-3cf5-412c-a9f3-112fc2951074 service nova] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Refreshing network info cache for port a3d4da82-f4ab-410c-8692-f14de0e43ef5 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:29:16 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:29:16 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:29:16 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:29:16 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:29:16 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:29:16 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:29:16 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:29:16 user nova-compute[71321]: DEBUG nova.network.neutron [req-02336c52-d31c-4579-ba63-1425a52e03f2 req-d91e85f1-3cf5-412c-a9f3-112fc2951074 service nova] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Updated VIF entry in instance network info cache for port a3d4da82-f4ab-410c-8692-f14de0e43ef5. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:29:16 user nova-compute[71321]: DEBUG nova.network.neutron [req-02336c52-d31c-4579-ba63-1425a52e03f2 req-d91e85f1-3cf5-412c-a9f3-112fc2951074 service nova] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Updating instance_info_cache with network_info: [{"id": "a3d4da82-f4ab-410c-8692-f14de0e43ef5", "address": "fa:16:3e:cc:ba:ed", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3d4da82-f4", "ovs_interfaceid": "a3d4da82-f4ab-410c-8692-f14de0e43ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:29:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-02336c52-d31c-4579-ba63-1425a52e03f2 req-d91e85f1-3cf5-412c-a9f3-112fc2951074 service nova] Releasing lock "refresh_cache-64589bd5-2688-4224-ba3e-8a26f9ffafaf" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:29:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:20 user nova-compute[71321]: DEBUG os_brick.utils [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:29:20 user nova-compute[71321]: INFO oslo.privsep.daemon [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpeie8kgk8/privsep.sock']
Apr 12 12:29:20 user sudo[81733]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpeie8kgk8/privsep.sock
Apr 12 12:29:20 user sudo[81733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 12:29:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:22 user sudo[81733]: pam_unix(sudo:session): session closed for user root
Apr 12 12:29:22 user nova-compute[71321]: INFO oslo.privsep.daemon [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Spawned new privsep daemon via rootwrap
Apr 12 12:29:22 user nova-compute[71321]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 12 12:29:22 user nova-compute[71321]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 12 12:29:22 user nova-compute[71321]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 12 12:29:22 user nova-compute[71321]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81736
Apr 12 12:29:22 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4961aa53-f622-4873-aa64-43330b323561]: (2,) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:22 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ef87a0-0981-49c8-98bf-4f2828a8390d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:22 user nova-compute[71321]: WARNING os_brick.initiator.connectors.nvmeof [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 12 12:29:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:22 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1483ec8b-54fe-4fa7-8dba-5165b43e83a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:22 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83a7e95-4af1-4af9-a399-bccc80d37d7b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:22 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[5144d1a3-0d49-4504-b799-299dbb2449e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:29:22 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:29:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:29:22 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:29:22 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb1e831-fd3c-4fe5-819a-d0dc5dbdd711]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:22 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:29:22 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:29:22 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:29:22 user nova-compute[71321]: DEBUG os_brick.utils [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] <== get_connector_properties: return (2146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:29:22 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Updating existing volume attachment record: d6c491c2-6de1-4b14-a76c-bd9b13137b8a {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:29:24 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "d8867363-6e36-4b34-9cc1-f30fbc572720" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:25 user nova-compute[71321]: DEBUG nova.compute.manager [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:29:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:25 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:29:25 user nova-compute[71321]: INFO nova.compute.claims [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Claim successful on node user
Apr 12 12:29:25 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Refreshing inventories for resource provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 12:29:25 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Updating ProviderTree inventory for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 12:29:25 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Updating inventory in ProviderTree for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 12:29:26 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Refreshing aggregate associations for resource provider 7ca624fd-d5cc-42af-93e3-9d62256fa231, aggregates: None {{(pid=71321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 12:29:26 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Refreshing trait associations for resource provider 7ca624fd-d5cc-42af-93e3-9d62256fa231, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=71321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 12:29:26 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:29:26 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:29:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.895s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:26 user nova-compute[71321]: DEBUG nova.compute.manager [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:29:26 user nova-compute[71321]: DEBUG nova.compute.manager [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:29:26 user nova-compute[71321]: DEBUG nova.network.neutron [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:29:26 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:29:26 user nova-compute[71321]: DEBUG nova.compute.manager [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:29:26 user nova-compute[71321]: INFO nova.virt.block_device [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Booting with volume 79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc at /dev/vda
Apr 12 12:29:27 user nova-compute[71321]: DEBUG nova.policy [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b1cf68007f18458b9824e056151f5c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed98064a134b4603bbf641f45988564a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG os_brick.utils [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c7870d-5ed0-42d2-985d-2240e0422fc6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7c7408-3267-4c30-b7f4-072cfca32f49]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7c8a67-23d2-41f9-903f-a135d8cdb49f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[5011a002-b2f6-416a-b906-5e898d0b761f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:29:27 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:29:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbc98f9-4739-40cd-819c-9923975cb96b]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG os_brick.utils [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Updating existing volume attachment record: 32d8ee48-03d9-43e9-aba9-f863e8f8bb7d {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG nova.network.neutron [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Successfully created port: 93bb6ab6-63a2-421a-b331-92c957f29f5a {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG nova.compute.manager [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:29:27 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Creating image(s)
Apr 12 12:29:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Did not create local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Ensure instance console log exists: /opt/stack/data/nova/instances/64589bd5-2688-4224-ba3e-8a26f9ffafaf/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Start _get_guest_xml network_info=[{"id": "a3d4da82-f4ab-410c-8692-f14de0e43ef5", "address": "fa:16:3e:cc:ba:ed", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3d4da82-f4", "ovs_interfaceid": "a3d4da82-f4ab-410c-8692-f14de0e43ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd6c491c2-6de1-4b14-a76c-bd9b13137b8a', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aESPGokd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '64589bd5-2688-4224-ba3e-8a26f9ffafaf', 'attached_at': '', 'detached_at': '', 'volume_id': 'ad0cabc7-491c-473d-9798-463099b67dd3', 'serial': 'ad0cabc7-491c-473d-9798-463099b67dd3'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:29:27 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:29:27 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:29:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG os_brick.initiator.connector [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Factory for ISCSI on None {{(pid=71321) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aESPGokd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:29:27 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:29:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:29:27 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:29:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:29:27 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:29:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f1c0d6-feec-452c-986e-fb44d88e8799]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:29:27 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:29:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0beb266a-405b-4126-a47e-98688cd1f022]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3] added
Apr 12 12:29:28 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[85dd8d7a-8cf4-45fe-b87e-878b518f2922]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[308c4bc2-ee58-4b15-953d-8739a2e3650a]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aESPGokd {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aESPGokd" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcef3d77-7af1-45f5-90d3-4c68abb87823]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aESPGokd'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[917baed7-af27-4bd3-993e-c2af89f40044]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a1483c-2e94-4572-961a-4df747e487cf]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 12:29:28 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 12:29:28 user nova-compute[71321]:  {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:29:28 user nova-compute[71321]: WARNING os_brick.initiator.connectors.iscsi [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 12:29:28 user nova-compute[71321]: 
Apr 12 12:29:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95656cd-bb27-44b5-806b-7929d4af8bd5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3, portal: 172.16.0.220,3260]
Apr 12 12:29:28 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3, portal: 172.16.0.220,3260] successful.
Apr 12 12:29:28 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4c6c6c-a659-4247-bb67-f196c32cb218]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7c388d-b350-4b55-8d6c-eff4f85bc594]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:29:28 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:29:28 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6473654-339c-47a8-85fb-64759dd5c851]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aESPGokd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:29:28 user nova-compute[71321]: DEBUG nova.network.neutron [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Successfully created port: 389d5d9e-e5fc-48f1-b443-b04d08ec6181 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:29:29 user nova-compute[71321]: DEBUG nova.network.neutron [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Successfully created port: bf6a7707-9d55-46b2-8738-06505013048b {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:29:29 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:29:29 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26466656261643034', 'path': '/dev/sdb'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:29:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466656261643034', 'path': '/dev/sdb'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:29:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1737375268',display_name='tempest-TestVolumeBootPattern-server-1737375268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1737375268',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ada441da2124adda751365952320e81',ramdisk_id='',reservation_id='r-9xhpm4s8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-310589135',owner_user_name='tempest-TestVolumeBootPattern-310589135-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:29:14Z,user_data=None,user_id='076e65b43f664765ad1d48be6e814f40',uuid=64589bd5-2688-4224-ba3e-8a26f9ffafaf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3d4da82-f4ab-410c-8692-f14de0e43ef5", "address": "fa:16:3e:cc:ba:ed", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3d4da82-f4", "ovs_interfaceid": "a3d4da82-f4ab-410c-8692-f14de0e43ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:29:29 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converting VIF {"id": "a3d4da82-f4ab-410c-8692-f14de0e43ef5", "address": "fa:16:3e:cc:ba:ed", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3d4da82-f4", "ovs_interfaceid": "a3d4da82-f4ab-410c-8692-f14de0e43ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:29:29 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:ba:ed,bridge_name='br-int',has_traffic_filtering=True,id=a3d4da82-f4ab-410c-8692-f14de0e43ef5,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3d4da82-f4') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:29:29 user nova-compute[71321]: DEBUG nova.objects.instance [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lazy-loading 'pci_devices' on Instance uuid 64589bd5-2688-4224-ba3e-8a26f9ffafaf {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:29:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:29:29 user nova-compute[71321]:   <uuid>64589bd5-2688-4224-ba3e-8a26f9ffafaf</uuid>
Apr 12 12:29:29 user nova-compute[71321]:   <name>instance-00000009</name>
Apr 12 12:29:29 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:29:29 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:29:29 user nova-compute[71321]:   <metadata>
Apr 12 12:29:29 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:29:29 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:29:29 user nova-compute[71321]:       <nova:name>tempest-TestVolumeBootPattern-server-1737375268</nova:name>
Apr 12 12:29:29 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:29:27</nova:creationTime>
Apr 12 12:29:29 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:29:29 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:29:29 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:29:29 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:29:29 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:29:29 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:29:29 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:29:29 user nova-compute[71321]:       <nova:owner>
Apr 12 12:29:29 user nova-compute[71321]:         <nova:user uuid="076e65b43f664765ad1d48be6e814f40">tempest-TestVolumeBootPattern-310589135-project-member</nova:user>
Apr 12 12:29:29 user nova-compute[71321]:         <nova:project uuid="5ada441da2124adda751365952320e81">tempest-TestVolumeBootPattern-310589135</nova:project>
Apr 12 12:29:29 user nova-compute[71321]:       </nova:owner>
Apr 12 12:29:29 user nova-compute[71321]:       <nova:ports>
Apr 12 12:29:29 user nova-compute[71321]:         <nova:port uuid="a3d4da82-f4ab-410c-8692-f14de0e43ef5">
Apr 12 12:29:29 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 12:29:29 user nova-compute[71321]:         </nova:port>
Apr 12 12:29:29 user nova-compute[71321]:       </nova:ports>
Apr 12 12:29:29 user nova-compute[71321]:     </nova:instance>
Apr 12 12:29:29 user nova-compute[71321]:   </metadata>
Apr 12 12:29:29 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:29:29 user nova-compute[71321]:     <system>
Apr 12 12:29:29 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:29:29 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:29:29 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:29:29 user nova-compute[71321]:       <entry name="serial">64589bd5-2688-4224-ba3e-8a26f9ffafaf</entry>
Apr 12 12:29:29 user nova-compute[71321]:       <entry name="uuid">64589bd5-2688-4224-ba3e-8a26f9ffafaf</entry>
Apr 12 12:29:29 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:29:29 user nova-compute[71321]:     </system>
Apr 12 12:29:29 user nova-compute[71321]:   </sysinfo>
Apr 12 12:29:29 user nova-compute[71321]:   <os>
Apr 12 12:29:29 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:29:29 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:29:29 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:29:29 user nova-compute[71321]:   </os>
Apr 12 12:29:29 user nova-compute[71321]:   <features>
Apr 12 12:29:29 user nova-compute[71321]:     <acpi/>
Apr 12 12:29:29 user nova-compute[71321]:     <apic/>
Apr 12 12:29:29 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:29:29 user nova-compute[71321]:   </features>
Apr 12 12:29:29 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:29:29 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:29:29 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:29:29 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:29:29 user nova-compute[71321]:   </clock>
Apr 12 12:29:29 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:29:29 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:29:29 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:29:29 user nova-compute[71321]:   </cpu>
Apr 12 12:29:29 user nova-compute[71321]:   <devices>
Apr 12 12:29:29 user nova-compute[71321]:     <disk type="block" device="disk">
Apr 12 12:29:29 user nova-compute[71321]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:29:29 user nova-compute[71321]:       <source dev="/dev/sdb"/>
Apr 12 12:29:29 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:29:29 user nova-compute[71321]:       <serial>ad0cabc7-491c-473d-9798-463099b67dd3</serial>
Apr 12 12:29:29 user nova-compute[71321]:     </disk>
Apr 12 12:29:29 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:29:29 user nova-compute[71321]:       <mac address="fa:16:3e:cc:ba:ed"/>
Apr 12 12:29:29 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:29:29 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:29:29 user nova-compute[71321]:       <target dev="tapa3d4da82-f4"/>
Apr 12 12:29:29 user nova-compute[71321]:     </interface>
Apr 12 12:29:29 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:29:29 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/64589bd5-2688-4224-ba3e-8a26f9ffafaf/console.log" append="off"/>
Apr 12 12:29:29 user nova-compute[71321]:     </serial>
Apr 12 12:29:29 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:29:29 user nova-compute[71321]:     <video>
Apr 12 12:29:29 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:29:29 user nova-compute[71321]:     </video>
Apr 12 12:29:29 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:29:29 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:29:29 user nova-compute[71321]:     </rng>
Apr 12 12:29:29 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:29:29 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:29:29 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:29:29 user nova-compute[71321]:     </memballoon>
Apr 12 12:29:29 user nova-compute[71321]:   </devices>
Apr 12 12:29:29 user nova-compute[71321]: </domain>
Apr 12 12:29:29 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:29:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1737375268',display_name='tempest-TestVolumeBootPattern-server-1737375268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1737375268',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ada441da2124adda751365952320e81',ramdisk_id='',reservation_id='r-9xhpm4s8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-310589135',owner_user_name='tempest-TestVolumeBootPattern-310589135-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:29:14Z,user_data=None,user_id='076e65b43f664765ad1d48be6e814f40',uuid=64589bd5-2688-4224-ba3e-8a26f9ffafaf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3d4da82-f4ab-410c-8692-f14de0e43ef5", "address": "fa:16:3e:cc:ba:ed", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3d4da82-f4", "ovs_interfaceid": "a3d4da82-f4ab-410c-8692-f14de0e43ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:29:29 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converting VIF {"id": "a3d4da82-f4ab-410c-8692-f14de0e43ef5", "address": "fa:16:3e:cc:ba:ed", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3d4da82-f4", "ovs_interfaceid": "a3d4da82-f4ab-410c-8692-f14de0e43ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:29:29 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:ba:ed,bridge_name='br-int',has_traffic_filtering=True,id=a3d4da82-f4ab-410c-8692-f14de0e43ef5,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3d4da82-f4') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:29:29 user nova-compute[71321]: DEBUG os_vif [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:ba:ed,bridge_name='br-int',has_traffic_filtering=True,id=a3d4da82-f4ab-410c-8692-f14de0e43ef5,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3d4da82-f4') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:29:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:29:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:29:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3d4da82-f4, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:29:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa3d4da82-f4, col_values=(('external_ids', {'iface-id': 'a3d4da82-f4ab-410c-8692-f14de0e43ef5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:ba:ed', 'vm-uuid': '64589bd5-2688-4224-ba3e-8a26f9ffafaf'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:29:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:29:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:29 user nova-compute[71321]: INFO os_vif [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:ba:ed,bridge_name='br-int',has_traffic_filtering=True,id=a3d4da82-f4ab-410c-8692-f14de0e43ef5,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3d4da82-f4')
Apr 12 12:29:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:29:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] No VIF found with MAC fa:16:3e:cc:ba:ed, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:29:30 user nova-compute[71321]: DEBUG nova.network.neutron [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Successfully created port: e9757213-2bc0-46a5-bffa-3b503c65ecc2 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:29:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:30 user nova-compute[71321]: DEBUG nova.network.neutron [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Successfully created port: 6f2ec393-bb3c-4986-bd50-44ae9a7147b0 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:29:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:30 user nova-compute[71321]: DEBUG nova.compute.manager [req-9076ad82-a8ad-47bb-a103-439da6157023 req-b5793798-ea9f-4d27-97ba-5968a450aac0 service nova] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Received event network-vif-plugged-a3d4da82-f4ab-410c-8692-f14de0e43ef5 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:29:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9076ad82-a8ad-47bb-a103-439da6157023 req-b5793798-ea9f-4d27-97ba-5968a450aac0 service nova] Acquiring lock "64589bd5-2688-4224-ba3e-8a26f9ffafaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9076ad82-a8ad-47bb-a103-439da6157023 req-b5793798-ea9f-4d27-97ba-5968a450aac0 service nova] Lock "64589bd5-2688-4224-ba3e-8a26f9ffafaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9076ad82-a8ad-47bb-a103-439da6157023 req-b5793798-ea9f-4d27-97ba-5968a450aac0 service nova] Lock "64589bd5-2688-4224-ba3e-8a26f9ffafaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:30 user nova-compute[71321]: DEBUG nova.compute.manager [req-9076ad82-a8ad-47bb-a103-439da6157023 req-b5793798-ea9f-4d27-97ba-5968a450aac0 service nova] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] No waiting events found dispatching network-vif-plugged-a3d4da82-f4ab-410c-8692-f14de0e43ef5 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:29:30 user nova-compute[71321]: WARNING nova.compute.manager [req-9076ad82-a8ad-47bb-a103-439da6157023 req-b5793798-ea9f-4d27-97ba-5968a450aac0 service nova] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Received unexpected event network-vif-plugged-a3d4da82-f4ab-410c-8692-f14de0e43ef5 for instance with vm_state building and task_state spawning.
Apr 12 12:29:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG nova.network.neutron [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Successfully updated port: 93bb6ab6-63a2-421a-b331-92c957f29f5a {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:29:32 user nova-compute[71321]: INFO nova.virt.block_device [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Booting with volume b0cc7840-90f7-4311-8c15-78c644bad569 at /dev/vdb
Apr 12 12:29:32 user nova-compute[71321]: DEBUG nova.compute.manager [req-6e561dcb-b8fe-4c89-b4d2-59d9f870f115 req-efc5151e-baba-42b3-a2f0-ccf8a6008e18 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-changed-93bb6ab6-63a2-421a-b331-92c957f29f5a {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG nova.compute.manager [req-6e561dcb-b8fe-4c89-b4d2-59d9f870f115 req-efc5151e-baba-42b3-a2f0-ccf8a6008e18 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Refreshing instance network info cache due to event network-changed-93bb6ab6-63a2-421a-b331-92c957f29f5a. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-6e561dcb-b8fe-4c89-b4d2-59d9f870f115 req-efc5151e-baba-42b3-a2f0-ccf8a6008e18 service nova] Acquiring lock "refresh_cache-d8867363-6e36-4b34-9cc1-f30fbc572720" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-6e561dcb-b8fe-4c89-b4d2-59d9f870f115 req-efc5151e-baba-42b3-a2f0-ccf8a6008e18 service nova] Acquired lock "refresh_cache-d8867363-6e36-4b34-9cc1-f30fbc572720" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG nova.network.neutron [req-6e561dcb-b8fe-4c89-b4d2-59d9f870f115 req-efc5151e-baba-42b3-a2f0-ccf8a6008e18 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Refreshing network info cache for port 93bb6ab6-63a2-421a-b331-92c957f29f5a {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG os_brick.utils [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa6ef0b-4715-4c1e-801f-3b8e25ba9762]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32a177e-5a41-4101-9bca-3804b565eb47]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc52f780-05fb-4329-8789-d3bab168e8d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b0b878-78b3-4d96-8968-2965d166233d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG nova.network.neutron [req-6e561dcb-b8fe-4c89-b4d2-59d9f870f115 req-efc5151e-baba-42b3-a2f0-ccf8a6008e18 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:29:32 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:29:32 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d361778-ea89-406e-a54d-240e1b1de47f]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG os_brick.utils [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Updating existing volume attachment record: 3f496d3d-1760-4dcf-93cf-2c51c4ca1e79 {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "651d5c05-2d02-450f-a33c-fbd9b3109016" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "651d5c05-2d02-450f-a33c-fbd9b3109016" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:29:32 user nova-compute[71321]: INFO nova.compute.claims [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Claim successful on node user
Apr 12 12:29:32 user nova-compute[71321]: DEBUG nova.network.neutron [req-6e561dcb-b8fe-4c89-b4d2-59d9f870f115 req-efc5151e-baba-42b3-a2f0-ccf8a6008e18 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-6e561dcb-b8fe-4c89-b4d2-59d9f870f115 req-efc5151e-baba-42b3-a2f0-ccf8a6008e18 service nova] Releasing lock "refresh_cache-d8867363-6e36-4b34-9cc1-f30fbc572720" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302572.9285138, 64589bd5-2688-4224-ba3e-8a26f9ffafaf => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:29:32 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] VM Resumed (Lifecycle Event)
Apr 12 12:29:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:29:32 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Instance spawned successfully.
Apr 12 12:29:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:29:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:29:32 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:29:32 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302572.9287188, 64589bd5-2688-4224-ba3e-8a26f9ffafaf => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:29:32 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] VM Started (Lifecycle Event)
Apr 12 12:29:33 user nova-compute[71321]: DEBUG nova.compute.manager [req-fca90ae1-59de-4149-9d83-fa08f68248cc req-e6980fe4-b0e8-4ab3-941b-33e0f85eca0d service nova] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Received event network-vif-plugged-a3d4da82-f4ab-410c-8692-f14de0e43ef5 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:29:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-fca90ae1-59de-4149-9d83-fa08f68248cc req-e6980fe4-b0e8-4ab3-941b-33e0f85eca0d service nova] Acquiring lock "64589bd5-2688-4224-ba3e-8a26f9ffafaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-fca90ae1-59de-4149-9d83-fa08f68248cc req-e6980fe4-b0e8-4ab3-941b-33e0f85eca0d service nova] Lock "64589bd5-2688-4224-ba3e-8a26f9ffafaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-fca90ae1-59de-4149-9d83-fa08f68248cc req-e6980fe4-b0e8-4ab3-941b-33e0f85eca0d service nova] Lock "64589bd5-2688-4224-ba3e-8a26f9ffafaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:33 user nova-compute[71321]: DEBUG nova.compute.manager [req-fca90ae1-59de-4149-9d83-fa08f68248cc req-e6980fe4-b0e8-4ab3-941b-33e0f85eca0d service nova] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] No waiting events found dispatching network-vif-plugged-a3d4da82-f4ab-410c-8692-f14de0e43ef5 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:29:33 user nova-compute[71321]: WARNING nova.compute.manager [req-fca90ae1-59de-4149-9d83-fa08f68248cc req-e6980fe4-b0e8-4ab3-941b-33e0f85eca0d service nova] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Received unexpected event network-vif-plugged-a3d4da82-f4ab-410c-8692-f14de0e43ef5 for instance with vm_state building and task_state spawning.
Apr 12 12:29:33 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:29:33 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:29:33 user nova-compute[71321]: INFO nova.compute.manager [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Took 5.19 seconds to spawn the instance on the hypervisor.
Apr 12 12:29:33 user nova-compute[71321]: DEBUG nova.compute.manager [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:29:33 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:29:33 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:29:33 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:29:33 user nova-compute[71321]: INFO nova.compute.manager [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Took 20.82 seconds to build instance.
Apr 12 12:29:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "64589bd5-2688-4224-ba3e-8a26f9ffafaf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.944s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:33 user nova-compute[71321]: DEBUG nova.compute.manager [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:29:33 user nova-compute[71321]: DEBUG nova.compute.manager [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:29:33 user nova-compute[71321]: DEBUG nova.network.neutron [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:29:33 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:29:33 user nova-compute[71321]: DEBUG nova.compute.manager [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:29:33 user nova-compute[71321]: DEBUG nova.policy [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '35727e3b48da4494808015e2b630a3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466d2a494cf64002a98588909bdcd197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:29:33 user nova-compute[71321]: DEBUG nova.network.neutron [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Successfully updated port: c698ebb6-016a-4988-8c8a-7a75252a7944 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:29:33 user nova-compute[71321]: DEBUG nova.compute.manager [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:29:33 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:29:33 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Creating image(s)
Apr 12 12:29:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "/opt/stack/data/nova/instances/651d5c05-2d02-450f-a33c-fbd9b3109016/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "/opt/stack/data/nova/instances/651d5c05-2d02-450f-a33c-fbd9b3109016/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "/opt/stack/data/nova/instances/651d5c05-2d02-450f-a33c-fbd9b3109016/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.147s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.142s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/651d5c05-2d02-450f-a33c-fbd9b3109016/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/651d5c05-2d02-450f-a33c-fbd9b3109016/disk 1073741824" returned: 0 in 0.053s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.142s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:33 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Checking if we can resize image /opt/stack/data/nova/instances/651d5c05-2d02-450f-a33c-fbd9b3109016/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:29:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/651d5c05-2d02-450f-a33c-fbd9b3109016/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:34 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/651d5c05-2d02-450f-a33c-fbd9b3109016/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:34 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Cannot resize image /opt/stack/data/nova/instances/651d5c05-2d02-450f-a33c-fbd9b3109016/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:29:34 user nova-compute[71321]: DEBUG nova.objects.instance [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lazy-loading 'migration_context' on Instance uuid 651d5c05-2d02-450f-a33c-fbd9b3109016 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:29:34 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:29:34 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Ensure instance console log exists: /opt/stack/data/nova/instances/651d5c05-2d02-450f-a33c-fbd9b3109016/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:29:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:34 user nova-compute[71321]: DEBUG nova.compute.manager [req-d37eb6ff-a5df-4b02-a122-10a96464cb2d req-228de561-6e0e-49d8-9fe8-25c88cc0957a service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-changed-c698ebb6-016a-4988-8c8a-7a75252a7944 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:29:34 user nova-compute[71321]: DEBUG nova.compute.manager [req-d37eb6ff-a5df-4b02-a122-10a96464cb2d req-228de561-6e0e-49d8-9fe8-25c88cc0957a service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Refreshing instance network info cache due to event network-changed-c698ebb6-016a-4988-8c8a-7a75252a7944. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:29:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d37eb6ff-a5df-4b02-a122-10a96464cb2d req-228de561-6e0e-49d8-9fe8-25c88cc0957a service nova] Acquiring lock "refresh_cache-d8867363-6e36-4b34-9cc1-f30fbc572720" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:29:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d37eb6ff-a5df-4b02-a122-10a96464cb2d req-228de561-6e0e-49d8-9fe8-25c88cc0957a service nova] Acquired lock "refresh_cache-d8867363-6e36-4b34-9cc1-f30fbc572720" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:29:34 user nova-compute[71321]: DEBUG nova.network.neutron [req-d37eb6ff-a5df-4b02-a122-10a96464cb2d req-228de561-6e0e-49d8-9fe8-25c88cc0957a service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Refreshing network info cache for port c698ebb6-016a-4988-8c8a-7a75252a7944 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:29:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:34 user nova-compute[71321]: DEBUG nova.network.neutron [req-d37eb6ff-a5df-4b02-a122-10a96464cb2d req-228de561-6e0e-49d8-9fe8-25c88cc0957a service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:29:35 user nova-compute[71321]: DEBUG nova.network.neutron [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Successfully updated port: bb10902a-003e-4c1a-85a8-194f040a1ffb {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:29:35 user nova-compute[71321]: DEBUG nova.network.neutron [req-d37eb6ff-a5df-4b02-a122-10a96464cb2d req-228de561-6e0e-49d8-9fe8-25c88cc0957a service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:29:35 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d37eb6ff-a5df-4b02-a122-10a96464cb2d req-228de561-6e0e-49d8-9fe8-25c88cc0957a service nova] Releasing lock "refresh_cache-d8867363-6e36-4b34-9cc1-f30fbc572720" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:29:35 user nova-compute[71321]: DEBUG nova.network.neutron [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Successfully created port: b8a991df-6886-4036-a382-49898be6fd25 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:29:36 user nova-compute[71321]: DEBUG nova.compute.manager [req-33a5779a-ab78-4ece-8a0c-ddc6638ac2d4 req-7c3fbb7d-d41f-4d2b-a149-a33046de69d1 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-changed-bb10902a-003e-4c1a-85a8-194f040a1ffb {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:29:36 user nova-compute[71321]: DEBUG nova.compute.manager [req-33a5779a-ab78-4ece-8a0c-ddc6638ac2d4 req-7c3fbb7d-d41f-4d2b-a149-a33046de69d1 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Refreshing instance network info cache due to event network-changed-bb10902a-003e-4c1a-85a8-194f040a1ffb. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:29:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-33a5779a-ab78-4ece-8a0c-ddc6638ac2d4 req-7c3fbb7d-d41f-4d2b-a149-a33046de69d1 service nova] Acquiring lock "refresh_cache-d8867363-6e36-4b34-9cc1-f30fbc572720" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:29:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-33a5779a-ab78-4ece-8a0c-ddc6638ac2d4 req-7c3fbb7d-d41f-4d2b-a149-a33046de69d1 service nova] Acquired lock "refresh_cache-d8867363-6e36-4b34-9cc1-f30fbc572720" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:29:36 user nova-compute[71321]: DEBUG nova.network.neutron [req-33a5779a-ab78-4ece-8a0c-ddc6638ac2d4 req-7c3fbb7d-d41f-4d2b-a149-a33046de69d1 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Refreshing network info cache for port bb10902a-003e-4c1a-85a8-194f040a1ffb {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:29:36 user nova-compute[71321]: DEBUG nova.network.neutron [req-33a5779a-ab78-4ece-8a0c-ddc6638ac2d4 req-7c3fbb7d-d41f-4d2b-a149-a33046de69d1 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:29:36 user nova-compute[71321]: DEBUG nova.network.neutron [req-33a5779a-ab78-4ece-8a0c-ddc6638ac2d4 req-7c3fbb7d-d41f-4d2b-a149-a33046de69d1 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:29:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-33a5779a-ab78-4ece-8a0c-ddc6638ac2d4 req-7c3fbb7d-d41f-4d2b-a149-a33046de69d1 service nova] Releasing lock "refresh_cache-d8867363-6e36-4b34-9cc1-f30fbc572720" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:29:36 user nova-compute[71321]: DEBUG nova.network.neutron [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Successfully updated port: 389d5d9e-e5fc-48f1-b443-b04d08ec6181 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:29:36 user nova-compute[71321]: DEBUG nova.network.neutron [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Successfully updated port: b8a991df-6886-4036-a382-49898be6fd25 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:29:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "refresh_cache-651d5c05-2d02-450f-a33c-fbd9b3109016" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:29:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquired lock "refresh_cache-651d5c05-2d02-450f-a33c-fbd9b3109016" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:29:36 user nova-compute[71321]: DEBUG nova.network.neutron [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:29:36 user nova-compute[71321]: DEBUG nova.network.neutron [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:29:37 user nova-compute[71321]: DEBUG nova.network.neutron [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Updating instance_info_cache with network_info: [{"id": "b8a991df-6886-4036-a382-49898be6fd25", "address": "fa:16:3e:a8:ae:95", "network": {"id": "0fcb9046-707e-462c-937c-3ba5aebe64e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-529948515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "466d2a494cf64002a98588909bdcd197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a991df-68", "ovs_interfaceid": "b8a991df-6886-4036-a382-49898be6fd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:29:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Releasing lock "refresh_cache-651d5c05-2d02-450f-a33c-fbd9b3109016" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:29:37 user nova-compute[71321]: DEBUG nova.compute.manager [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Instance network_info: |[{"id": "b8a991df-6886-4036-a382-49898be6fd25", "address": "fa:16:3e:a8:ae:95", "network": {"id": "0fcb9046-707e-462c-937c-3ba5aebe64e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-529948515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "466d2a494cf64002a98588909bdcd197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a991df-68", "ovs_interfaceid": "b8a991df-6886-4036-a382-49898be6fd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:29:37 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Start _get_guest_xml network_info=[{"id": "b8a991df-6886-4036-a382-49898be6fd25", "address": "fa:16:3e:a8:ae:95", "network": {"id": "0fcb9046-707e-462c-937c-3ba5aebe64e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-529948515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "466d2a494cf64002a98588909bdcd197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a991df-68", "ovs_interfaceid": "b8a991df-6886-4036-a382-49898be6fd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:29:37 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:29:37 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:29:37 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:29:37 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:29:37 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:29:37 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:29:37 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:29:37 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:29:37 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:29:37 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:29:37 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:29:37 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:29:37 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:29:37 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:29:37 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:29:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1300903891',display_name='tempest-VolumesSnapshotTestJSON-instance-1300903891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1300903891',id=11,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='466d2a494cf64002a98588909bdcd197',ramdisk_id='',reservation_id='r-ujhsdp9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-760244133',owner_user_name='tempest-VolumesSnapshotTestJSON-760244133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:29:33Z,user_data=None,user_id='35727e3b48da4494808015e2b630a3f9',uuid=651d5c05-2d02-450f-a33c-fbd9b3109016,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8a991df-6886-4036-a382-49898be6fd25", "address": "fa:16:3e:a8:ae:95", "network": {"id": "0fcb9046-707e-462c-937c-3ba5aebe64e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-529948515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "466d2a494cf64002a98588909bdcd197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a991df-68", "ovs_interfaceid": "b8a991df-6886-4036-a382-49898be6fd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:29:37 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Converting VIF {"id": "b8a991df-6886-4036-a382-49898be6fd25", "address": "fa:16:3e:a8:ae:95", "network": {"id": "0fcb9046-707e-462c-937c-3ba5aebe64e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-529948515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "466d2a494cf64002a98588909bdcd197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a991df-68", "ovs_interfaceid": "b8a991df-6886-4036-a382-49898be6fd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:29:37 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:ae:95,bridge_name='br-int',has_traffic_filtering=True,id=b8a991df-6886-4036-a382-49898be6fd25,network=Network(0fcb9046-707e-462c-937c-3ba5aebe64e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8a991df-68') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:29:37 user nova-compute[71321]: DEBUG nova.objects.instance [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lazy-loading 'pci_devices' on Instance uuid 651d5c05-2d02-450f-a33c-fbd9b3109016 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:29:37 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:29:37 user nova-compute[71321]:   <uuid>651d5c05-2d02-450f-a33c-fbd9b3109016</uuid>
Apr 12 12:29:37 user nova-compute[71321]:   <name>instance-0000000b</name>
Apr 12 12:29:37 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:29:37 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:29:37 user nova-compute[71321]:   <metadata>
Apr 12 12:29:37 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:29:37 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:29:37 user nova-compute[71321]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1300903891</nova:name>
Apr 12 12:29:37 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:29:37</nova:creationTime>
Apr 12 12:29:37 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:29:37 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:29:37 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:29:37 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:29:37 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:29:37 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:29:37 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:29:37 user nova-compute[71321]:       <nova:owner>
Apr 12 12:29:37 user nova-compute[71321]:         <nova:user uuid="35727e3b48da4494808015e2b630a3f9">tempest-VolumesSnapshotTestJSON-760244133-project-member</nova:user>
Apr 12 12:29:37 user nova-compute[71321]:         <nova:project uuid="466d2a494cf64002a98588909bdcd197">tempest-VolumesSnapshotTestJSON-760244133</nova:project>
Apr 12 12:29:37 user nova-compute[71321]:       </nova:owner>
Apr 12 12:29:37 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:29:37 user nova-compute[71321]:       <nova:ports>
Apr 12 12:29:37 user nova-compute[71321]:         <nova:port uuid="b8a991df-6886-4036-a382-49898be6fd25">
Apr 12 12:29:37 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 12:29:37 user nova-compute[71321]:         </nova:port>
Apr 12 12:29:37 user nova-compute[71321]:       </nova:ports>
Apr 12 12:29:37 user nova-compute[71321]:     </nova:instance>
Apr 12 12:29:37 user nova-compute[71321]:   </metadata>
Apr 12 12:29:37 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:29:37 user nova-compute[71321]:     <system>
Apr 12 12:29:37 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:29:37 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:29:37 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:29:37 user nova-compute[71321]:       <entry name="serial">651d5c05-2d02-450f-a33c-fbd9b3109016</entry>
Apr 12 12:29:37 user nova-compute[71321]:       <entry name="uuid">651d5c05-2d02-450f-a33c-fbd9b3109016</entry>
Apr 12 12:29:37 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:29:37 user nova-compute[71321]:     </system>
Apr 12 12:29:37 user nova-compute[71321]:   </sysinfo>
Apr 12 12:29:37 user nova-compute[71321]:   <os>
Apr 12 12:29:37 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:29:37 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:29:37 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:29:37 user nova-compute[71321]:   </os>
Apr 12 12:29:37 user nova-compute[71321]:   <features>
Apr 12 12:29:37 user nova-compute[71321]:     <acpi/>
Apr 12 12:29:37 user nova-compute[71321]:     <apic/>
Apr 12 12:29:37 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:29:37 user nova-compute[71321]:   </features>
Apr 12 12:29:37 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:29:37 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:29:37 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:29:37 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:29:37 user nova-compute[71321]:   </clock>
Apr 12 12:29:37 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:29:37 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:29:37 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:29:37 user nova-compute[71321]:   </cpu>
Apr 12 12:29:37 user nova-compute[71321]:   <devices>
Apr 12 12:29:37 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:29:37 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:29:37 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/651d5c05-2d02-450f-a33c-fbd9b3109016/disk"/>
Apr 12 12:29:37 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:29:37 user nova-compute[71321]:     </disk>
Apr 12 12:29:37 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:29:37 user nova-compute[71321]:       <mac address="fa:16:3e:a8:ae:95"/>
Apr 12 12:29:37 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:29:37 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:29:37 user nova-compute[71321]:       <target dev="tapb8a991df-68"/>
Apr 12 12:29:37 user nova-compute[71321]:     </interface>
Apr 12 12:29:37 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:29:37 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/651d5c05-2d02-450f-a33c-fbd9b3109016/console.log" append="off"/>
Apr 12 12:29:37 user nova-compute[71321]:     </serial>
Apr 12 12:29:37 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:29:37 user nova-compute[71321]:     <video>
Apr 12 12:29:37 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:29:37 user nova-compute[71321]:     </video>
Apr 12 12:29:37 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:29:37 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:29:37 user nova-compute[71321]:     </rng>
Apr 12 12:29:37 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:29:37 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:29:37 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:29:37 user nova-compute[71321]:     </memballoon>
Apr 12 12:29:37 user nova-compute[71321]:   </devices>
Apr 12 12:29:37 user nova-compute[71321]: </domain>
Apr 12 12:29:37 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:29:37 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:29:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1300903891',display_name='tempest-VolumesSnapshotTestJSON-instance-1300903891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1300903891',id=11,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='466d2a494cf64002a98588909bdcd197',ramdisk_id='',reservation_id='r-ujhsdp9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-760244133',owner_user_name='tempest-VolumesSnapshotTestJSON-760244133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:29:33Z,user_data=None,user_id='35727e3b48da4494808015e2b630a3f9',uuid=651d5c05-2d02-450f-a33c-fbd9b3109016,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8a991df-6886-4036-a382-49898be6fd25", "address": "fa:16:3e:a8:ae:95", "network": {"id": "0fcb9046-707e-462c-937c-3ba5aebe64e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-529948515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "466d2a494cf64002a98588909bdcd197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a991df-68", "ovs_interfaceid": "b8a991df-6886-4036-a382-49898be6fd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:29:37 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Converting VIF {"id": "b8a991df-6886-4036-a382-49898be6fd25", "address": "fa:16:3e:a8:ae:95", "network": {"id": "0fcb9046-707e-462c-937c-3ba5aebe64e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-529948515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "466d2a494cf64002a98588909bdcd197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a991df-68", "ovs_interfaceid": "b8a991df-6886-4036-a382-49898be6fd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:29:37 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:ae:95,bridge_name='br-int',has_traffic_filtering=True,id=b8a991df-6886-4036-a382-49898be6fd25,network=Network(0fcb9046-707e-462c-937c-3ba5aebe64e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8a991df-68') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:29:37 user nova-compute[71321]: DEBUG os_vif [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:ae:95,bridge_name='br-int',has_traffic_filtering=True,id=b8a991df-6886-4036-a382-49898be6fd25,network=Network(0fcb9046-707e-462c-937c-3ba5aebe64e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8a991df-68') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:29:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:29:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:29:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8a991df-68, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:29:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb8a991df-68, col_values=(('external_ids', {'iface-id': 'b8a991df-6886-4036-a382-49898be6fd25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:ae:95', 'vm-uuid': '651d5c05-2d02-450f-a33c-fbd9b3109016'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:29:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:29:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:37 user nova-compute[71321]: INFO os_vif [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:ae:95,bridge_name='br-int',has_traffic_filtering=True,id=b8a991df-6886-4036-a382-49898be6fd25,network=Network(0fcb9046-707e-462c-937c-3ba5aebe64e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8a991df-68')
Apr 12 12:29:37 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:29:37 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] No VIF found with MAC fa:16:3e:a8:ae:95, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:29:38 user nova-compute[71321]: DEBUG nova.compute.manager [req-871e12c1-3750-48a4-9d2d-61c3bd63299b req-4f051dda-e687-49a9-8567-2f01a1c50464 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-changed-389d5d9e-e5fc-48f1-b443-b04d08ec6181 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:29:38 user nova-compute[71321]: DEBUG nova.compute.manager [req-871e12c1-3750-48a4-9d2d-61c3bd63299b req-4f051dda-e687-49a9-8567-2f01a1c50464 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Refreshing instance network info cache due to event network-changed-389d5d9e-e5fc-48f1-b443-b04d08ec6181. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:29:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-871e12c1-3750-48a4-9d2d-61c3bd63299b req-4f051dda-e687-49a9-8567-2f01a1c50464 service nova] Acquiring lock "refresh_cache-d8867363-6e36-4b34-9cc1-f30fbc572720" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:29:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-871e12c1-3750-48a4-9d2d-61c3bd63299b req-4f051dda-e687-49a9-8567-2f01a1c50464 service nova] Acquired lock "refresh_cache-d8867363-6e36-4b34-9cc1-f30fbc572720" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:29:38 user nova-compute[71321]: DEBUG nova.network.neutron [req-871e12c1-3750-48a4-9d2d-61c3bd63299b req-4f051dda-e687-49a9-8567-2f01a1c50464 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Refreshing network info cache for port 389d5d9e-e5fc-48f1-b443-b04d08ec6181 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:29:38 user nova-compute[71321]: DEBUG nova.network.neutron [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Successfully updated port: bf6a7707-9d55-46b2-8738-06505013048b {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:29:38 user nova-compute[71321]: DEBUG nova.network.neutron [req-871e12c1-3750-48a4-9d2d-61c3bd63299b req-4f051dda-e687-49a9-8567-2f01a1c50464 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:29:38 user nova-compute[71321]: INFO nova.virt.block_device [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Booting with volume 03750d10-be51-41e7-8ffe-78d0af572b24 at /dev/vdc
Apr 12 12:29:38 user nova-compute[71321]: DEBUG os_brick.utils [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:29:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:38 user nova-compute[71321]: DEBUG nova.network.neutron [req-871e12c1-3750-48a4-9d2d-61c3bd63299b req-4f051dda-e687-49a9-8567-2f01a1c50464 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:29:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:38 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78e4276-2844-4f4c-9173-6d4a46bd8673]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-871e12c1-3750-48a4-9d2d-61c3bd63299b req-4f051dda-e687-49a9-8567-2f01a1c50464 service nova] Releasing lock "refresh_cache-d8867363-6e36-4b34-9cc1-f30fbc572720" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:29:38 user nova-compute[71321]: DEBUG nova.compute.manager [req-871e12c1-3750-48a4-9d2d-61c3bd63299b req-4f051dda-e687-49a9-8567-2f01a1c50464 service nova] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Received event network-changed-b8a991df-6886-4036-a382-49898be6fd25 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:29:38 user nova-compute[71321]: DEBUG nova.compute.manager [req-871e12c1-3750-48a4-9d2d-61c3bd63299b req-4f051dda-e687-49a9-8567-2f01a1c50464 service nova] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Refreshing instance network info cache due to event network-changed-b8a991df-6886-4036-a382-49898be6fd25. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:29:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-871e12c1-3750-48a4-9d2d-61c3bd63299b req-4f051dda-e687-49a9-8567-2f01a1c50464 service nova] Acquiring lock "refresh_cache-651d5c05-2d02-450f-a33c-fbd9b3109016" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:29:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-871e12c1-3750-48a4-9d2d-61c3bd63299b req-4f051dda-e687-49a9-8567-2f01a1c50464 service nova] Acquired lock "refresh_cache-651d5c05-2d02-450f-a33c-fbd9b3109016" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:29:38 user nova-compute[71321]: DEBUG nova.network.neutron [req-871e12c1-3750-48a4-9d2d-61c3bd63299b req-4f051dda-e687-49a9-8567-2f01a1c50464 service nova] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Refreshing network info cache for port b8a991df-6886-4036-a382-49898be6fd25 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:29:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:38 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b887f4-57f6-42e9-a187-1a8809d1aa8e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:38 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a86d629-b03b-4cd4-9ed2-d0d85f5f5235]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:38 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93bcb32-d001-4b77-95ef-68f3fa02386b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:29:38 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:29:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:29:38 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:29:38 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3977d1-7fc6-42be-919c-895c180452f5]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:38 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:29:38 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:29:38 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:29:38 user nova-compute[71321]: DEBUG os_brick.utils [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:29:38 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Updating existing volume attachment record: 238f3444-2571-4bef-8739-8296828d762a {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:29:39 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:39 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:39 user nova-compute[71321]: DEBUG nova.network.neutron [req-871e12c1-3750-48a4-9d2d-61c3bd63299b req-4f051dda-e687-49a9-8567-2f01a1c50464 service nova] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Updated VIF entry in instance network info cache for port b8a991df-6886-4036-a382-49898be6fd25. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:29:39 user nova-compute[71321]: DEBUG nova.network.neutron [req-871e12c1-3750-48a4-9d2d-61c3bd63299b req-4f051dda-e687-49a9-8567-2f01a1c50464 service nova] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Updating instance_info_cache with network_info: [{"id": "b8a991df-6886-4036-a382-49898be6fd25", "address": "fa:16:3e:a8:ae:95", "network": {"id": "0fcb9046-707e-462c-937c-3ba5aebe64e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-529948515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "466d2a494cf64002a98588909bdcd197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a991df-68", "ovs_interfaceid": "b8a991df-6886-4036-a382-49898be6fd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:29:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-a4c9e88c-cf74-4f10-a18a-34548110105e req-71e1bcea-c96b-4a67-b829-d5eedc436fcc service nova] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Received event network-vif-plugged-b8a991df-6886-4036-a382-49898be6fd25 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:29:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a4c9e88c-cf74-4f10-a18a-34548110105e req-71e1bcea-c96b-4a67-b829-d5eedc436fcc service nova] Acquiring lock "651d5c05-2d02-450f-a33c-fbd9b3109016-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a4c9e88c-cf74-4f10-a18a-34548110105e req-71e1bcea-c96b-4a67-b829-d5eedc436fcc service nova] Lock "651d5c05-2d02-450f-a33c-fbd9b3109016-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a4c9e88c-cf74-4f10-a18a-34548110105e req-71e1bcea-c96b-4a67-b829-d5eedc436fcc service nova] Lock "651d5c05-2d02-450f-a33c-fbd9b3109016-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-a4c9e88c-cf74-4f10-a18a-34548110105e req-71e1bcea-c96b-4a67-b829-d5eedc436fcc service nova] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] No waiting events found dispatching network-vif-plugged-b8a991df-6886-4036-a382-49898be6fd25 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:29:39 user nova-compute[71321]: WARNING nova.compute.manager [req-a4c9e88c-cf74-4f10-a18a-34548110105e req-71e1bcea-c96b-4a67-b829-d5eedc436fcc service nova] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Received unexpected event network-vif-plugged-b8a991df-6886-4036-a382-49898be6fd25 for instance with vm_state building and task_state spawning.
Apr 12 12:29:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-871e12c1-3750-48a4-9d2d-61c3bd63299b req-4f051dda-e687-49a9-8567-2f01a1c50464 service nova] Releasing lock "refresh_cache-651d5c05-2d02-450f-a33c-fbd9b3109016" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:29:39 user nova-compute[71321]: DEBUG nova.network.neutron [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Successfully updated port: e9757213-2bc0-46a5-bffa-3b503c65ecc2 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:29:40 user nova-compute[71321]: DEBUG nova.compute.manager [req-c6bab2aa-4865-4831-b00c-07c24089d687 req-410cea38-ad28-4665-816d-4da5a1f07363 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-changed-bf6a7707-9d55-46b2-8738-06505013048b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:29:40 user nova-compute[71321]: DEBUG nova.compute.manager [req-c6bab2aa-4865-4831-b00c-07c24089d687 req-410cea38-ad28-4665-816d-4da5a1f07363 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Refreshing instance network info cache due to event network-changed-bf6a7707-9d55-46b2-8738-06505013048b. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:29:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c6bab2aa-4865-4831-b00c-07c24089d687 req-410cea38-ad28-4665-816d-4da5a1f07363 service nova] Acquiring lock "refresh_cache-d8867363-6e36-4b34-9cc1-f30fbc572720" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:29:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c6bab2aa-4865-4831-b00c-07c24089d687 req-410cea38-ad28-4665-816d-4da5a1f07363 service nova] Acquired lock "refresh_cache-d8867363-6e36-4b34-9cc1-f30fbc572720" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:29:40 user nova-compute[71321]: DEBUG nova.network.neutron [req-c6bab2aa-4865-4831-b00c-07c24089d687 req-410cea38-ad28-4665-816d-4da5a1f07363 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Refreshing network info cache for port bf6a7707-9d55-46b2-8738-06505013048b {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:29:40 user nova-compute[71321]: DEBUG nova.network.neutron [req-c6bab2aa-4865-4831-b00c-07c24089d687 req-410cea38-ad28-4665-816d-4da5a1f07363 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:29:40 user nova-compute[71321]: DEBUG nova.network.neutron [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Successfully updated port: 6f2ec393-bb3c-4986-bd50-44ae9a7147b0 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:29:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "refresh_cache-d8867363-6e36-4b34-9cc1-f30fbc572720" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:29:40 user nova-compute[71321]: DEBUG nova.network.neutron [req-c6bab2aa-4865-4831-b00c-07c24089d687 req-410cea38-ad28-4665-816d-4da5a1f07363 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:29:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c6bab2aa-4865-4831-b00c-07c24089d687 req-410cea38-ad28-4665-816d-4da5a1f07363 service nova] Releasing lock "refresh_cache-d8867363-6e36-4b34-9cc1-f30fbc572720" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:29:40 user nova-compute[71321]: DEBUG nova.compute.manager [req-c6bab2aa-4865-4831-b00c-07c24089d687 req-410cea38-ad28-4665-816d-4da5a1f07363 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-changed-e9757213-2bc0-46a5-bffa-3b503c65ecc2 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:29:40 user nova-compute[71321]: DEBUG nova.compute.manager [req-c6bab2aa-4865-4831-b00c-07c24089d687 req-410cea38-ad28-4665-816d-4da5a1f07363 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Refreshing instance network info cache due to event network-changed-e9757213-2bc0-46a5-bffa-3b503c65ecc2. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:29:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c6bab2aa-4865-4831-b00c-07c24089d687 req-410cea38-ad28-4665-816d-4da5a1f07363 service nova] Acquiring lock "refresh_cache-d8867363-6e36-4b34-9cc1-f30fbc572720" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:29:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c6bab2aa-4865-4831-b00c-07c24089d687 req-410cea38-ad28-4665-816d-4da5a1f07363 service nova] Acquired lock "refresh_cache-d8867363-6e36-4b34-9cc1-f30fbc572720" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:29:40 user nova-compute[71321]: DEBUG nova.network.neutron [req-c6bab2aa-4865-4831-b00c-07c24089d687 req-410cea38-ad28-4665-816d-4da5a1f07363 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Refreshing network info cache for port e9757213-2bc0-46a5-bffa-3b503c65ecc2 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:29:41 user nova-compute[71321]: DEBUG nova.network.neutron [req-c6bab2aa-4865-4831-b00c-07c24089d687 req-410cea38-ad28-4665-816d-4da5a1f07363 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:29:41 user nova-compute[71321]: DEBUG nova.network.neutron [req-c6bab2aa-4865-4831-b00c-07c24089d687 req-410cea38-ad28-4665-816d-4da5a1f07363 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:29:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c6bab2aa-4865-4831-b00c-07c24089d687 req-410cea38-ad28-4665-816d-4da5a1f07363 service nova] Releasing lock "refresh_cache-d8867363-6e36-4b34-9cc1-f30fbc572720" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:29:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquired lock "refresh_cache-d8867363-6e36-4b34-9cc1-f30fbc572720" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:29:41 user nova-compute[71321]: DEBUG nova.network.neutron [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:29:41 user nova-compute[71321]: DEBUG nova.network.neutron [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:29:41 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302581.6508105, 651d5c05-2d02-450f-a33c-fbd9b3109016 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:29:41 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] VM Resumed (Lifecycle Event)
Apr 12 12:29:41 user nova-compute[71321]: DEBUG nova.compute.manager [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:29:41 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:29:41 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Instance spawned successfully.
Apr 12 12:29:41 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:29:41 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:29:41 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:29:41 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:29:41 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302581.6558723, 651d5c05-2d02-450f-a33c-fbd9b3109016 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:29:41 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] VM Started (Lifecycle Event)
Apr 12 12:29:41 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:29:41 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:29:41 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:29:41 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:29:41 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:29:41 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:29:41 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:29:41 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:29:41 user nova-compute[71321]: DEBUG nova.compute.manager [req-42f1bd48-576b-4448-8ea6-3c9f7205179d req-78b8bd09-3881-4a98-8d25-9b41731d7ccc service nova] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Received event network-vif-plugged-b8a991df-6886-4036-a382-49898be6fd25 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:29:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-42f1bd48-576b-4448-8ea6-3c9f7205179d req-78b8bd09-3881-4a98-8d25-9b41731d7ccc service nova] Acquiring lock "651d5c05-2d02-450f-a33c-fbd9b3109016-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-42f1bd48-576b-4448-8ea6-3c9f7205179d req-78b8bd09-3881-4a98-8d25-9b41731d7ccc service nova] Lock "651d5c05-2d02-450f-a33c-fbd9b3109016-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-42f1bd48-576b-4448-8ea6-3c9f7205179d req-78b8bd09-3881-4a98-8d25-9b41731d7ccc service nova] Lock "651d5c05-2d02-450f-a33c-fbd9b3109016-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:41 user nova-compute[71321]: DEBUG nova.compute.manager [req-42f1bd48-576b-4448-8ea6-3c9f7205179d req-78b8bd09-3881-4a98-8d25-9b41731d7ccc service nova] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] No waiting events found dispatching network-vif-plugged-b8a991df-6886-4036-a382-49898be6fd25 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:29:41 user nova-compute[71321]: WARNING nova.compute.manager [req-42f1bd48-576b-4448-8ea6-3c9f7205179d req-78b8bd09-3881-4a98-8d25-9b41731d7ccc service nova] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Received unexpected event network-vif-plugged-b8a991df-6886-4036-a382-49898be6fd25 for instance with vm_state building and task_state spawning.
Apr 12 12:29:41 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:29:41 user nova-compute[71321]: INFO nova.compute.manager [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Took 8.39 seconds to spawn the instance on the hypervisor.
Apr 12 12:29:41 user nova-compute[71321]: DEBUG nova.compute.manager [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:29:41 user nova-compute[71321]: INFO nova.compute.manager [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Took 9.42 seconds to build instance.
Apr 12 12:29:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "651d5c05-2d02-450f-a33c-fbd9b3109016" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.534s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:42 user nova-compute[71321]: DEBUG nova.compute.manager [req-795216b8-d8c8-443a-ab5f-6c60fb412618 req-5d60ca38-7eea-48af-9a08-15a2f7fb19aa service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-changed-6f2ec393-bb3c-4986-bd50-44ae9a7147b0 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:29:42 user nova-compute[71321]: DEBUG nova.compute.manager [req-795216b8-d8c8-443a-ab5f-6c60fb412618 req-5d60ca38-7eea-48af-9a08-15a2f7fb19aa service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Refreshing instance network info cache due to event network-changed-6f2ec393-bb3c-4986-bd50-44ae9a7147b0. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:29:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-795216b8-d8c8-443a-ab5f-6c60fb412618 req-5d60ca38-7eea-48af-9a08-15a2f7fb19aa service nova] Acquiring lock "refresh_cache-d8867363-6e36-4b34-9cc1-f30fbc572720" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:29:42 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG nova.compute.manager [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:29:44 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Creating image(s)
Apr 12 12:29:44 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Did not create local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Ensure instance console log exists: /opt/stack/data/nova/instances/d8867363-6e36-4b34-9cc1-f30fbc572720/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG nova.network.neutron [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Updating instance_info_cache with network_info: [{"id": "93bb6ab6-63a2-421a-b331-92c957f29f5a", "address": "fa:16:3e:79:39:dc", "network": {"id": "200ada24-4b99-42e5-9085-07900a59a716", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1440676334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bb6ab6-63", "ovs_interfaceid": "93bb6ab6-63a2-421a-b331-92c957f29f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c698ebb6-016a-4988-8c8a-7a75252a7944", "address": "fa:16:3e:c8:f3:a6", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc698ebb6-01", "ovs_interfaceid": "c698ebb6-016a-4988-8c8a-7a75252a7944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bb10902a-003e-4c1a-85a8-194f040a1ffb", "address": "fa:16:3e:36:6f:30", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb10902a-00", "ovs_interfaceid": "bb10902a-003e-4c1a-85a8-194f040a1ffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "389d5d9e-e5fc-48f1-b443-b04d08ec6181", "address": "fa:16:3e:9e:00:f4", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap389d5d9e-e5", "ovs_interfaceid": "389d5d9e-e5fc-48f1-b443-b04d08ec6181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf6a7707-9d55-46b2-8738-06505013048b", "address": "fa:16:3e:be:d3:4b", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6a7707-9d", "ovs_interfaceid": "bf6a7707-9d55-46b2-8738-06505013048b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9757213-2bc0-46a5-bffa-3b503c65ecc2", "address": "fa:16:3e:03:d8:98", "network": {"id": "f67d6710-fe9f-4d97-935e-535e0202f0ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048697198", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9757213-2b", "ovs_interfaceid": "e9757213-2bc0-46a5-bffa-3b503c65ecc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f2ec393-bb3c-4986-bd50-44ae9a7147b0", "address": "fa:16:3e:4c:1b:5c", "network": {"id": "f67d6710-fe9f-4d97-935e-535e0202f0ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048697198", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f2ec393-bb", "ovs_interfaceid": "6f2ec393-bb3c-4986-bd50-44ae9a7147b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Releasing lock "refresh_cache-d8867363-6e36-4b34-9cc1-f30fbc572720" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG nova.compute.manager [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Instance network_info: |[{"id": "93bb6ab6-63a2-421a-b331-92c957f29f5a", "address": "fa:16:3e:79:39:dc", "network": {"id": "200ada24-4b99-42e5-9085-07900a59a716", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1440676334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bb6ab6-63", "ovs_interfaceid": "93bb6ab6-63a2-421a-b331-92c957f29f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c698ebb6-016a-4988-8c8a-7a75252a7944", "address": "fa:16:3e:c8:f3:a6", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc698ebb6-01", "ovs_interfaceid": "c698ebb6-016a-4988-8c8a-7a75252a7944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bb10902a-003e-4c1a-85a8-194f040a1ffb", "address": "fa:16:3e:36:6f:30", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb10902a-00", "ovs_interfaceid": "bb10902a-003e-4c1a-85a8-194f040a1ffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "389d5d9e-e5fc-48f1-b443-b04d08ec6181", "address": "fa:16:3e:9e:00:f4", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap389d5d9e-e5", "ovs_interfaceid": "389d5d9e-e5fc-48f1-b443-b04d08ec6181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf6a7707-9d55-46b2-8738-06505013048b", "address": "fa:16:3e:be:d3:4b", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6a7707-9d", "ovs_interfaceid": "bf6a7707-9d55-46b2-8738-06505013048b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9757213-2bc0-46a5-bffa-3b503c65ecc2", "address": "fa:16:3e:03:d8:98", "network": {"id": "f67d6710-fe9f-4d97-935e-535e0202f0ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048697198", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9757213-2b", "ovs_interfaceid": "e9757213-2bc0-46a5-bffa-3b503c65ecc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f2ec393-bb3c-4986-bd50-44ae9a7147b0", "address": "fa:16:3e:4c:1b:5c", "network": {"id": "f67d6710-fe9f-4d97-935e-535e0202f0ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048697198", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f2ec393-bb", "ovs_interfaceid": "6f2ec393-bb3c-4986-bd50-44ae9a7147b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-795216b8-d8c8-443a-ab5f-6c60fb412618 req-5d60ca38-7eea-48af-9a08-15a2f7fb19aa service nova] Acquired lock "refresh_cache-d8867363-6e36-4b34-9cc1-f30fbc572720" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG nova.network.neutron [req-795216b8-d8c8-443a-ab5f-6c60fb412618 req-5d60ca38-7eea-48af-9a08-15a2f7fb19aa service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Refreshing network info cache for port 6f2ec393-bb3c-4986-bd50-44ae9a7147b0 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Start _get_guest_xml network_info=[{"id": "93bb6ab6-63a2-421a-b331-92c957f29f5a", "address": "fa:16:3e:79:39:dc", "network": {"id": "200ada24-4b99-42e5-9085-07900a59a716", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1440676334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bb6ab6-63", "ovs_interfaceid": "93bb6ab6-63a2-421a-b331-92c957f29f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c698ebb6-016a-4988-8c8a-7a75252a7944", "address": "fa:16:3e:c8:f3:a6", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc698ebb6-01", "ovs_interfaceid": "c698ebb6-016a-4988-8c8a-7a75252a7944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bb10902a-003e-4c1a-85a8-194f040a1ffb", "address": "fa:16:3e:36:6f:30", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb10902a-00", "ovs_interfaceid": "bb10902a-003e-4c1a-85a8-194f040a1ffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "389d5d9e-e5fc-48f1-b443-b04d08ec6181", "address": "fa:16:3e:9e:00:f4", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap389d5d9e-e5", "ovs_interfaceid": "389d5d9e-e5fc-48f1-b443-b04d08ec6181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf6a7707-9d55-46b2-8738-06505013048b", "address": "fa:16:3e:be:d3:4b", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6a7707-9d", "ovs_interfaceid": "bf6a7707-9d55-46b2-8738-06505013048b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9757213-2bc0-46a5-bffa-3b503c65ecc2", "address": "fa:16:3e:03:d8:98", "network": {"id": "f67d6710-fe9f-4d97-935e-535e0202f0ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048697198", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9757213-2b", "ovs_interfaceid": "e9757213-2bc0-46a5-bffa-3b503c65ecc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f2ec393-bb3c-4986-bd50-44ae9a7147b0", "address": "fa:16:3e:4c:1b:5c", "network": {"id": "f67d6710-fe9f-4d97-935e-535e0202f0ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048697198", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f2ec393-bb", "ovs_interfaceid": "6f2ec393-bb3c-4986-bd50-44ae9a7147b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '32d8ee48-03d9-43e9-aba9-f863e8f8bb7d', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dSwPCAuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd8867363-6e36-4b34-9cc1-f30fbc572720', 'attached_at': '', 'detached_at': '', 'volume_id': '79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc', 'serial': '79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': '3f496d3d-1760-4dcf-93cf-2c51c4ca1e79', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgiGFVof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd8867363-6e36-4b34-9cc1-f30fbc572720', 'attached_at': '', 'detached_at': '', 'volume_id': 'b0cc7840-90f7-4311-8c15-78c644bad569', 'serial': 'b0cc7840-90f7-4311-8c15-78c644bad569'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': 1, 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': '238f3444-2571-4bef-8739-8296828d762a', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YzRkoMvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd8867363-6e36-4b34-9cc1-f30fbc572720', 'attached_at': '', 'detached_at': '', 'volume_id': '03750d10-be51-41e7-8ffe-78d0af572b24', 'serial': '03750d10-be51-41e7-8ffe-78d0af572b24'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': 2, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:29:44 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:29:44 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:29:44 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dSwPCAuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:29:44 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:29:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:29:44 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:29:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:29:44 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7df7dd-d0dd-4e66-9c5b-cecbbb5db8c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:29:44 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eaeb386-2fe3-4dca-9a58-6593fb35836e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc] added
Apr 12 12:29:44 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0879d96-1bcb-4af0-8baa-c38d5ce4c301]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d52cf2-457e-44be-a816-d71d43aa8b87]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dSwPCAuR {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dSwPCAuR" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44a8c12-0f27-4785-b68e-ac8b6c684bee]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dSwPCAuR'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a0a096-fb52-4b00-8246-b8243881ac50]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb53f6f-594b-4c6e-9ee5-58702e4d90dc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:29:44 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:29:44 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3a76b6-1d1b-4c56-8e7b-4c4bb7d610db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc, portal: 172.16.0.220,3260]
Apr 12 12:29:44 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc, portal: 172.16.0.220,3260] successful.
Apr 12 12:29:44 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ac22de-180b-47d4-a92e-1bdb56059863]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ed9f61-1178-4c33-ac5c-0c6f52d602dd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:29:44 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:29:44 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:29:44 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:29:44 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fbc85d-59e3-43f9-a8b9-e1dff726c8c3]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:29:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dSwPCAuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:29:45 user nova-compute[71321]: DEBUG nova.network.neutron [req-795216b8-d8c8-443a-ab5f-6c60fb412618 req-5d60ca38-7eea-48af-9a08-15a2f7fb19aa service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Updated VIF entry in instance network info cache for port 6f2ec393-bb3c-4986-bd50-44ae9a7147b0. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:29:45 user nova-compute[71321]: DEBUG nova.network.neutron [req-795216b8-d8c8-443a-ab5f-6c60fb412618 req-5d60ca38-7eea-48af-9a08-15a2f7fb19aa service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Updating instance_info_cache with network_info: [{"id": "93bb6ab6-63a2-421a-b331-92c957f29f5a", "address": "fa:16:3e:79:39:dc", "network": {"id": "200ada24-4b99-42e5-9085-07900a59a716", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1440676334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bb6ab6-63", "ovs_interfaceid": "93bb6ab6-63a2-421a-b331-92c957f29f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c698ebb6-016a-4988-8c8a-7a75252a7944", "address": "fa:16:3e:c8:f3:a6", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc698ebb6-01", "ovs_interfaceid": "c698ebb6-016a-4988-8c8a-7a75252a7944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bb10902a-003e-4c1a-85a8-194f040a1ffb", "address": "fa:16:3e:36:6f:30", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb10902a-00", "ovs_interfaceid": "bb10902a-003e-4c1a-85a8-194f040a1ffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "389d5d9e-e5fc-48f1-b443-b04d08ec6181", "address": "fa:16:3e:9e:00:f4", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap389d5d9e-e5", "ovs_interfaceid": "389d5d9e-e5fc-48f1-b443-b04d08ec6181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf6a7707-9d55-46b2-8738-06505013048b", "address": "fa:16:3e:be:d3:4b", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6a7707-9d", "ovs_interfaceid": "bf6a7707-9d55-46b2-8738-06505013048b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9757213-2bc0-46a5-bffa-3b503c65ecc2", "address": "fa:16:3e:03:d8:98", "network": {"id": "f67d6710-fe9f-4d97-935e-535e0202f0ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048697198", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9757213-2b", "ovs_interfaceid": "e9757213-2bc0-46a5-bffa-3b503c65ecc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f2ec393-bb3c-4986-bd50-44ae9a7147b0", "address": "fa:16:3e:4c:1b:5c", "network": {"id": "f67d6710-fe9f-4d97-935e-535e0202f0ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048697198", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f2ec393-bb", "ovs_interfaceid": "6f2ec393-bb3c-4986-bd50-44ae9a7147b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:29:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-795216b8-d8c8-443a-ab5f-6c60fb412618 req-5d60ca38-7eea-48af-9a08-15a2f7fb19aa service nova] Releasing lock "refresh_cache-d8867363-6e36-4b34-9cc1-f30fbc572720" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:29:45 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:29:45 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '26634346330313131', 'path': '/dev/sdc'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:29:45 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634346330313131', 'path': '/dev/sdc'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:29:45 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:29:45 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgiGFVof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:29:45 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:29:45 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:29:45 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:29:45 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:29:45 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:29:45 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:29:45 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:29:45 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:45 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:45 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9916da8-8639-4cd0-9b65-84c02845fbd0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:45 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:29:45 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:29:45 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:45 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:45 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[268fd667-f3c4-4392-891e-1f9f02cb38f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:45 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569] added
Apr 12 12:29:45 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:29:45 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4527d7-7ad0-448c-a3ec-ff27dcce0239]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd9fc87-3bc9-446f-a9f9-7db328bd9bb7]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pgiGFVof {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pgiGFVof" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4f4279-da12-49b2-99a4-17ad6617cbfe]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pgiGFVof'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[23df3e90-20cb-4260-af76-b0c93184d68a]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba90b506-60c7-4037-b07a-119740b15e62]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:29:46 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:29:46 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:29:46 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:29:46 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf85bc9d-1761-4f14-97df-fead133e85e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569, portal: 172.16.0.220,3260]
Apr 12 12:29:46 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569, portal: 172.16.0.220,3260] successful.
Apr 12 12:29:46 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce537eb8-5d07-492a-82df-6e5cc0297b39]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbb0b5a-c61b-411f-ad92-f93311c20973]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:29:46 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:29:46 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:29:46 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:29:46 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:29:46 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:29:46 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1d5547-0488-4287-b7a4-14b5c28c195f]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:29:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgiGFVof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23937653131616533', 'path': '/dev/sdd'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937653131616533', 'path': '/dev/sdd'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YzRkoMvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:29:47 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:29:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:29:47 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:29:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:29:47 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:29:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c770f71-f12d-4185-ad64-b203564b362d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:29:47 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[914e22c5-1bde-4714-ae3d-2496a478af28]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24] added
Apr 12 12:29:47 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d44900c-1380-4b79-ad54-225e52424c58]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9780245-639c-4a34-8b7d-d803c5706840]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YzRkoMvT {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YzRkoMvT" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[81364d9e-8e1b-4e68-b5d2-41318b6517ba]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YzRkoMvT'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0220a1-935b-4720-8d41-6d249b38537a]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eeececb-c35e-44ce-ae6a-1dd059e56d6a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:29:47 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:29:47 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:29:47 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:29:47 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:29:47 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:29:47 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[588c0a32-0b12-4ab5-9b68-74afe1974c8e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24, portal: 172.16.0.220,3260]
Apr 12 12:29:47 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24, portal: 172.16.0.220,3260] successful.
Apr 12 12:29:47 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2805a634-35c9-44df-b229-a43c0ed7f363]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ffba54-3a60-44fa-aa62-4dbd373bee58]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:29:47 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:29:47 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:29:47 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:29:47 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:29:47 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:29:47 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:29:47 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:29:47 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd36fe2a-9ee6-4757-80be-ddeb55b24854]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YzRkoMvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:29:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23936353531623030', 'path': '/dev/sde'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936353531623030', 'path': '/dev/sde'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:29:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1511709584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1511709584',id=10,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzJQXzt1AYOf4lFnoJZvCjH3+G3z3Xlj83+ey7m3OEW9t8n5k8TLfR+L2ikcKnDMFMmln4QvSg9XLtbDzFTnjllywjp5FJCi4mQrVJZGB6DYL5ifjmZNLoATW9/WbDgrg==',key_name='tempest-keypair-1404432695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed98064a134b4603bbf641f45988564a',ramdisk_id='',reservation_id='r-ezox3prz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-350828706',owner_user_name='tempest-TaggedBootDevicesTest-350828706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:29:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1cf68007f18458b9824e056151f5c57',uuid=d8867363-6e36-4b34-9cc1-f30fbc572720,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93bb6ab6-63a2-421a-b331-92c957f29f5a", "address": "fa:16:3e:79:39:dc", "network": {"id": "200ada24-4b99-42e5-9085-07900a59a716", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1440676334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bb6ab6-63", "ovs_interfaceid": "93bb6ab6-63a2-421a-b331-92c957f29f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converting VIF {"id": "93bb6ab6-63a2-421a-b331-92c957f29f5a", "address": "fa:16:3e:79:39:dc", "network": {"id": "200ada24-4b99-42e5-9085-07900a59a716", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1440676334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bb6ab6-63", "ovs_interfaceid": "93bb6ab6-63a2-421a-b331-92c957f29f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:39:dc,bridge_name='br-int',has_traffic_filtering=True,id=93bb6ab6-63a2-421a-b331-92c957f29f5a,network=Network(200ada24-4b99-42e5-9085-07900a59a716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93bb6ab6-63') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:29:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1511709584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1511709584',id=10,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzJQXzt1AYOf4lFnoJZvCjH3+G3z3Xlj83+ey7m3OEW9t8n5k8TLfR+L2ikcKnDMFMmln4QvSg9XLtbDzFTnjllywjp5FJCi4mQrVJZGB6DYL5ifjmZNLoATW9/WbDgrg==',key_name='tempest-keypair-1404432695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed98064a134b4603bbf641f45988564a',ramdisk_id='',reservation_id='r-ezox3prz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-350828706',owner_user_name='tempest-TaggedBootDevicesTest-350828706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:29:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1cf68007f18458b9824e056151f5c57',uuid=d8867363-6e36-4b34-9cc1-f30fbc572720,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c698ebb6-016a-4988-8c8a-7a75252a7944", "address": "fa:16:3e:c8:f3:a6", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc698ebb6-01", "ovs_interfaceid": "c698ebb6-016a-4988-8c8a-7a75252a7944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converting VIF {"id": "c698ebb6-016a-4988-8c8a-7a75252a7944", "address": "fa:16:3e:c8:f3:a6", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc698ebb6-01", "ovs_interfaceid": "c698ebb6-016a-4988-8c8a-7a75252a7944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:f3:a6,bridge_name='br-int',has_traffic_filtering=True,id=c698ebb6-016a-4988-8c8a-7a75252a7944,network=Network(623863b1-0de3-49d4-b240-59885c22eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc698ebb6-01') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:29:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1511709584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1511709584',id=10,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzJQXzt1AYOf4lFnoJZvCjH3+G3z3Xlj83+ey7m3OEW9t8n5k8TLfR+L2ikcKnDMFMmln4QvSg9XLtbDzFTnjllywjp5FJCi4mQrVJZGB6DYL5ifjmZNLoATW9/WbDgrg==',key_name='tempest-keypair-1404432695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed98064a134b4603bbf641f45988564a',ramdisk_id='',reservation_id='r-ezox3prz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-350828706',owner_user_name='tempest-TaggedBootDevicesTest-350828706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:29:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1cf68007f18458b9824e056151f5c57',uuid=d8867363-6e36-4b34-9cc1-f30fbc572720,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb10902a-003e-4c1a-85a8-194f040a1ffb", "address": "fa:16:3e:36:6f:30", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb10902a-00", "ovs_interfaceid": "bb10902a-003e-4c1a-85a8-194f040a1ffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converting VIF {"id": "bb10902a-003e-4c1a-85a8-194f040a1ffb", "address": "fa:16:3e:36:6f:30", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb10902a-00", "ovs_interfaceid": "bb10902a-003e-4c1a-85a8-194f040a1ffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:6f:30,bridge_name='br-int',has_traffic_filtering=True,id=bb10902a-003e-4c1a-85a8-194f040a1ffb,network=Network(623863b1-0de3-49d4-b240-59885c22eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbb10902a-00') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:29:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1511709584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1511709584',id=10,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzJQXzt1AYOf4lFnoJZvCjH3+G3z3Xlj83+ey7m3OEW9t8n5k8TLfR+L2ikcKnDMFMmln4QvSg9XLtbDzFTnjllywjp5FJCi4mQrVJZGB6DYL5ifjmZNLoATW9/WbDgrg==',key_name='tempest-keypair-1404432695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed98064a134b4603bbf641f45988564a',ramdisk_id='',reservation_id='r-ezox3prz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-350828706',owner_user_name='tempest-TaggedBootDevicesTest-350828706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:29:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1cf68007f18458b9824e056151f5c57',uuid=d8867363-6e36-4b34-9cc1-f30fbc572720,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "389d5d9e-e5fc-48f1-b443-b04d08ec6181", "address": "fa:16:3e:9e:00:f4", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap389d5d9e-e5", "ovs_interfaceid": "389d5d9e-e5fc-48f1-b443-b04d08ec6181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converting VIF {"id": "389d5d9e-e5fc-48f1-b443-b04d08ec6181", "address": "fa:16:3e:9e:00:f4", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap389d5d9e-e5", "ovs_interfaceid": "389d5d9e-e5fc-48f1-b443-b04d08ec6181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:00:f4,bridge_name='br-int',has_traffic_filtering=True,id=389d5d9e-e5fc-48f1-b443-b04d08ec6181,network=Network(623863b1-0de3-49d4-b240-59885c22eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap389d5d9e-e5') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:29:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1511709584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1511709584',id=10,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzJQXzt1AYOf4lFnoJZvCjH3+G3z3Xlj83+ey7m3OEW9t8n5k8TLfR+L2ikcKnDMFMmln4QvSg9XLtbDzFTnjllywjp5FJCi4mQrVJZGB6DYL5ifjmZNLoATW9/WbDgrg==',key_name='tempest-keypair-1404432695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed98064a134b4603bbf641f45988564a',ramdisk_id='',reservation_id='r-ezox3prz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-350828706',owner_user_name='tempest-TaggedBootDevicesTest-350828706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:29:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1cf68007f18458b9824e056151f5c57',uuid=d8867363-6e36-4b34-9cc1-f30fbc572720,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf6a7707-9d55-46b2-8738-06505013048b", "address": "fa:16:3e:be:d3:4b", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6a7707-9d", "ovs_interfaceid": "bf6a7707-9d55-46b2-8738-06505013048b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converting VIF {"id": "bf6a7707-9d55-46b2-8738-06505013048b", "address": "fa:16:3e:be:d3:4b", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6a7707-9d", "ovs_interfaceid": "bf6a7707-9d55-46b2-8738-06505013048b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:d3:4b,bridge_name='br-int',has_traffic_filtering=True,id=bf6a7707-9d55-46b2-8738-06505013048b,network=Network(623863b1-0de3-49d4-b240-59885c22eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6a7707-9d') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:29:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1511709584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1511709584',id=10,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzJQXzt1AYOf4lFnoJZvCjH3+G3z3Xlj83+ey7m3OEW9t8n5k8TLfR+L2ikcKnDMFMmln4QvSg9XLtbDzFTnjllywjp5FJCi4mQrVJZGB6DYL5ifjmZNLoATW9/WbDgrg==',key_name='tempest-keypair-1404432695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed98064a134b4603bbf641f45988564a',ramdisk_id='',reservation_id='r-ezox3prz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-350828706',owner_user_name='tempest-TaggedBootDevicesTest-350828706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:29:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1cf68007f18458b9824e056151f5c57',uuid=d8867363-6e36-4b34-9cc1-f30fbc572720,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9757213-2bc0-46a5-bffa-3b503c65ecc2", "address": "fa:16:3e:03:d8:98", "network": {"id": "f67d6710-fe9f-4d97-935e-535e0202f0ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048697198", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9757213-2b", "ovs_interfaceid": "e9757213-2bc0-46a5-bffa-3b503c65ecc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converting VIF {"id": "e9757213-2bc0-46a5-bffa-3b503c65ecc2", "address": "fa:16:3e:03:d8:98", "network": {"id": "f67d6710-fe9f-4d97-935e-535e0202f0ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048697198", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9757213-2b", "ovs_interfaceid": "e9757213-2bc0-46a5-bffa-3b503c65ecc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:d8:98,bridge_name='br-int',has_traffic_filtering=True,id=e9757213-2bc0-46a5-bffa-3b503c65ecc2,network=Network(f67d6710-fe9f-4d97-935e-535e0202f0ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9757213-2b') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:29:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1511709584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1511709584',id=10,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzJQXzt1AYOf4lFnoJZvCjH3+G3z3Xlj83+ey7m3OEW9t8n5k8TLfR+L2ikcKnDMFMmln4QvSg9XLtbDzFTnjllywjp5FJCi4mQrVJZGB6DYL5ifjmZNLoATW9/WbDgrg==',key_name='tempest-keypair-1404432695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed98064a134b4603bbf641f45988564a',ramdisk_id='',reservation_id='r-ezox3prz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-350828706',owner_user_name='tempest-TaggedBootDevicesTest-350828706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:29:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1cf68007f18458b9824e056151f5c57',uuid=d8867363-6e36-4b34-9cc1-f30fbc572720,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f2ec393-bb3c-4986-bd50-44ae9a7147b0", "address": "fa:16:3e:4c:1b:5c", "network": {"id": "f67d6710-fe9f-4d97-935e-535e0202f0ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048697198", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f2ec393-bb", "ovs_interfaceid": "6f2ec393-bb3c-4986-bd50-44ae9a7147b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converting VIF {"id": "6f2ec393-bb3c-4986-bd50-44ae9a7147b0", "address": "fa:16:3e:4c:1b:5c", "network": {"id": "f67d6710-fe9f-4d97-935e-535e0202f0ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048697198", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f2ec393-bb", "ovs_interfaceid": "6f2ec393-bb3c-4986-bd50-44ae9a7147b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:1b:5c,bridge_name='br-int',has_traffic_filtering=True,id=6f2ec393-bb3c-4986-bd50-44ae9a7147b0,network=Network(f67d6710-fe9f-4d97-935e-535e0202f0ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f2ec393-bb') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.objects.instance [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lazy-loading 'pci_devices' on Instance uuid d8867363-6e36-4b34-9cc1-f30fbc572720 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:29:48 user nova-compute[71321]:   <uuid>d8867363-6e36-4b34-9cc1-f30fbc572720</uuid>
Apr 12 12:29:48 user nova-compute[71321]:   <name>instance-0000000a</name>
Apr 12 12:29:48 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:29:48 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:29:48 user nova-compute[71321]:   <metadata>
Apr 12 12:29:48 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:29:48 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:29:48 user nova-compute[71321]:       <nova:name>tempest-device-tagging-server-1511709584</nova:name>
Apr 12 12:29:48 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:29:44</nova:creationTime>
Apr 12 12:29:48 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:29:48 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:29:48 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:29:48 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:29:48 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:29:48 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:29:48 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:29:48 user nova-compute[71321]:       <nova:owner>
Apr 12 12:29:48 user nova-compute[71321]:         <nova:user uuid="b1cf68007f18458b9824e056151f5c57">tempest-TaggedBootDevicesTest-350828706-project-member</nova:user>
Apr 12 12:29:48 user nova-compute[71321]:         <nova:project uuid="ed98064a134b4603bbf641f45988564a">tempest-TaggedBootDevicesTest-350828706</nova:project>
Apr 12 12:29:48 user nova-compute[71321]:       </nova:owner>
Apr 12 12:29:48 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:29:48 user nova-compute[71321]:       <nova:ports>
Apr 12 12:29:48 user nova-compute[71321]:         <nova:port uuid="93bb6ab6-63a2-421a-b331-92c957f29f5a">
Apr 12 12:29:48 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 12:29:48 user nova-compute[71321]:         </nova:port>
Apr 12 12:29:48 user nova-compute[71321]:         <nova:port uuid="c698ebb6-016a-4988-8c8a-7a75252a7944">
Apr 12 12:29:48 user nova-compute[71321]:           <nova:ip type="fixed" address="10.1.1.83" ipVersion="4"/>
Apr 12 12:29:48 user nova-compute[71321]:         </nova:port>
Apr 12 12:29:48 user nova-compute[71321]:         <nova:port uuid="bb10902a-003e-4c1a-85a8-194f040a1ffb">
Apr 12 12:29:48 user nova-compute[71321]:           <nova:ip type="fixed" address="10.1.1.69" ipVersion="4"/>
Apr 12 12:29:48 user nova-compute[71321]:         </nova:port>
Apr 12 12:29:48 user nova-compute[71321]:         <nova:port uuid="389d5d9e-e5fc-48f1-b443-b04d08ec6181">
Apr 12 12:29:48 user nova-compute[71321]:           <nova:ip type="fixed" address="10.1.1.208" ipVersion="4"/>
Apr 12 12:29:48 user nova-compute[71321]:         </nova:port>
Apr 12 12:29:48 user nova-compute[71321]:         <nova:port uuid="bf6a7707-9d55-46b2-8738-06505013048b">
Apr 12 12:29:48 user nova-compute[71321]:           <nova:ip type="fixed" address="10.1.1.63" ipVersion="4"/>
Apr 12 12:29:48 user nova-compute[71321]:         </nova:port>
Apr 12 12:29:48 user nova-compute[71321]:         <nova:port uuid="e9757213-2bc0-46a5-bffa-3b503c65ecc2">
Apr 12 12:29:48 user nova-compute[71321]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 12 12:29:48 user nova-compute[71321]:         </nova:port>
Apr 12 12:29:48 user nova-compute[71321]:         <nova:port uuid="6f2ec393-bb3c-4986-bd50-44ae9a7147b0">
Apr 12 12:29:48 user nova-compute[71321]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 12 12:29:48 user nova-compute[71321]:         </nova:port>
Apr 12 12:29:48 user nova-compute[71321]:       </nova:ports>
Apr 12 12:29:48 user nova-compute[71321]:     </nova:instance>
Apr 12 12:29:48 user nova-compute[71321]:   </metadata>
Apr 12 12:29:48 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:29:48 user nova-compute[71321]:     <system>
Apr 12 12:29:48 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:29:48 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:29:48 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:29:48 user nova-compute[71321]:       <entry name="serial">d8867363-6e36-4b34-9cc1-f30fbc572720</entry>
Apr 12 12:29:48 user nova-compute[71321]:       <entry name="uuid">d8867363-6e36-4b34-9cc1-f30fbc572720</entry>
Apr 12 12:29:48 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:29:48 user nova-compute[71321]:     </system>
Apr 12 12:29:48 user nova-compute[71321]:   </sysinfo>
Apr 12 12:29:48 user nova-compute[71321]:   <os>
Apr 12 12:29:48 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:29:48 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:29:48 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:29:48 user nova-compute[71321]:   </os>
Apr 12 12:29:48 user nova-compute[71321]:   <features>
Apr 12 12:29:48 user nova-compute[71321]:     <acpi/>
Apr 12 12:29:48 user nova-compute[71321]:     <apic/>
Apr 12 12:29:48 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:29:48 user nova-compute[71321]:   </features>
Apr 12 12:29:48 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:29:48 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:29:48 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:29:48 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:29:48 user nova-compute[71321]:   </clock>
Apr 12 12:29:48 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:29:48 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:29:48 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:29:48 user nova-compute[71321]:   </cpu>
Apr 12 12:29:48 user nova-compute[71321]:   <devices>
Apr 12 12:29:48 user nova-compute[71321]:     <disk type="file" device="cdrom">
Apr 12 12:29:48 user nova-compute[71321]:       <driver name="qemu" type="raw" cache="none"/>
Apr 12 12:29:48 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/d8867363-6e36-4b34-9cc1-f30fbc572720/disk.config"/>
Apr 12 12:29:48 user nova-compute[71321]:       <target dev="hda" bus="ide"/>
Apr 12 12:29:48 user nova-compute[71321]:     </disk>
Apr 12 12:29:48 user nova-compute[71321]:     <disk type="block" device="disk">
Apr 12 12:29:48 user nova-compute[71321]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:29:48 user nova-compute[71321]:       <source dev="/dev/sdc"/>
Apr 12 12:29:48 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:29:48 user nova-compute[71321]:       <serial>79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc</serial>
Apr 12 12:29:48 user nova-compute[71321]:     </disk>
Apr 12 12:29:48 user nova-compute[71321]:     <disk type="block" device="disk">
Apr 12 12:29:48 user nova-compute[71321]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:29:48 user nova-compute[71321]:       <source dev="/dev/sdd"/>
Apr 12 12:29:48 user nova-compute[71321]:       <target dev="vdb" bus="virtio"/>
Apr 12 12:29:48 user nova-compute[71321]:       <serial>b0cc7840-90f7-4311-8c15-78c644bad569</serial>
Apr 12 12:29:48 user nova-compute[71321]:     </disk>
Apr 12 12:29:48 user nova-compute[71321]:     <disk type="block" device="disk">
Apr 12 12:29:48 user nova-compute[71321]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:29:48 user nova-compute[71321]:       <source dev="/dev/sde"/>
Apr 12 12:29:48 user nova-compute[71321]:       <target dev="vdc" bus="virtio"/>
Apr 12 12:29:48 user nova-compute[71321]:       <serial>03750d10-be51-41e7-8ffe-78d0af572b24</serial>
Apr 12 12:29:48 user nova-compute[71321]:     </disk>
Apr 12 12:29:48 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:29:48 user nova-compute[71321]:       <mac address="fa:16:3e:79:39:dc"/>
Apr 12 12:29:48 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:29:48 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:29:48 user nova-compute[71321]:       <target dev="tap93bb6ab6-63"/>
Apr 12 12:29:48 user nova-compute[71321]:     </interface>
Apr 12 12:29:48 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:29:48 user nova-compute[71321]:       <mac address="fa:16:3e:c8:f3:a6"/>
Apr 12 12:29:48 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:29:48 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:29:48 user nova-compute[71321]:       <target dev="tapc698ebb6-01"/>
Apr 12 12:29:48 user nova-compute[71321]:     </interface>
Apr 12 12:29:48 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:29:48 user nova-compute[71321]:       <mac address="fa:16:3e:36:6f:30"/>
Apr 12 12:29:48 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:29:48 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:29:48 user nova-compute[71321]:       <target dev="tapbb10902a-00"/>
Apr 12 12:29:48 user nova-compute[71321]:     </interface>
Apr 12 12:29:48 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:29:48 user nova-compute[71321]:       <mac address="fa:16:3e:9e:00:f4"/>
Apr 12 12:29:48 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:29:48 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:29:48 user nova-compute[71321]:       <target dev="tap389d5d9e-e5"/>
Apr 12 12:29:48 user nova-compute[71321]:     </interface>
Apr 12 12:29:48 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:29:48 user nova-compute[71321]:       <mac address="fa:16:3e:be:d3:4b"/>
Apr 12 12:29:48 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:29:48 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:29:48 user nova-compute[71321]:       <target dev="tapbf6a7707-9d"/>
Apr 12 12:29:48 user nova-compute[71321]:     </interface>
Apr 12 12:29:48 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:29:48 user nova-compute[71321]:       <mac address="fa:16:3e:03:d8:98"/>
Apr 12 12:29:48 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:29:48 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:29:48 user nova-compute[71321]:       <target dev="tape9757213-2b"/>
Apr 12 12:29:48 user nova-compute[71321]:     </interface>
Apr 12 12:29:48 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:29:48 user nova-compute[71321]:       <mac address="fa:16:3e:4c:1b:5c"/>
Apr 12 12:29:48 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:29:48 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:29:48 user nova-compute[71321]:       <target dev="tap6f2ec393-bb"/>
Apr 12 12:29:48 user nova-compute[71321]:     </interface>
Apr 12 12:29:48 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:29:48 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/d8867363-6e36-4b34-9cc1-f30fbc572720/console.log" append="off"/>
Apr 12 12:29:48 user nova-compute[71321]:     </serial>
Apr 12 12:29:48 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:29:48 user nova-compute[71321]:     <video>
Apr 12 12:29:48 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:29:48 user nova-compute[71321]:     </video>
Apr 12 12:29:48 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:29:48 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:29:48 user nova-compute[71321]:     </rng>
Apr 12 12:29:48 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:29:48 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:29:48 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:29:48 user nova-compute[71321]:     </memballoon>
Apr 12 12:29:48 user nova-compute[71321]:   </devices>
Apr 12 12:29:48 user nova-compute[71321]: </domain>
Apr 12 12:29:48 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:29:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1511709584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1511709584',id=10,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzJQXzt1AYOf4lFnoJZvCjH3+G3z3Xlj83+ey7m3OEW9t8n5k8TLfR+L2ikcKnDMFMmln4QvSg9XLtbDzFTnjllywjp5FJCi4mQrVJZGB6DYL5ifjmZNLoATW9/WbDgrg==',key_name='tempest-keypair-1404432695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed98064a134b4603bbf641f45988564a',ramdisk_id='',reservation_id='r-ezox3prz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-350828706',owner_user_name='tempest-TaggedBootDevicesTest-350828706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:29:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1cf68007f18458b9824e056151f5c57',uuid=d8867363-6e36-4b34-9cc1-f30fbc572720,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93bb6ab6-63a2-421a-b331-92c957f29f5a", "address": "fa:16:3e:79:39:dc", "network": {"id": "200ada24-4b99-42e5-9085-07900a59a716", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1440676334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bb6ab6-63", "ovs_interfaceid": "93bb6ab6-63a2-421a-b331-92c957f29f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converting VIF {"id": "93bb6ab6-63a2-421a-b331-92c957f29f5a", "address": "fa:16:3e:79:39:dc", "network": {"id": "200ada24-4b99-42e5-9085-07900a59a716", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1440676334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bb6ab6-63", "ovs_interfaceid": "93bb6ab6-63a2-421a-b331-92c957f29f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:39:dc,bridge_name='br-int',has_traffic_filtering=True,id=93bb6ab6-63a2-421a-b331-92c957f29f5a,network=Network(200ada24-4b99-42e5-9085-07900a59a716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93bb6ab6-63') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG os_vif [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:39:dc,bridge_name='br-int',has_traffic_filtering=True,id=93bb6ab6-63a2-421a-b331-92c957f29f5a,network=Network(200ada24-4b99-42e5-9085-07900a59a716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93bb6ab6-63') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93bb6ab6-63, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap93bb6ab6-63, col_values=(('external_ids', {'iface-id': '93bb6ab6-63a2-421a-b331-92c957f29f5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:39:dc', 'vm-uuid': 'd8867363-6e36-4b34-9cc1-f30fbc572720'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:48 user nova-compute[71321]: INFO os_vif [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:39:dc,bridge_name='br-int',has_traffic_filtering=True,id=93bb6ab6-63a2-421a-b331-92c957f29f5a,network=Network(200ada24-4b99-42e5-9085-07900a59a716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93bb6ab6-63')
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:29:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1511709584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1511709584',id=10,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzJQXzt1AYOf4lFnoJZvCjH3+G3z3Xlj83+ey7m3OEW9t8n5k8TLfR+L2ikcKnDMFMmln4QvSg9XLtbDzFTnjllywjp5FJCi4mQrVJZGB6DYL5ifjmZNLoATW9/WbDgrg==',key_name='tempest-keypair-1404432695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed98064a134b4603bbf641f45988564a',ramdisk_id='',reservation_id='r-ezox3prz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-350828706',owner_user_name='tempest-TaggedBootDevicesTest-350828706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:29:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1cf68007f18458b9824e056151f5c57',uuid=d8867363-6e36-4b34-9cc1-f30fbc572720,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c698ebb6-016a-4988-8c8a-7a75252a7944", "address": "fa:16:3e:c8:f3:a6", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc698ebb6-01", "ovs_interfaceid": "c698ebb6-016a-4988-8c8a-7a75252a7944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converting VIF {"id": "c698ebb6-016a-4988-8c8a-7a75252a7944", "address": "fa:16:3e:c8:f3:a6", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc698ebb6-01", "ovs_interfaceid": "c698ebb6-016a-4988-8c8a-7a75252a7944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:f3:a6,bridge_name='br-int',has_traffic_filtering=True,id=c698ebb6-016a-4988-8c8a-7a75252a7944,network=Network(623863b1-0de3-49d4-b240-59885c22eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc698ebb6-01') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG os_vif [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:f3:a6,bridge_name='br-int',has_traffic_filtering=True,id=c698ebb6-016a-4988-8c8a-7a75252a7944,network=Network(623863b1-0de3-49d4-b240-59885c22eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc698ebb6-01') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc698ebb6-01, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc698ebb6-01, col_values=(('external_ids', {'iface-id': 'c698ebb6-016a-4988-8c8a-7a75252a7944', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:f3:a6', 'vm-uuid': 'd8867363-6e36-4b34-9cc1-f30fbc572720'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:48 user nova-compute[71321]: INFO os_vif [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:f3:a6,bridge_name='br-int',has_traffic_filtering=True,id=c698ebb6-016a-4988-8c8a-7a75252a7944,network=Network(623863b1-0de3-49d4-b240-59885c22eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc698ebb6-01')
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:29:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1511709584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1511709584',id=10,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzJQXzt1AYOf4lFnoJZvCjH3+G3z3Xlj83+ey7m3OEW9t8n5k8TLfR+L2ikcKnDMFMmln4QvSg9XLtbDzFTnjllywjp5FJCi4mQrVJZGB6DYL5ifjmZNLoATW9/WbDgrg==',key_name='tempest-keypair-1404432695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed98064a134b4603bbf641f45988564a',ramdisk_id='',reservation_id='r-ezox3prz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-350828706',owner_user_name='tempest-TaggedBootDevicesTest-350828706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:29:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1cf68007f18458b9824e056151f5c57',uuid=d8867363-6e36-4b34-9cc1-f30fbc572720,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb10902a-003e-4c1a-85a8-194f040a1ffb", "address": "fa:16:3e:36:6f:30", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb10902a-00", "ovs_interfaceid": "bb10902a-003e-4c1a-85a8-194f040a1ffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converting VIF {"id": "bb10902a-003e-4c1a-85a8-194f040a1ffb", "address": "fa:16:3e:36:6f:30", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb10902a-00", "ovs_interfaceid": "bb10902a-003e-4c1a-85a8-194f040a1ffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:6f:30,bridge_name='br-int',has_traffic_filtering=True,id=bb10902a-003e-4c1a-85a8-194f040a1ffb,network=Network(623863b1-0de3-49d4-b240-59885c22eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbb10902a-00') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG os_vif [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:6f:30,bridge_name='br-int',has_traffic_filtering=True,id=bb10902a-003e-4c1a-85a8-194f040a1ffb,network=Network(623863b1-0de3-49d4-b240-59885c22eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbb10902a-00') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb10902a-00, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbb10902a-00, col_values=(('external_ids', {'iface-id': 'bb10902a-003e-4c1a-85a8-194f040a1ffb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:6f:30', 'vm-uuid': 'd8867363-6e36-4b34-9cc1-f30fbc572720'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:48 user nova-compute[71321]: INFO os_vif [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:6f:30,bridge_name='br-int',has_traffic_filtering=True,id=bb10902a-003e-4c1a-85a8-194f040a1ffb,network=Network(623863b1-0de3-49d4-b240-59885c22eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbb10902a-00')
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:29:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1511709584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1511709584',id=10,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzJQXzt1AYOf4lFnoJZvCjH3+G3z3Xlj83+ey7m3OEW9t8n5k8TLfR+L2ikcKnDMFMmln4QvSg9XLtbDzFTnjllywjp5FJCi4mQrVJZGB6DYL5ifjmZNLoATW9/WbDgrg==',key_name='tempest-keypair-1404432695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed98064a134b4603bbf641f45988564a',ramdisk_id='',reservation_id='r-ezox3prz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-350828706',owner_user_name='tempest-TaggedBootDevicesTest-350828706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:29:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1cf68007f18458b9824e056151f5c57',uuid=d8867363-6e36-4b34-9cc1-f30fbc572720,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "389d5d9e-e5fc-48f1-b443-b04d08ec6181", "address": "fa:16:3e:9e:00:f4", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap389d5d9e-e5", "ovs_interfaceid": "389d5d9e-e5fc-48f1-b443-b04d08ec6181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converting VIF {"id": "389d5d9e-e5fc-48f1-b443-b04d08ec6181", "address": "fa:16:3e:9e:00:f4", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap389d5d9e-e5", "ovs_interfaceid": "389d5d9e-e5fc-48f1-b443-b04d08ec6181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:00:f4,bridge_name='br-int',has_traffic_filtering=True,id=389d5d9e-e5fc-48f1-b443-b04d08ec6181,network=Network(623863b1-0de3-49d4-b240-59885c22eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap389d5d9e-e5') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG os_vif [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:00:f4,bridge_name='br-int',has_traffic_filtering=True,id=389d5d9e-e5fc-48f1-b443-b04d08ec6181,network=Network(623863b1-0de3-49d4-b240-59885c22eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap389d5d9e-e5') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap389d5d9e-e5, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap389d5d9e-e5, col_values=(('external_ids', {'iface-id': '389d5d9e-e5fc-48f1-b443-b04d08ec6181', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:00:f4', 'vm-uuid': 'd8867363-6e36-4b34-9cc1-f30fbc572720'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:48 user nova-compute[71321]: INFO os_vif [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:00:f4,bridge_name='br-int',has_traffic_filtering=True,id=389d5d9e-e5fc-48f1-b443-b04d08ec6181,network=Network(623863b1-0de3-49d4-b240-59885c22eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap389d5d9e-e5')
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:29:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1511709584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1511709584',id=10,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzJQXzt1AYOf4lFnoJZvCjH3+G3z3Xlj83+ey7m3OEW9t8n5k8TLfR+L2ikcKnDMFMmln4QvSg9XLtbDzFTnjllywjp5FJCi4mQrVJZGB6DYL5ifjmZNLoATW9/WbDgrg==',key_name='tempest-keypair-1404432695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed98064a134b4603bbf641f45988564a',ramdisk_id='',reservation_id='r-ezox3prz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-350828706',owner_user_name='tempest-TaggedBootDevicesTest-350828706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:29:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1cf68007f18458b9824e056151f5c57',uuid=d8867363-6e36-4b34-9cc1-f30fbc572720,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf6a7707-9d55-46b2-8738-06505013048b", "address": "fa:16:3e:be:d3:4b", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6a7707-9d", "ovs_interfaceid": "bf6a7707-9d55-46b2-8738-06505013048b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converting VIF {"id": "bf6a7707-9d55-46b2-8738-06505013048b", "address": "fa:16:3e:be:d3:4b", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6a7707-9d", "ovs_interfaceid": "bf6a7707-9d55-46b2-8738-06505013048b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:d3:4b,bridge_name='br-int',has_traffic_filtering=True,id=bf6a7707-9d55-46b2-8738-06505013048b,network=Network(623863b1-0de3-49d4-b240-59885c22eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6a7707-9d') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG os_vif [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:d3:4b,bridge_name='br-int',has_traffic_filtering=True,id=bf6a7707-9d55-46b2-8738-06505013048b,network=Network(623863b1-0de3-49d4-b240-59885c22eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6a7707-9d') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf6a7707-9d, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbf6a7707-9d, col_values=(('external_ids', {'iface-id': 'bf6a7707-9d55-46b2-8738-06505013048b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:d3:4b', 'vm-uuid': 'd8867363-6e36-4b34-9cc1-f30fbc572720'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:48 user nova-compute[71321]: INFO os_vif [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:d3:4b,bridge_name='br-int',has_traffic_filtering=True,id=bf6a7707-9d55-46b2-8738-06505013048b,network=Network(623863b1-0de3-49d4-b240-59885c22eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6a7707-9d')
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:29:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1511709584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1511709584',id=10,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzJQXzt1AYOf4lFnoJZvCjH3+G3z3Xlj83+ey7m3OEW9t8n5k8TLfR+L2ikcKnDMFMmln4QvSg9XLtbDzFTnjllywjp5FJCi4mQrVJZGB6DYL5ifjmZNLoATW9/WbDgrg==',key_name='tempest-keypair-1404432695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed98064a134b4603bbf641f45988564a',ramdisk_id='',reservation_id='r-ezox3prz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-350828706',owner_user_name='tempest-TaggedBootDevicesTest-350828706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:29:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1cf68007f18458b9824e056151f5c57',uuid=d8867363-6e36-4b34-9cc1-f30fbc572720,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9757213-2bc0-46a5-bffa-3b503c65ecc2", "address": "fa:16:3e:03:d8:98", "network": {"id": "f67d6710-fe9f-4d97-935e-535e0202f0ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048697198", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9757213-2b", "ovs_interfaceid": "e9757213-2bc0-46a5-bffa-3b503c65ecc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converting VIF {"id": "e9757213-2bc0-46a5-bffa-3b503c65ecc2", "address": "fa:16:3e:03:d8:98", "network": {"id": "f67d6710-fe9f-4d97-935e-535e0202f0ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048697198", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9757213-2b", "ovs_interfaceid": "e9757213-2bc0-46a5-bffa-3b503c65ecc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:d8:98,bridge_name='br-int',has_traffic_filtering=True,id=e9757213-2bc0-46a5-bffa-3b503c65ecc2,network=Network(f67d6710-fe9f-4d97-935e-535e0202f0ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9757213-2b') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG os_vif [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:d8:98,bridge_name='br-int',has_traffic_filtering=True,id=e9757213-2bc0-46a5-bffa-3b503c65ecc2,network=Network(f67d6710-fe9f-4d97-935e-535e0202f0ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9757213-2b') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9757213-2b, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape9757213-2b, col_values=(('external_ids', {'iface-id': 'e9757213-2bc0-46a5-bffa-3b503c65ecc2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:d8:98', 'vm-uuid': 'd8867363-6e36-4b34-9cc1-f30fbc572720'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:29:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:29:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:49 user nova-compute[71321]: INFO os_vif [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:d8:98,bridge_name='br-int',has_traffic_filtering=True,id=e9757213-2bc0-46a5-bffa-3b503c65ecc2,network=Network(f67d6710-fe9f-4d97-935e-535e0202f0ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9757213-2b')
Apr 12 12:29:49 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:29:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1511709584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1511709584',id=10,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzJQXzt1AYOf4lFnoJZvCjH3+G3z3Xlj83+ey7m3OEW9t8n5k8TLfR+L2ikcKnDMFMmln4QvSg9XLtbDzFTnjllywjp5FJCi4mQrVJZGB6DYL5ifjmZNLoATW9/WbDgrg==',key_name='tempest-keypair-1404432695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed98064a134b4603bbf641f45988564a',ramdisk_id='',reservation_id='r-ezox3prz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-350828706',owner_user_name='tempest-TaggedBootDevicesTest-350828706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:29:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1cf68007f18458b9824e056151f5c57',uuid=d8867363-6e36-4b34-9cc1-f30fbc572720,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f2ec393-bb3c-4986-bd50-44ae9a7147b0", "address": "fa:16:3e:4c:1b:5c", "network": {"id": "f67d6710-fe9f-4d97-935e-535e0202f0ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048697198", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f2ec393-bb", "ovs_interfaceid": "6f2ec393-bb3c-4986-bd50-44ae9a7147b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:29:49 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converting VIF {"id": "6f2ec393-bb3c-4986-bd50-44ae9a7147b0", "address": "fa:16:3e:4c:1b:5c", "network": {"id": "f67d6710-fe9f-4d97-935e-535e0202f0ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048697198", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f2ec393-bb", "ovs_interfaceid": "6f2ec393-bb3c-4986-bd50-44ae9a7147b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:29:49 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:1b:5c,bridge_name='br-int',has_traffic_filtering=True,id=6f2ec393-bb3c-4986-bd50-44ae9a7147b0,network=Network(f67d6710-fe9f-4d97-935e-535e0202f0ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f2ec393-bb') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:29:49 user nova-compute[71321]: DEBUG os_vif [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:1b:5c,bridge_name='br-int',has_traffic_filtering=True,id=6f2ec393-bb3c-4986-bd50-44ae9a7147b0,network=Network(f67d6710-fe9f-4d97-935e-535e0202f0ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f2ec393-bb') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:29:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:29:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:29:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f2ec393-bb, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:29:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6f2ec393-bb, col_values=(('external_ids', {'iface-id': '6f2ec393-bb3c-4986-bd50-44ae9a7147b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:1b:5c', 'vm-uuid': 'd8867363-6e36-4b34-9cc1-f30fbc572720'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:29:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:29:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:49 user nova-compute[71321]: INFO os_vif [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:1b:5c,bridge_name='br-int',has_traffic_filtering=True,id=6f2ec393-bb3c-4986-bd50-44ae9a7147b0,network=Network(f67d6710-fe9f-4d97-935e-535e0202f0ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f2ec393-bb')
Apr 12 12:29:49 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] No BDM found with device name hda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:29:49 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:29:49 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] No VIF found with MAC fa:16:3e:79:39:dc, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:29:49 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] No VIF found with MAC fa:16:3e:be:d3:4b, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:29:49 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Using config drive
Apr 12 12:29:49 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Creating config drive at /opt/stack/data/nova/instances/d8867363-6e36-4b34-9cc1-f30fbc572720/disk.config
Apr 12 12:29:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d8867363-6e36-4b34-9cc1-f30fbc572720/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmps03ek9z9 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:29:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d8867363-6e36-4b34-9cc1-f30fbc572720/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmps03ek9z9" returned: 0 in 0.058s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:29:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:51 user nova-compute[71321]: DEBUG nova.compute.manager [req-f27af70e-6260-4ab4-85cd-d3409afdc6b8 req-577917e9-7845-4aa4-903d-24e35fd39089 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-plugged-93bb6ab6-63a2-421a-b331-92c957f29f5a {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:29:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f27af70e-6260-4ab4-85cd-d3409afdc6b8 req-577917e9-7845-4aa4-903d-24e35fd39089 service nova] Acquiring lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f27af70e-6260-4ab4-85cd-d3409afdc6b8 req-577917e9-7845-4aa4-903d-24e35fd39089 service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f27af70e-6260-4ab4-85cd-d3409afdc6b8 req-577917e9-7845-4aa4-903d-24e35fd39089 service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:51 user nova-compute[71321]: DEBUG nova.compute.manager [req-f27af70e-6260-4ab4-85cd-d3409afdc6b8 req-577917e9-7845-4aa4-903d-24e35fd39089 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] No waiting events found dispatching network-vif-plugged-93bb6ab6-63a2-421a-b331-92c957f29f5a {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:29:51 user nova-compute[71321]: WARNING nova.compute.manager [req-f27af70e-6260-4ab4-85cd-d3409afdc6b8 req-577917e9-7845-4aa4-903d-24e35fd39089 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received unexpected event network-vif-plugged-93bb6ab6-63a2-421a-b331-92c957f29f5a for instance with vm_state building and task_state spawning.
Apr 12 12:29:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:51 user nova-compute[71321]: DEBUG nova.compute.manager [req-e82a500f-0056-4d92-ba5f-acf546fa9e17 req-1c32039e-41ce-47e4-a4bf-df9fe6938562 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-plugged-c698ebb6-016a-4988-8c8a-7a75252a7944 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:29:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e82a500f-0056-4d92-ba5f-acf546fa9e17 req-1c32039e-41ce-47e4-a4bf-df9fe6938562 service nova] Acquiring lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e82a500f-0056-4d92-ba5f-acf546fa9e17 req-1c32039e-41ce-47e4-a4bf-df9fe6938562 service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e82a500f-0056-4d92-ba5f-acf546fa9e17 req-1c32039e-41ce-47e4-a4bf-df9fe6938562 service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:51 user nova-compute[71321]: DEBUG nova.compute.manager [req-e82a500f-0056-4d92-ba5f-acf546fa9e17 req-1c32039e-41ce-47e4-a4bf-df9fe6938562 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] No waiting events found dispatching network-vif-plugged-c698ebb6-016a-4988-8c8a-7a75252a7944 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:29:51 user nova-compute[71321]: WARNING nova.compute.manager [req-e82a500f-0056-4d92-ba5f-acf546fa9e17 req-1c32039e-41ce-47e4-a4bf-df9fe6938562 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received unexpected event network-vif-plugged-c698ebb6-016a-4988-8c8a-7a75252a7944 for instance with vm_state building and task_state spawning.
Apr 12 12:29:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:52 user nova-compute[71321]: DEBUG nova.compute.manager [req-89853f93-38c5-4bd2-b032-c229b4fc28c4 req-3983b4cc-48f5-493e-bba9-7a996ba61149 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-plugged-bf6a7707-9d55-46b2-8738-06505013048b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:29:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-89853f93-38c5-4bd2-b032-c229b4fc28c4 req-3983b4cc-48f5-493e-bba9-7a996ba61149 service nova] Acquiring lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-89853f93-38c5-4bd2-b032-c229b4fc28c4 req-3983b4cc-48f5-493e-bba9-7a996ba61149 service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-89853f93-38c5-4bd2-b032-c229b4fc28c4 req-3983b4cc-48f5-493e-bba9-7a996ba61149 service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:52 user nova-compute[71321]: DEBUG nova.compute.manager [req-89853f93-38c5-4bd2-b032-c229b4fc28c4 req-3983b4cc-48f5-493e-bba9-7a996ba61149 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] No waiting events found dispatching network-vif-plugged-bf6a7707-9d55-46b2-8738-06505013048b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:29:52 user nova-compute[71321]: WARNING nova.compute.manager [req-89853f93-38c5-4bd2-b032-c229b4fc28c4 req-3983b4cc-48f5-493e-bba9-7a996ba61149 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received unexpected event network-vif-plugged-bf6a7707-9d55-46b2-8738-06505013048b for instance with vm_state building and task_state spawning.
Apr 12 12:29:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG nova.compute.manager [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-plugged-93bb6ab6-63a2-421a-b331-92c957f29f5a {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] Acquiring lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG nova.compute.manager [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] No waiting events found dispatching network-vif-plugged-93bb6ab6-63a2-421a-b331-92c957f29f5a {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:29:53 user nova-compute[71321]: WARNING nova.compute.manager [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received unexpected event network-vif-plugged-93bb6ab6-63a2-421a-b331-92c957f29f5a for instance with vm_state building and task_state spawning.
Apr 12 12:29:53 user nova-compute[71321]: DEBUG nova.compute.manager [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-plugged-389d5d9e-e5fc-48f1-b443-b04d08ec6181 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] Acquiring lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG nova.compute.manager [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] No waiting events found dispatching network-vif-plugged-389d5d9e-e5fc-48f1-b443-b04d08ec6181 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:29:53 user nova-compute[71321]: WARNING nova.compute.manager [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received unexpected event network-vif-plugged-389d5d9e-e5fc-48f1-b443-b04d08ec6181 for instance with vm_state building and task_state spawning.
Apr 12 12:29:53 user nova-compute[71321]: DEBUG nova.compute.manager [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-plugged-389d5d9e-e5fc-48f1-b443-b04d08ec6181 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] Acquiring lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG nova.compute.manager [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] No waiting events found dispatching network-vif-plugged-389d5d9e-e5fc-48f1-b443-b04d08ec6181 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:29:53 user nova-compute[71321]: WARNING nova.compute.manager [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received unexpected event network-vif-plugged-389d5d9e-e5fc-48f1-b443-b04d08ec6181 for instance with vm_state building and task_state spawning.
Apr 12 12:29:53 user nova-compute[71321]: DEBUG nova.compute.manager [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-plugged-e9757213-2bc0-46a5-bffa-3b503c65ecc2 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] Acquiring lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG nova.compute.manager [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] No waiting events found dispatching network-vif-plugged-e9757213-2bc0-46a5-bffa-3b503c65ecc2 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:29:53 user nova-compute[71321]: WARNING nova.compute.manager [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received unexpected event network-vif-plugged-e9757213-2bc0-46a5-bffa-3b503c65ecc2 for instance with vm_state building and task_state spawning.
Apr 12 12:29:53 user nova-compute[71321]: DEBUG nova.compute.manager [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-plugged-e9757213-2bc0-46a5-bffa-3b503c65ecc2 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] Acquiring lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG nova.compute.manager [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] No waiting events found dispatching network-vif-plugged-e9757213-2bc0-46a5-bffa-3b503c65ecc2 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:29:53 user nova-compute[71321]: WARNING nova.compute.manager [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received unexpected event network-vif-plugged-e9757213-2bc0-46a5-bffa-3b503c65ecc2 for instance with vm_state building and task_state spawning.
Apr 12 12:29:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG nova.compute.manager [req-78d695a7-7ec7-4439-a0c1-a6c1fb3bc239 req-f4ddb68a-e7fb-4aa9-b5d5-e2295d41bec1 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-plugged-c698ebb6-016a-4988-8c8a-7a75252a7944 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-78d695a7-7ec7-4439-a0c1-a6c1fb3bc239 req-f4ddb68a-e7fb-4aa9-b5d5-e2295d41bec1 service nova] Acquiring lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-78d695a7-7ec7-4439-a0c1-a6c1fb3bc239 req-f4ddb68a-e7fb-4aa9-b5d5-e2295d41bec1 service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-78d695a7-7ec7-4439-a0c1-a6c1fb3bc239 req-f4ddb68a-e7fb-4aa9-b5d5-e2295d41bec1 service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG nova.compute.manager [req-78d695a7-7ec7-4439-a0c1-a6c1fb3bc239 req-f4ddb68a-e7fb-4aa9-b5d5-e2295d41bec1 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] No waiting events found dispatching network-vif-plugged-c698ebb6-016a-4988-8c8a-7a75252a7944 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:29:53 user nova-compute[71321]: WARNING nova.compute.manager [req-78d695a7-7ec7-4439-a0c1-a6c1fb3bc239 req-f4ddb68a-e7fb-4aa9-b5d5-e2295d41bec1 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received unexpected event network-vif-plugged-c698ebb6-016a-4988-8c8a-7a75252a7944 for instance with vm_state building and task_state spawning.
Apr 12 12:29:53 user nova-compute[71321]: DEBUG nova.compute.manager [req-78d695a7-7ec7-4439-a0c1-a6c1fb3bc239 req-f4ddb68a-e7fb-4aa9-b5d5-e2295d41bec1 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-plugged-bb10902a-003e-4c1a-85a8-194f040a1ffb {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-78d695a7-7ec7-4439-a0c1-a6c1fb3bc239 req-f4ddb68a-e7fb-4aa9-b5d5-e2295d41bec1 service nova] Acquiring lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-78d695a7-7ec7-4439-a0c1-a6c1fb3bc239 req-f4ddb68a-e7fb-4aa9-b5d5-e2295d41bec1 service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-78d695a7-7ec7-4439-a0c1-a6c1fb3bc239 req-f4ddb68a-e7fb-4aa9-b5d5-e2295d41bec1 service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG nova.compute.manager [req-78d695a7-7ec7-4439-a0c1-a6c1fb3bc239 req-f4ddb68a-e7fb-4aa9-b5d5-e2295d41bec1 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] No waiting events found dispatching network-vif-plugged-bb10902a-003e-4c1a-85a8-194f040a1ffb {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:29:53 user nova-compute[71321]: WARNING nova.compute.manager [req-78d695a7-7ec7-4439-a0c1-a6c1fb3bc239 req-f4ddb68a-e7fb-4aa9-b5d5-e2295d41bec1 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received unexpected event network-vif-plugged-bb10902a-003e-4c1a-85a8-194f040a1ffb for instance with vm_state building and task_state spawning.
Apr 12 12:29:53 user nova-compute[71321]: DEBUG nova.compute.manager [req-78d695a7-7ec7-4439-a0c1-a6c1fb3bc239 req-f4ddb68a-e7fb-4aa9-b5d5-e2295d41bec1 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-plugged-bb10902a-003e-4c1a-85a8-194f040a1ffb {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-78d695a7-7ec7-4439-a0c1-a6c1fb3bc239 req-f4ddb68a-e7fb-4aa9-b5d5-e2295d41bec1 service nova] Acquiring lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-78d695a7-7ec7-4439-a0c1-a6c1fb3bc239 req-f4ddb68a-e7fb-4aa9-b5d5-e2295d41bec1 service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-78d695a7-7ec7-4439-a0c1-a6c1fb3bc239 req-f4ddb68a-e7fb-4aa9-b5d5-e2295d41bec1 service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:53 user nova-compute[71321]: DEBUG nova.compute.manager [req-78d695a7-7ec7-4439-a0c1-a6c1fb3bc239 req-f4ddb68a-e7fb-4aa9-b5d5-e2295d41bec1 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] No waiting events found dispatching network-vif-plugged-bb10902a-003e-4c1a-85a8-194f040a1ffb {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:29:53 user nova-compute[71321]: WARNING nova.compute.manager [req-78d695a7-7ec7-4439-a0c1-a6c1fb3bc239 req-f4ddb68a-e7fb-4aa9-b5d5-e2295d41bec1 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received unexpected event network-vif-plugged-bb10902a-003e-4c1a-85a8-194f040a1ffb for instance with vm_state building and task_state spawning.
Apr 12 12:29:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:55 user nova-compute[71321]: DEBUG nova.compute.manager [req-816b4276-ebeb-4fd5-939e-701cd74b4023 req-f0a759bd-4c6e-4dcc-8e17-ef6fefff25af service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-plugged-bf6a7707-9d55-46b2-8738-06505013048b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:29:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-816b4276-ebeb-4fd5-939e-701cd74b4023 req-f0a759bd-4c6e-4dcc-8e17-ef6fefff25af service nova] Acquiring lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-816b4276-ebeb-4fd5-939e-701cd74b4023 req-f0a759bd-4c6e-4dcc-8e17-ef6fefff25af service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-816b4276-ebeb-4fd5-939e-701cd74b4023 req-f0a759bd-4c6e-4dcc-8e17-ef6fefff25af service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:55 user nova-compute[71321]: DEBUG nova.compute.manager [req-816b4276-ebeb-4fd5-939e-701cd74b4023 req-f0a759bd-4c6e-4dcc-8e17-ef6fefff25af service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] No waiting events found dispatching network-vif-plugged-bf6a7707-9d55-46b2-8738-06505013048b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:29:55 user nova-compute[71321]: WARNING nova.compute.manager [req-816b4276-ebeb-4fd5-939e-701cd74b4023 req-f0a759bd-4c6e-4dcc-8e17-ef6fefff25af service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received unexpected event network-vif-plugged-bf6a7707-9d55-46b2-8738-06505013048b for instance with vm_state building and task_state spawning.
Apr 12 12:29:55 user nova-compute[71321]: DEBUG nova.compute.manager [req-816b4276-ebeb-4fd5-939e-701cd74b4023 req-f0a759bd-4c6e-4dcc-8e17-ef6fefff25af service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-plugged-6f2ec393-bb3c-4986-bd50-44ae9a7147b0 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:29:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-816b4276-ebeb-4fd5-939e-701cd74b4023 req-f0a759bd-4c6e-4dcc-8e17-ef6fefff25af service nova] Acquiring lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-816b4276-ebeb-4fd5-939e-701cd74b4023 req-f0a759bd-4c6e-4dcc-8e17-ef6fefff25af service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-816b4276-ebeb-4fd5-939e-701cd74b4023 req-f0a759bd-4c6e-4dcc-8e17-ef6fefff25af service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:55 user nova-compute[71321]: DEBUG nova.compute.manager [req-816b4276-ebeb-4fd5-939e-701cd74b4023 req-f0a759bd-4c6e-4dcc-8e17-ef6fefff25af service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] No waiting events found dispatching network-vif-plugged-6f2ec393-bb3c-4986-bd50-44ae9a7147b0 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:29:55 user nova-compute[71321]: WARNING nova.compute.manager [req-816b4276-ebeb-4fd5-939e-701cd74b4023 req-f0a759bd-4c6e-4dcc-8e17-ef6fefff25af service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received unexpected event network-vif-plugged-6f2ec393-bb3c-4986-bd50-44ae9a7147b0 for instance with vm_state building and task_state spawning.
Apr 12 12:29:55 user nova-compute[71321]: DEBUG nova.compute.manager [req-816b4276-ebeb-4fd5-939e-701cd74b4023 req-f0a759bd-4c6e-4dcc-8e17-ef6fefff25af service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-plugged-6f2ec393-bb3c-4986-bd50-44ae9a7147b0 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:29:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-816b4276-ebeb-4fd5-939e-701cd74b4023 req-f0a759bd-4c6e-4dcc-8e17-ef6fefff25af service nova] Acquiring lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:29:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-816b4276-ebeb-4fd5-939e-701cd74b4023 req-f0a759bd-4c6e-4dcc-8e17-ef6fefff25af service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:29:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-816b4276-ebeb-4fd5-939e-701cd74b4023 req-f0a759bd-4c6e-4dcc-8e17-ef6fefff25af service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:55 user nova-compute[71321]: DEBUG nova.compute.manager [req-816b4276-ebeb-4fd5-939e-701cd74b4023 req-f0a759bd-4c6e-4dcc-8e17-ef6fefff25af service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] No waiting events found dispatching network-vif-plugged-6f2ec393-bb3c-4986-bd50-44ae9a7147b0 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:29:55 user nova-compute[71321]: WARNING nova.compute.manager [req-816b4276-ebeb-4fd5-939e-701cd74b4023 req-f0a759bd-4c6e-4dcc-8e17-ef6fefff25af service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received unexpected event network-vif-plugged-6f2ec393-bb3c-4986-bd50-44ae9a7147b0 for instance with vm_state building and task_state spawning.
Apr 12 12:29:55 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302595.2844012, d8867363-6e36-4b34-9cc1-f30fbc572720 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:29:55 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] VM Resumed (Lifecycle Event)
Apr 12 12:29:55 user nova-compute[71321]: DEBUG nova.compute.manager [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:29:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:29:55 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Instance spawned successfully.
Apr 12 12:29:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:29:55 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:29:55 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:29:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:29:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:29:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:29:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:29:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:29:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:29:55 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:29:55 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302595.285001, d8867363-6e36-4b34-9cc1-f30fbc572720 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:29:55 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] VM Started (Lifecycle Event)
Apr 12 12:29:55 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:29:55 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:29:55 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:29:55 user nova-compute[71321]: INFO nova.compute.manager [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Took 11.40 seconds to spawn the instance on the hypervisor.
Apr 12 12:29:55 user nova-compute[71321]: DEBUG nova.compute.manager [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:29:55 user nova-compute[71321]: INFO nova.compute.manager [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Took 30.16 seconds to build instance.
Apr 12 12:29:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.294s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:29:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:29:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:07 user nova-compute[71321]: INFO nova.compute.manager [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Rescuing
Apr 12 12:30:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "refresh_cache-a4107f2d-88e4-4846-9ece-cb16ad7ecd02" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:30:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquired lock "refresh_cache-a4107f2d-88e4-4846-9ece-cb16ad7ecd02" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:30:07 user nova-compute[71321]: DEBUG nova.network.neutron [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG nova.network.neutron [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Updating instance_info_cache with network_info: [{"id": "5680054b-9363-4825-ade2-add800d7142b", "address": "fa:16:3e:08:27:b7", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5680054b-93", "ovs_interfaceid": "5680054b-9363-4825-ade2-add800d7142b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Releasing lock "refresh_cache-a4107f2d-88e4-4846-9ece-cb16ad7ecd02" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG nova.compute.manager [req-3312ecc8-0e97-4c24-a499-14ec74077852 req-dff45ecc-f0fa-401c-8e09-b8f80bd4fbb2 service nova] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Received event network-vif-unplugged-5680054b-9363-4825-ade2-add800d7142b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3312ecc8-0e97-4c24-a499-14ec74077852 req-dff45ecc-f0fa-401c-8e09-b8f80bd4fbb2 service nova] Acquiring lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3312ecc8-0e97-4c24-a499-14ec74077852 req-dff45ecc-f0fa-401c-8e09-b8f80bd4fbb2 service nova] Lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3312ecc8-0e97-4c24-a499-14ec74077852 req-dff45ecc-f0fa-401c-8e09-b8f80bd4fbb2 service nova] Lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG nova.compute.manager [req-3312ecc8-0e97-4c24-a499-14ec74077852 req-dff45ecc-f0fa-401c-8e09-b8f80bd4fbb2 service nova] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] No waiting events found dispatching network-vif-unplugged-5680054b-9363-4825-ade2-add800d7142b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:30:08 user nova-compute[71321]: WARNING nova.compute.manager [req-3312ecc8-0e97-4c24-a499-14ec74077852 req-dff45ecc-f0fa-401c-8e09-b8f80bd4fbb2 service nova] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Received unexpected event network-vif-unplugged-5680054b-9363-4825-ade2-add800d7142b for instance with vm_state active and task_state rescuing.
Apr 12 12:30:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:08 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Instance destroyed successfully.
Apr 12 12:30:08 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Attempting rescue
Apr 12 12:30:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71321) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Instance directory exists: not creating {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 12:30:08 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Creating image(s)
Apr 12 12:30:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "/opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "/opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "/opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG nova.objects.instance [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'trusted_certs' on Instance uuid a4107f2d-88e4-4846-9ece-cb16ad7ecd02 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.150s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue" returned: 0 in 0.062s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG nova.objects.instance [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'migration_context' on Instance uuid a4107f2d-88e4-4846-9ece-cb16ad7ecd02 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Start _get_guest_xml network_info=[{"id": "5680054b-9363-4825-ade2-add800d7142b", "address": "fa:16:3e:08:27:b7", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "vif_mac": "fa:16:3e:08:27:b7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5680054b-93", "ovs_interfaceid": "5680054b-9363-4825-ade2-add800d7142b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG nova.objects.instance [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'resources' on Instance uuid a4107f2d-88e4-4846-9ece-cb16ad7ecd02 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG nova.objects.instance [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'numa_topology' on Instance uuid a4107f2d-88e4-4846-9ece-cb16ad7ecd02 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:30:08 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:30:08 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:30:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:30:08 user nova-compute[71321]: DEBUG nova.objects.instance [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'vcpu_model' on Instance uuid a4107f2d-88e4-4846-9ece-cb16ad7ecd02 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:30:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:28:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-633086399',display_name='tempest-ServerRescueNegativeTestJSON-server-633086399',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-633086399',id=2,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:28:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9ec9671123c4a00a2880de4b4df8d3e',ramdisk_id='',reservation_id='r-s30bwkvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1979263125',owner_user_name='tempest-ServerRescueNegativeTestJSON-1979263125-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:28:32Z,user_data=None,user_id='1db0203a6e6f4cc3bccbf19577a0c82f',uuid=a4107f2d-88e4-4846-9ece-cb16ad7ecd02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5680054b-9363-4825-ade2-add800d7142b", "address": "fa:16:3e:08:27:b7", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "vif_mac": "fa:16:3e:08:27:b7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5680054b-93", "ovs_interfaceid": "5680054b-9363-4825-ade2-add800d7142b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:30:09 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Converting VIF {"id": "5680054b-9363-4825-ade2-add800d7142b", "address": "fa:16:3e:08:27:b7", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "vif_mac": "fa:16:3e:08:27:b7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5680054b-93", "ovs_interfaceid": "5680054b-9363-4825-ade2-add800d7142b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:30:09 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:27:b7,bridge_name='br-int',has_traffic_filtering=True,id=5680054b-9363-4825-ade2-add800d7142b,network=Network(0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5680054b-93') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:30:09 user nova-compute[71321]: DEBUG nova.objects.instance [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'pci_devices' on Instance uuid a4107f2d-88e4-4846-9ece-cb16ad7ecd02 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:30:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:30:09 user nova-compute[71321]:   <uuid>a4107f2d-88e4-4846-9ece-cb16ad7ecd02</uuid>
Apr 12 12:30:09 user nova-compute[71321]:   <name>instance-00000002</name>
Apr 12 12:30:09 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:30:09 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:30:09 user nova-compute[71321]:   <metadata>
Apr 12 12:30:09 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:30:09 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:30:09 user nova-compute[71321]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-633086399</nova:name>
Apr 12 12:30:09 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:30:08</nova:creationTime>
Apr 12 12:30:09 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:30:09 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:30:09 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:30:09 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:30:09 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:30:09 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:30:09 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:30:09 user nova-compute[71321]:       <nova:owner>
Apr 12 12:30:09 user nova-compute[71321]:         <nova:user uuid="1db0203a6e6f4cc3bccbf19577a0c82f">tempest-ServerRescueNegativeTestJSON-1979263125-project-member</nova:user>
Apr 12 12:30:09 user nova-compute[71321]:         <nova:project uuid="f9ec9671123c4a00a2880de4b4df8d3e">tempest-ServerRescueNegativeTestJSON-1979263125</nova:project>
Apr 12 12:30:09 user nova-compute[71321]:       </nova:owner>
Apr 12 12:30:09 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:30:09 user nova-compute[71321]:       <nova:ports>
Apr 12 12:30:09 user nova-compute[71321]:         <nova:port uuid="5680054b-9363-4825-ade2-add800d7142b">
Apr 12 12:30:09 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 12:30:09 user nova-compute[71321]:         </nova:port>
Apr 12 12:30:09 user nova-compute[71321]:       </nova:ports>
Apr 12 12:30:09 user nova-compute[71321]:     </nova:instance>
Apr 12 12:30:09 user nova-compute[71321]:   </metadata>
Apr 12 12:30:09 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:30:09 user nova-compute[71321]:     <system>
Apr 12 12:30:09 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:30:09 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:30:09 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:30:09 user nova-compute[71321]:       <entry name="serial">a4107f2d-88e4-4846-9ece-cb16ad7ecd02</entry>
Apr 12 12:30:09 user nova-compute[71321]:       <entry name="uuid">a4107f2d-88e4-4846-9ece-cb16ad7ecd02</entry>
Apr 12 12:30:09 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:30:09 user nova-compute[71321]:     </system>
Apr 12 12:30:09 user nova-compute[71321]:   </sysinfo>
Apr 12 12:30:09 user nova-compute[71321]:   <os>
Apr 12 12:30:09 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:30:09 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:30:09 user nova-compute[71321]:   </os>
Apr 12 12:30:09 user nova-compute[71321]:   <features>
Apr 12 12:30:09 user nova-compute[71321]:     <acpi/>
Apr 12 12:30:09 user nova-compute[71321]:     <apic/>
Apr 12 12:30:09 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:30:09 user nova-compute[71321]:   </features>
Apr 12 12:30:09 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:30:09 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:30:09 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:30:09 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:30:09 user nova-compute[71321]:   </clock>
Apr 12 12:30:09 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:30:09 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:30:09 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:30:09 user nova-compute[71321]:   </cpu>
Apr 12 12:30:09 user nova-compute[71321]:   <devices>
Apr 12 12:30:09 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:30:09 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:30:09 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue"/>
Apr 12 12:30:09 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:30:09 user nova-compute[71321]:     </disk>
Apr 12 12:30:09 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:30:09 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:30:09 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk"/>
Apr 12 12:30:09 user nova-compute[71321]:       <target dev="vdb" bus="virtio"/>
Apr 12 12:30:09 user nova-compute[71321]:     </disk>
Apr 12 12:30:09 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:30:09 user nova-compute[71321]:       <mac address="fa:16:3e:08:27:b7"/>
Apr 12 12:30:09 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:30:09 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:30:09 user nova-compute[71321]:       <target dev="tap5680054b-93"/>
Apr 12 12:30:09 user nova-compute[71321]:     </interface>
Apr 12 12:30:09 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:30:09 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/console.log" append="off"/>
Apr 12 12:30:09 user nova-compute[71321]:     </serial>
Apr 12 12:30:09 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:30:09 user nova-compute[71321]:     <video>
Apr 12 12:30:09 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:30:09 user nova-compute[71321]:     </video>
Apr 12 12:30:09 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:30:09 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:30:09 user nova-compute[71321]:     </rng>
Apr 12 12:30:09 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:30:09 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:30:09 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:30:09 user nova-compute[71321]:     </memballoon>
Apr 12 12:30:09 user nova-compute[71321]:   </devices>
Apr 12 12:30:09 user nova-compute[71321]: </domain>
Apr 12 12:30:09 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:30:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:09 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Instance destroyed successfully.
Apr 12 12:30:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:30:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:30:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] No VIF found with MAC fa:16:3e:08:27:b7, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:30:09 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:30:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:10 user nova-compute[71321]: DEBUG nova.compute.manager [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:30:10 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:30:10 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:30:10 user nova-compute[71321]: DEBUG nova.compute.manager [req-e8940c44-1970-43be-8d0a-8b46fa1970e7 req-849695f8-caa9-4425-9225-7e802d03823e service nova] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Received event network-vif-plugged-5680054b-9363-4825-ade2-add800d7142b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:30:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e8940c44-1970-43be-8d0a-8b46fa1970e7 req-849695f8-caa9-4425-9225-7e802d03823e service nova] Acquiring lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e8940c44-1970-43be-8d0a-8b46fa1970e7 req-849695f8-caa9-4425-9225-7e802d03823e service nova] Lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e8940c44-1970-43be-8d0a-8b46fa1970e7 req-849695f8-caa9-4425-9225-7e802d03823e service nova] Lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:10 user nova-compute[71321]: DEBUG nova.compute.manager [req-e8940c44-1970-43be-8d0a-8b46fa1970e7 req-849695f8-caa9-4425-9225-7e802d03823e service nova] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] No waiting events found dispatching network-vif-plugged-5680054b-9363-4825-ade2-add800d7142b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:30:10 user nova-compute[71321]: WARNING nova.compute.manager [req-e8940c44-1970-43be-8d0a-8b46fa1970e7 req-849695f8-caa9-4425-9225-7e802d03823e service nova] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Received unexpected event network-vif-plugged-5680054b-9363-4825-ade2-add800d7142b for instance with vm_state active and task_state rescuing.
Apr 12 12:30:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-a4107f2d-88e4-4846-9ece-cb16ad7ecd02" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:30:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-a4107f2d-88e4-4846-9ece-cb16ad7ecd02" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:30:10 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 12:30:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:10 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:30:10 user nova-compute[71321]: INFO nova.compute.claims [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Claim successful on node user
Apr 12 12:30:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:11 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:30:11 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:30:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.543s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:11 user nova-compute[71321]: DEBUG nova.compute.manager [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:30:11 user nova-compute[71321]: DEBUG nova.compute.manager [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:30:11 user nova-compute[71321]: DEBUG nova.network.neutron [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:30:11 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:30:11 user nova-compute[71321]: DEBUG nova.compute.manager [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:30:11 user nova-compute[71321]: DEBUG nova.compute.manager [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:30:11 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:30:11 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Creating image(s)
Apr 12 12:30:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "/opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "/opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "/opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:11 user nova-compute[71321]: DEBUG nova.policy [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2272654f6bbb4fb39b3c334c32d4688c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ad4c8abb3447bd8ad5f5f2e95e2d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:30:11 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Updating instance_info_cache with network_info: [{"id": "5680054b-9363-4825-ade2-add800d7142b", "address": "fa:16:3e:08:27:b7", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5680054b-93", "ovs_interfaceid": "5680054b-9363-4825-ade2-add800d7142b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:30:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.138s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-a4107f2d-88e4-4846-9ece-cb16ad7ecd02" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:30:11 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 12:30:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.129s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/disk 1073741824" returned: 0 in 0.066s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.147s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:11 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:30:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:12 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Cannot resize image /opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:30:12 user nova-compute[71321]: DEBUG nova.objects.instance [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lazy-loading 'migration_context' on Instance uuid d584edf2-12e3-48d1-947f-fdfb0c9c7377 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:30:12 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:30:12 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Ensure instance console log exists: /opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:30:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:12 user nova-compute[71321]: DEBUG nova.network.neutron [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Successfully created port: 5fbb21e1-ece8-4e20-baa6-55fe59a41325 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:30:12 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:30:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:12 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:30:12 user nova-compute[71321]: DEBUG nova.compute.manager [req-1f9aba5a-2979-4f67-bd3e-af9f7325b3e9 req-ce94be56-8b4e-488c-8ca5-4961ed35b86a service nova] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Received event network-vif-plugged-5680054b-9363-4825-ade2-add800d7142b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:30:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-1f9aba5a-2979-4f67-bd3e-af9f7325b3e9 req-ce94be56-8b4e-488c-8ca5-4961ed35b86a service nova] Acquiring lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-1f9aba5a-2979-4f67-bd3e-af9f7325b3e9 req-ce94be56-8b4e-488c-8ca5-4961ed35b86a service nova] Lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-1f9aba5a-2979-4f67-bd3e-af9f7325b3e9 req-ce94be56-8b4e-488c-8ca5-4961ed35b86a service nova] Lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:12 user nova-compute[71321]: DEBUG nova.compute.manager [req-1f9aba5a-2979-4f67-bd3e-af9f7325b3e9 req-ce94be56-8b4e-488c-8ca5-4961ed35b86a service nova] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] No waiting events found dispatching network-vif-plugged-5680054b-9363-4825-ade2-add800d7142b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:30:12 user nova-compute[71321]: WARNING nova.compute.manager [req-1f9aba5a-2979-4f67-bd3e-af9f7325b3e9 req-ce94be56-8b4e-488c-8ca5-4961ed35b86a service nova] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Received unexpected event network-vif-plugged-5680054b-9363-4825-ade2-add800d7142b for instance with vm_state active and task_state rescuing.
Apr 12 12:30:12 user nova-compute[71321]: DEBUG nova.compute.manager [req-1f9aba5a-2979-4f67-bd3e-af9f7325b3e9 req-ce94be56-8b4e-488c-8ca5-4961ed35b86a service nova] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Received event network-vif-plugged-5680054b-9363-4825-ade2-add800d7142b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:30:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-1f9aba5a-2979-4f67-bd3e-af9f7325b3e9 req-ce94be56-8b4e-488c-8ca5-4961ed35b86a service nova] Acquiring lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-1f9aba5a-2979-4f67-bd3e-af9f7325b3e9 req-ce94be56-8b4e-488c-8ca5-4961ed35b86a service nova] Lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-1f9aba5a-2979-4f67-bd3e-af9f7325b3e9 req-ce94be56-8b4e-488c-8ca5-4961ed35b86a service nova] Lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:12 user nova-compute[71321]: DEBUG nova.compute.manager [req-1f9aba5a-2979-4f67-bd3e-af9f7325b3e9 req-ce94be56-8b4e-488c-8ca5-4961ed35b86a service nova] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] No waiting events found dispatching network-vif-plugged-5680054b-9363-4825-ade2-add800d7142b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:30:12 user nova-compute[71321]: WARNING nova.compute.manager [req-1f9aba5a-2979-4f67-bd3e-af9f7325b3e9 req-ce94be56-8b4e-488c-8ca5-4961ed35b86a service nova] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Received unexpected event network-vif-plugged-5680054b-9363-4825-ade2-add800d7142b for instance with vm_state active and task_state rescuing.
Apr 12 12:30:12 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Removed pending event for a4107f2d-88e4-4846-9ece-cb16ad7ecd02 due to event {{(pid=71321) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 12:30:12 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302612.7872043, a4107f2d-88e4-4846-9ece-cb16ad7ecd02 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:30:12 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] VM Resumed (Lifecycle Event)
Apr 12 12:30:12 user nova-compute[71321]: DEBUG nova.compute.manager [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:30:12 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:30:12 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:30:12 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 12:30:12 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302612.789806, a4107f2d-88e4-4846-9ece-cb16ad7ecd02 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:30:12 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] VM Started (Lifecycle Event)
Apr 12 12:30:12 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:30:12 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:30:12 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 12:30:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f3ff25a-522c-431b-a177-85177401c7a9/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f3ff25a-522c-431b-a177-85177401c7a9/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f3ff25a-522c-431b-a177-85177401c7a9/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG nova.network.neutron [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Successfully updated port: 5fbb21e1-ece8-4e20-baa6-55fe59a41325 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "refresh_cache-d584edf2-12e3-48d1-947f-fdfb0c9c7377" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquired lock "refresh_cache-d584edf2-12e3-48d1-947f-fdfb0c9c7377" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG nova.network.neutron [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG nova.network.neutron [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f3ff25a-522c-431b-a177-85177401c7a9/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG nova.network.neutron [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Updating instance_info_cache with network_info: [{"id": "5fbb21e1-ece8-4e20-baa6-55fe59a41325", "address": "fa:16:3e:eb:10:b5", "network": {"id": "cba3e8fe-24d8-4128-b9b8-4087ab3a4407", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-916061215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8ad4c8abb3447bd8ad5f5f2e95e2d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fbb21e1-ec", "ovs_interfaceid": "5fbb21e1-ece8-4e20-baa6-55fe59a41325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Releasing lock "refresh_cache-d584edf2-12e3-48d1-947f-fdfb0c9c7377" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG nova.compute.manager [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Instance network_info: |[{"id": "5fbb21e1-ece8-4e20-baa6-55fe59a41325", "address": "fa:16:3e:eb:10:b5", "network": {"id": "cba3e8fe-24d8-4128-b9b8-4087ab3a4407", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-916061215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8ad4c8abb3447bd8ad5f5f2e95e2d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fbb21e1-ec", "ovs_interfaceid": "5fbb21e1-ece8-4e20-baa6-55fe59a41325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Start _get_guest_xml network_info=[{"id": "5fbb21e1-ece8-4e20-baa6-55fe59a41325", "address": "fa:16:3e:eb:10:b5", "network": {"id": "cba3e8fe-24d8-4128-b9b8-4087ab3a4407", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-916061215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8ad4c8abb3447bd8ad5f5f2e95e2d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fbb21e1-ec", "ovs_interfaceid": "5fbb21e1-ece8-4e20-baa6-55fe59a41325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:30:13 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:30:13 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:30:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:30:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-651340607',display_name='tempest-SnapshotDataIntegrityTests-server-651340607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-651340607',id=12,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8n/tv/M6R4wuDM0jbUye1gml7maodQ+9g689zJJzJ3WkTrfUhAnJqMicn9hfAmFSezo1t5uVHloxtsKXdGPLhaCAAP9IYcYEBLi42ToHoaHRnJDijgZlZ0V9SGIdT9Ig==',key_name='tempest-SnapshotDataIntegrityTests-1869203116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8ad4c8abb3447bd8ad5f5f2e95e2d78',ramdisk_id='',reservation_id='r-nzrrrw0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1611683463',owner_user_name='tempest-SnapshotDataIntegrityTests-1611683463-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:30:11Z,user_data=None,user_id='2272654f6bbb4fb39b3c334c32d4688c',uuid=d584edf2-12e3-48d1-947f-fdfb0c9c7377,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fbb21e1-ece8-4e20-baa6-55fe59a41325", "address": "fa:16:3e:eb:10:b5", "network": {"id": "cba3e8fe-24d8-4128-b9b8-4087ab3a4407", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-916061215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8ad4c8abb3447bd8ad5f5f2e95e2d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fbb21e1-ec", "ovs_interfaceid": "5fbb21e1-ece8-4e20-baa6-55fe59a41325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Converting VIF {"id": "5fbb21e1-ece8-4e20-baa6-55fe59a41325", "address": "fa:16:3e:eb:10:b5", "network": {"id": "cba3e8fe-24d8-4128-b9b8-4087ab3a4407", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-916061215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8ad4c8abb3447bd8ad5f5f2e95e2d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fbb21e1-ec", "ovs_interfaceid": "5fbb21e1-ece8-4e20-baa6-55fe59a41325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:10:b5,bridge_name='br-int',has_traffic_filtering=True,id=5fbb21e1-ece8-4e20-baa6-55fe59a41325,network=Network(cba3e8fe-24d8-4128-b9b8-4087ab3a4407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fbb21e1-ec') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG nova.objects.instance [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lazy-loading 'pci_devices' on Instance uuid d584edf2-12e3-48d1-947f-fdfb0c9c7377 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:30:13 user nova-compute[71321]:   <uuid>d584edf2-12e3-48d1-947f-fdfb0c9c7377</uuid>
Apr 12 12:30:13 user nova-compute[71321]:   <name>instance-0000000c</name>
Apr 12 12:30:13 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:30:13 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:30:13 user nova-compute[71321]:   <metadata>
Apr 12 12:30:13 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:30:13 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:30:13 user nova-compute[71321]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-651340607</nova:name>
Apr 12 12:30:13 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:30:13</nova:creationTime>
Apr 12 12:30:13 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:30:13 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:30:13 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:30:13 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:30:13 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:30:13 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:30:13 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:30:13 user nova-compute[71321]:       <nova:owner>
Apr 12 12:30:13 user nova-compute[71321]:         <nova:user uuid="2272654f6bbb4fb39b3c334c32d4688c">tempest-SnapshotDataIntegrityTests-1611683463-project-member</nova:user>
Apr 12 12:30:13 user nova-compute[71321]:         <nova:project uuid="c8ad4c8abb3447bd8ad5f5f2e95e2d78">tempest-SnapshotDataIntegrityTests-1611683463</nova:project>
Apr 12 12:30:13 user nova-compute[71321]:       </nova:owner>
Apr 12 12:30:13 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:30:13 user nova-compute[71321]:       <nova:ports>
Apr 12 12:30:13 user nova-compute[71321]:         <nova:port uuid="5fbb21e1-ece8-4e20-baa6-55fe59a41325">
Apr 12 12:30:13 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 12:30:13 user nova-compute[71321]:         </nova:port>
Apr 12 12:30:13 user nova-compute[71321]:       </nova:ports>
Apr 12 12:30:13 user nova-compute[71321]:     </nova:instance>
Apr 12 12:30:13 user nova-compute[71321]:   </metadata>
Apr 12 12:30:13 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:30:13 user nova-compute[71321]:     <system>
Apr 12 12:30:13 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:30:13 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:30:13 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:30:13 user nova-compute[71321]:       <entry name="serial">d584edf2-12e3-48d1-947f-fdfb0c9c7377</entry>
Apr 12 12:30:13 user nova-compute[71321]:       <entry name="uuid">d584edf2-12e3-48d1-947f-fdfb0c9c7377</entry>
Apr 12 12:30:13 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:30:13 user nova-compute[71321]:     </system>
Apr 12 12:30:13 user nova-compute[71321]:   </sysinfo>
Apr 12 12:30:13 user nova-compute[71321]:   <os>
Apr 12 12:30:13 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:30:13 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:30:13 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:30:13 user nova-compute[71321]:   </os>
Apr 12 12:30:13 user nova-compute[71321]:   <features>
Apr 12 12:30:13 user nova-compute[71321]:     <acpi/>
Apr 12 12:30:13 user nova-compute[71321]:     <apic/>
Apr 12 12:30:13 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:30:13 user nova-compute[71321]:   </features>
Apr 12 12:30:13 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:30:13 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:30:13 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:30:13 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:30:13 user nova-compute[71321]:   </clock>
Apr 12 12:30:13 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:30:13 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:30:13 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:30:13 user nova-compute[71321]:   </cpu>
Apr 12 12:30:13 user nova-compute[71321]:   <devices>
Apr 12 12:30:13 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:30:13 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:30:13 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/disk"/>
Apr 12 12:30:13 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:30:13 user nova-compute[71321]:     </disk>
Apr 12 12:30:13 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:30:13 user nova-compute[71321]:       <mac address="fa:16:3e:eb:10:b5"/>
Apr 12 12:30:13 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:30:13 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:30:13 user nova-compute[71321]:       <target dev="tap5fbb21e1-ec"/>
Apr 12 12:30:13 user nova-compute[71321]:     </interface>
Apr 12 12:30:13 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:30:13 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/console.log" append="off"/>
Apr 12 12:30:13 user nova-compute[71321]:     </serial>
Apr 12 12:30:13 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:30:13 user nova-compute[71321]:     <video>
Apr 12 12:30:13 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:30:13 user nova-compute[71321]:     </video>
Apr 12 12:30:13 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:30:13 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:30:13 user nova-compute[71321]:     </rng>
Apr 12 12:30:13 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:30:13 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:30:13 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:30:13 user nova-compute[71321]:     </memballoon>
Apr 12 12:30:13 user nova-compute[71321]:   </devices>
Apr 12 12:30:13 user nova-compute[71321]: </domain>
Apr 12 12:30:13 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:30:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-651340607',display_name='tempest-SnapshotDataIntegrityTests-server-651340607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-651340607',id=12,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8n/tv/M6R4wuDM0jbUye1gml7maodQ+9g689zJJzJ3WkTrfUhAnJqMicn9hfAmFSezo1t5uVHloxtsKXdGPLhaCAAP9IYcYEBLi42ToHoaHRnJDijgZlZ0V9SGIdT9Ig==',key_name='tempest-SnapshotDataIntegrityTests-1869203116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8ad4c8abb3447bd8ad5f5f2e95e2d78',ramdisk_id='',reservation_id='r-nzrrrw0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1611683463',owner_user_name='tempest-SnapshotDataIntegrityTests-1611683463-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:30:11Z,user_data=None,user_id='2272654f6bbb4fb39b3c334c32d4688c',uuid=d584edf2-12e3-48d1-947f-fdfb0c9c7377,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fbb21e1-ece8-4e20-baa6-55fe59a41325", "address": "fa:16:3e:eb:10:b5", "network": {"id": "cba3e8fe-24d8-4128-b9b8-4087ab3a4407", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-916061215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8ad4c8abb3447bd8ad5f5f2e95e2d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fbb21e1-ec", "ovs_interfaceid": "5fbb21e1-ece8-4e20-baa6-55fe59a41325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Converting VIF {"id": "5fbb21e1-ece8-4e20-baa6-55fe59a41325", "address": "fa:16:3e:eb:10:b5", "network": {"id": "cba3e8fe-24d8-4128-b9b8-4087ab3a4407", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-916061215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8ad4c8abb3447bd8ad5f5f2e95e2d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fbb21e1-ec", "ovs_interfaceid": "5fbb21e1-ece8-4e20-baa6-55fe59a41325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:10:b5,bridge_name='br-int',has_traffic_filtering=True,id=5fbb21e1-ece8-4e20-baa6-55fe59a41325,network=Network(cba3e8fe-24d8-4128-b9b8-4087ab3a4407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fbb21e1-ec') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG os_vif [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:10:b5,bridge_name='br-int',has_traffic_filtering=True,id=5fbb21e1-ece8-4e20-baa6-55fe59a41325,network=Network(cba3e8fe-24d8-4128-b9b8-4087ab3a4407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fbb21e1-ec') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5fbb21e1-ec, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5fbb21e1-ec, col_values=(('external_ids', {'iface-id': '5fbb21e1-ece8-4e20-baa6-55fe59a41325', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:10:b5', 'vm-uuid': 'd584edf2-12e3-48d1-947f-fdfb0c9c7377'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:13 user nova-compute[71321]: INFO os_vif [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:10:b5,bridge_name='br-int',has_traffic_filtering=True,id=5fbb21e1-ece8-4e20-baa6-55fe59a41325,network=Network(cba3e8fe-24d8-4128-b9b8-4087ab3a4407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fbb21e1-ec')
Apr 12 12:30:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] No VIF found with MAC fa:16:3e:eb:10:b5, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:13 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/651d5c05-2d02-450f-a33c-fbd9b3109016/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:14 user nova-compute[71321]: DEBUG nova.compute.manager [req-6356ab6a-04a1-4532-b895-87da3eb1db57 req-726c4ff6-82ff-4790-ade9-bfb9d81b9852 service nova] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Received event network-changed-5fbb21e1-ece8-4e20-baa6-55fe59a41325 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:30:14 user nova-compute[71321]: DEBUG nova.compute.manager [req-6356ab6a-04a1-4532-b895-87da3eb1db57 req-726c4ff6-82ff-4790-ade9-bfb9d81b9852 service nova] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Refreshing instance network info cache due to event network-changed-5fbb21e1-ece8-4e20-baa6-55fe59a41325. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:30:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-6356ab6a-04a1-4532-b895-87da3eb1db57 req-726c4ff6-82ff-4790-ade9-bfb9d81b9852 service nova] Acquiring lock "refresh_cache-d584edf2-12e3-48d1-947f-fdfb0c9c7377" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:30:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-6356ab6a-04a1-4532-b895-87da3eb1db57 req-726c4ff6-82ff-4790-ade9-bfb9d81b9852 service nova] Acquired lock "refresh_cache-d584edf2-12e3-48d1-947f-fdfb0c9c7377" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:30:14 user nova-compute[71321]: DEBUG nova.network.neutron [req-6356ab6a-04a1-4532-b895-87da3eb1db57 req-726c4ff6-82ff-4790-ade9-bfb9d81b9852 service nova] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Refreshing network info cache for port 5fbb21e1-ece8-4e20-baa6-55fe59a41325 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:30:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/651d5c05-2d02-450f-a33c-fbd9b3109016/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/651d5c05-2d02-450f-a33c-fbd9b3109016/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/651d5c05-2d02-450f-a33c-fbd9b3109016/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a69c0-488f-40cb-bdde-3e410029d4c8/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a69c0-488f-40cb-bdde-3e410029d4c8/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a69c0-488f-40cb-bdde-3e410029d4c8/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a69c0-488f-40cb-bdde-3e410029d4c8/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:15 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:30:15 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:30:15 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:30:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:15 user nova-compute[71321]: DEBUG nova.network.neutron [req-6356ab6a-04a1-4532-b895-87da3eb1db57 req-726c4ff6-82ff-4790-ade9-bfb9d81b9852 service nova] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Updated VIF entry in instance network info cache for port 5fbb21e1-ece8-4e20-baa6-55fe59a41325. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:30:15 user nova-compute[71321]: DEBUG nova.network.neutron [req-6356ab6a-04a1-4532-b895-87da3eb1db57 req-726c4ff6-82ff-4790-ade9-bfb9d81b9852 service nova] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Updating instance_info_cache with network_info: [{"id": "5fbb21e1-ece8-4e20-baa6-55fe59a41325", "address": "fa:16:3e:eb:10:b5", "network": {"id": "cba3e8fe-24d8-4128-b9b8-4087ab3a4407", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-916061215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8ad4c8abb3447bd8ad5f5f2e95e2d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fbb21e1-ec", "ovs_interfaceid": "5fbb21e1-ece8-4e20-baa6-55fe59a41325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:30:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Acquiring lock "5a054fbb-bfb4-40fa-8a03-a0c201df6857" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "5a054fbb-bfb4-40fa-8a03-a0c201df6857" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-6356ab6a-04a1-4532-b895-87da3eb1db57 req-726c4ff6-82ff-4790-ade9-bfb9d81b9852 service nova] Releasing lock "refresh_cache-d584edf2-12e3-48d1-947f-fdfb0c9c7377" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:30:15 user nova-compute[71321]: DEBUG nova.objects.instance [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lazy-loading 'flavor' on Instance uuid 5a054fbb-bfb4-40fa-8a03-a0c201df6857 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:30:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "5a054fbb-bfb4-40fa-8a03-a0c201df6857" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.139s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a054fbb-bfb4-40fa-8a03-a0c201df6857/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a054fbb-bfb4-40fa-8a03-a0c201df6857/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a054fbb-bfb4-40fa-8a03-a0c201df6857/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Acquiring lock "5a054fbb-bfb4-40fa-8a03-a0c201df6857" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "5a054fbb-bfb4-40fa-8a03-a0c201df6857" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:16 user nova-compute[71321]: INFO nova.compute.manager [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Attaching volume 149aa9b1-4712-4377-899a-30c28b5a826c to /dev/vdb
Apr 12 12:30:16 user nova-compute[71321]: DEBUG os_brick.utils [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:30:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:16 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb113d7-92c0-42db-9f43-13928b9af3f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a054fbb-bfb4-40fa-8a03-a0c201df6857/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:16 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[17858596-b57c-4c39-8245-a4d0d8077c2c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:30:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:16 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[159da08c-aa50-49f0-9a0c-bc5803a3a35e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:16 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c2c765-b9de-40a1-bab8-e8b0b71eb568]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:30:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:30:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:30:16 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:30:16 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e8b295-53b7-4b72-b2a9-a6c528169f65]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:30:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:30:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:30:16 user nova-compute[71321]: DEBUG os_brick.utils [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:30:16 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Updating existing volume attachment record: edabd290-f75c-4f10-bcc2-8c10c5b09154 {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:30:17 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302617.5383267, d584edf2-12e3-48d1-947f-fdfb0c9c7377 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:30:17 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] VM Resumed (Lifecycle Event)
Apr 12 12:30:17 user nova-compute[71321]: DEBUG nova.compute.manager [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:30:17 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:30:17 user nova-compute[71321]: DEBUG nova.compute.manager [req-3636939a-8a6a-4c05-b4c4-1da0106d9500 req-b6919c3a-3f6b-4f1e-b75f-3cc6f0cafbdb service nova] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Received event network-vif-plugged-5fbb21e1-ece8-4e20-baa6-55fe59a41325 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:30:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3636939a-8a6a-4c05-b4c4-1da0106d9500 req-b6919c3a-3f6b-4f1e-b75f-3cc6f0cafbdb service nova] Acquiring lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3636939a-8a6a-4c05-b4c4-1da0106d9500 req-b6919c3a-3f6b-4f1e-b75f-3cc6f0cafbdb service nova] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3636939a-8a6a-4c05-b4c4-1da0106d9500 req-b6919c3a-3f6b-4f1e-b75f-3cc6f0cafbdb service nova] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:17 user nova-compute[71321]: DEBUG nova.compute.manager [req-3636939a-8a6a-4c05-b4c4-1da0106d9500 req-b6919c3a-3f6b-4f1e-b75f-3cc6f0cafbdb service nova] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] No waiting events found dispatching network-vif-plugged-5fbb21e1-ece8-4e20-baa6-55fe59a41325 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:30:17 user nova-compute[71321]: WARNING nova.compute.manager [req-3636939a-8a6a-4c05-b4c4-1da0106d9500 req-b6919c3a-3f6b-4f1e-b75f-3cc6f0cafbdb service nova] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Received unexpected event network-vif-plugged-5fbb21e1-ece8-4e20-baa6-55fe59a41325 for instance with vm_state building and task_state spawning.
Apr 12 12:30:17 user nova-compute[71321]: DEBUG nova.compute.manager [req-3636939a-8a6a-4c05-b4c4-1da0106d9500 req-b6919c3a-3f6b-4f1e-b75f-3cc6f0cafbdb service nova] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Received event network-vif-plugged-5fbb21e1-ece8-4e20-baa6-55fe59a41325 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:30:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3636939a-8a6a-4c05-b4c4-1da0106d9500 req-b6919c3a-3f6b-4f1e-b75f-3cc6f0cafbdb service nova] Acquiring lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3636939a-8a6a-4c05-b4c4-1da0106d9500 req-b6919c3a-3f6b-4f1e-b75f-3cc6f0cafbdb service nova] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3636939a-8a6a-4c05-b4c4-1da0106d9500 req-b6919c3a-3f6b-4f1e-b75f-3cc6f0cafbdb service nova] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:17 user nova-compute[71321]: DEBUG nova.compute.manager [req-3636939a-8a6a-4c05-b4c4-1da0106d9500 req-b6919c3a-3f6b-4f1e-b75f-3cc6f0cafbdb service nova] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] No waiting events found dispatching network-vif-plugged-5fbb21e1-ece8-4e20-baa6-55fe59a41325 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:30:17 user nova-compute[71321]: WARNING nova.compute.manager [req-3636939a-8a6a-4c05-b4c4-1da0106d9500 req-b6919c3a-3f6b-4f1e-b75f-3cc6f0cafbdb service nova] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Received unexpected event network-vif-plugged-5fbb21e1-ece8-4e20-baa6-55fe59a41325 for instance with vm_state building and task_state spawning.
Apr 12 12:30:17 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:30:17 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:30:18 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:30:18 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:30:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=7431MB free_disk=26.602741241455078GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:30:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:18 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Instance spawned successfully.
Apr 12 12:30:18 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:30:18 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:30:18 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302617.5387533, d584edf2-12e3-48d1-947f-fdfb0c9c7377 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:30:18 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] VM Started (Lifecycle Event)
Apr 12 12:30:18 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:30:18 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:30:18 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:30:18 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:30:18 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:30:18 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:30:18 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:30:18 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:30:18 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:30:18 user nova-compute[71321]: INFO nova.compute.manager [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Took 6.78 seconds to spawn the instance on the hypervisor.
Apr 12 12:30:18 user nova-compute[71321]: DEBUG nova.compute.manager [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:30:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 2f3ff25a-522c-431b-a177-85177401c7a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:30:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:30:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 839e85a2-f7af-482d-a5e6-09195888300e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:30:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 651d5c05-2d02-450f-a33c-fbd9b3109016 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:30:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 64589bd5-2688-4224-ba3e-8a26f9ffafaf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:30:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 5a054fbb-bfb4-40fa-8a03-a0c201df6857 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:30:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:30:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:30:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 540a69c0-488f-40cb-bdde-3e410029d4c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:30:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance d8867363-6e36-4b34-9cc1-f30fbc572720 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:30:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 10116da0-785c-41cf-96bb-95721af863db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:30:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance a4107f2d-88e4-4846-9ece-cb16ad7ecd02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:30:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:30:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:30:18 user nova-compute[71321]: INFO nova.compute.manager [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Took 7.73 seconds to build instance.
Apr 12 12:30:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.862s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:18 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:30:18 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:30:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:30:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.968s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:19 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:30:19 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:30:19 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:30:19 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:30:19 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:30:19 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:30:19 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:30:19 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:30:20 user nova-compute[71321]: DEBUG nova.compute.manager [req-8d13544c-651d-47d5-872c-df0bbef31dfe req-69ed86a4-dd09-4445-b40d-299c878e0c3f service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received event network-changed-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:30:20 user nova-compute[71321]: DEBUG nova.compute.manager [req-8d13544c-651d-47d5-872c-df0bbef31dfe req-69ed86a4-dd09-4445-b40d-299c878e0c3f service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Refreshing instance network info cache due to event network-changed-6f21df63-1895-4500-b119-c4670a7f3569. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:30:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-8d13544c-651d-47d5-872c-df0bbef31dfe req-69ed86a4-dd09-4445-b40d-299c878e0c3f service nova] Acquiring lock "refresh_cache-546c0c08-35f1-4043-ac30-56d49bc86af1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:30:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-8d13544c-651d-47d5-872c-df0bbef31dfe req-69ed86a4-dd09-4445-b40d-299c878e0c3f service nova] Acquired lock "refresh_cache-546c0c08-35f1-4043-ac30-56d49bc86af1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:30:20 user nova-compute[71321]: DEBUG nova.network.neutron [req-8d13544c-651d-47d5-872c-df0bbef31dfe req-69ed86a4-dd09-4445-b40d-299c878e0c3f service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Refreshing network info cache for port 6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:30:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:30:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KIAJTZVw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:30:20 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:30:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:30:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.005s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:30:20 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:30:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:30:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:30:20 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:30:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb54fac9-7862-48a3-8b26-af26d0c10e68]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:30:21 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9e97b9-60c5-49cf-b225-11824b1e1f3b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c] added
Apr 12 12:30:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[18abb927-6bd0-4511-a065-d86d4863cf74]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[706c8c6b-f1d9-4d49-b630-4d4dcc562304]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KIAJTZVw {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KIAJTZVw" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5616b4e-c9c4-4cbf-8267-0087cfe91edf]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KIAJTZVw'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[355b7eb3-6ec8-43d3-a1d6-1fc609353837]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd41bc5d-46db-483c-8f0a-bc6d06d2e1ae]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:30:21 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:30:21 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:30:21 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:30:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:30:21 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:30:21 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:30:21 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:30:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG nova.network.neutron [req-8d13544c-651d-47d5-872c-df0bbef31dfe req-69ed86a4-dd09-4445-b40d-299c878e0c3f service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Updated VIF entry in instance network info cache for port 6f21df63-1895-4500-b119-c4670a7f3569. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG nova.network.neutron [req-8d13544c-651d-47d5-872c-df0bbef31dfe req-69ed86a4-dd09-4445-b40d-299c878e0c3f service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Updating instance_info_cache with network_info: [{"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-8d13544c-651d-47d5-872c-df0bbef31dfe req-69ed86a4-dd09-4445-b40d-299c878e0c3f service nova] Releasing lock "refresh_cache-546c0c08-35f1-4043-ac30-56d49bc86af1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c01a5e-015b-4005-8348-683193180d6a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c, portal: 172.16.0.220,3260]
Apr 12 12:30:21 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c, portal: 172.16.0.220,3260] successful.
Apr 12 12:30:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea37b962-5cd0-4abe-b014-8c1a05c6edb9]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4882125c-4095-43c5-bb8c-a7c6ed033e65]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:30:21 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:30:21 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:30:21 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:30:21 user nova-compute[71321]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c (non-flash)
Apr 12 12:30:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:30:21 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:30:21 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:30:21 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:30:21 user nova-compute[71321]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c (non-flash)
Apr 12 12:30:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[87255c61-238f-45db-86f2-a2f0df07b468]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:30:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KIAJTZVw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:30:22 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:30:22 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23538393363303839', 'path': '/dev/sdf'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:30:22 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538393363303839', 'path': '/dev/sdf'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:30:22 user nova-compute[71321]: DEBUG nova.objects.instance [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lazy-loading 'flavor' on Instance uuid 5a054fbb-bfb4-40fa-8a03-a0c201df6857 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:30:22 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 12:30:22 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:30:22 user nova-compute[71321]:   <source dev="/dev/sdf"/>
Apr 12 12:30:22 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:30:22 user nova-compute[71321]:   <serial>149aa9b1-4712-4377-899a-30c28b5a826c</serial>
Apr 12 12:30:22 user nova-compute[71321]: </disk>
Apr 12 12:30:22 user nova-compute[71321]:  {{(pid=71321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 12:30:22 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:30:22 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:30:22 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] No VIF found with MAC fa:16:3e:72:15:77, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:30:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "5a054fbb-bfb4-40fa-8a03-a0c201df6857" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.046s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Acquiring lock "5a054fbb-bfb4-40fa-8a03-a0c201df6857" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "5a054fbb-bfb4-40fa-8a03-a0c201df6857" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Acquiring lock "5a054fbb-bfb4-40fa-8a03-a0c201df6857-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "5a054fbb-bfb4-40fa-8a03-a0c201df6857-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "5a054fbb-bfb4-40fa-8a03-a0c201df6857-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:23 user nova-compute[71321]: INFO nova.compute.manager [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Terminating instance
Apr 12 12:30:23 user nova-compute[71321]: DEBUG nova.compute.manager [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:30:23 user nova-compute[71321]: DEBUG nova.compute.manager [req-6d89e6a9-df14-4150-b3c8-7b8c37ad848b req-55137e77-a4d3-4c3d-a1d1-39c39832cc8e service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Received event network-changed-b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:30:23 user nova-compute[71321]: DEBUG nova.compute.manager [req-6d89e6a9-df14-4150-b3c8-7b8c37ad848b req-55137e77-a4d3-4c3d-a1d1-39c39832cc8e service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Refreshing instance network info cache due to event network-changed-b5f18af0-544d-4978-b20e-85da7e880834. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:30:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-6d89e6a9-df14-4150-b3c8-7b8c37ad848b req-55137e77-a4d3-4c3d-a1d1-39c39832cc8e service nova] Acquiring lock "refresh_cache-839e85a2-f7af-482d-a5e6-09195888300e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:30:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-6d89e6a9-df14-4150-b3c8-7b8c37ad848b req-55137e77-a4d3-4c3d-a1d1-39c39832cc8e service nova] Acquired lock "refresh_cache-839e85a2-f7af-482d-a5e6-09195888300e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:30:23 user nova-compute[71321]: DEBUG nova.network.neutron [req-6d89e6a9-df14-4150-b3c8-7b8c37ad848b req-55137e77-a4d3-4c3d-a1d1-39c39832cc8e service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Refreshing network info cache for port b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:30:23 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:23 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:23 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:23 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:23 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG nova.compute.manager [req-04140b14-015a-4fa7-abb7-96c6d632c1f5 req-2de537c1-65f6-4e8d-a619-ce28b2cee09a service nova] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Received event network-vif-unplugged-bea9db47-d43e-4df8-a5f2-e934e855cfa5 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-04140b14-015a-4fa7-abb7-96c6d632c1f5 req-2de537c1-65f6-4e8d-a619-ce28b2cee09a service nova] Acquiring lock "5a054fbb-bfb4-40fa-8a03-a0c201df6857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-04140b14-015a-4fa7-abb7-96c6d632c1f5 req-2de537c1-65f6-4e8d-a619-ce28b2cee09a service nova] Lock "5a054fbb-bfb4-40fa-8a03-a0c201df6857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-04140b14-015a-4fa7-abb7-96c6d632c1f5 req-2de537c1-65f6-4e8d-a619-ce28b2cee09a service nova] Lock "5a054fbb-bfb4-40fa-8a03-a0c201df6857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG nova.compute.manager [req-04140b14-015a-4fa7-abb7-96c6d632c1f5 req-2de537c1-65f6-4e8d-a619-ce28b2cee09a service nova] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] No waiting events found dispatching network-vif-unplugged-bea9db47-d43e-4df8-a5f2-e934e855cfa5 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG nova.compute.manager [req-04140b14-015a-4fa7-abb7-96c6d632c1f5 req-2de537c1-65f6-4e8d-a619-ce28b2cee09a service nova] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Received event network-vif-unplugged-bea9db47-d43e-4df8-a5f2-e934e855cfa5 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG nova.network.neutron [req-6d89e6a9-df14-4150-b3c8-7b8c37ad848b req-55137e77-a4d3-4c3d-a1d1-39c39832cc8e service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Updated VIF entry in instance network info cache for port b5f18af0-544d-4978-b20e-85da7e880834. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG nova.network.neutron [req-6d89e6a9-df14-4150-b3c8-7b8c37ad848b req-55137e77-a4d3-4c3d-a1d1-39c39832cc8e service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Updating instance_info_cache with network_info: [{"id": "b5f18af0-544d-4978-b20e-85da7e880834", "address": "fa:16:3e:f7:93:c8", "network": {"id": "b6e89fad-c9f7-473e-ab76-3f005281cc95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-175129642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1faa529d424800900e10a7ceaa63d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f18af0-54", "ovs_interfaceid": "b5f18af0-544d-4978-b20e-85da7e880834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-6d89e6a9-df14-4150-b3c8-7b8c37ad848b req-55137e77-a4d3-4c3d-a1d1-39c39832cc8e service nova] Releasing lock "refresh_cache-839e85a2-f7af-482d-a5e6-09195888300e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:24 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Instance destroyed successfully.
Apr 12 12:30:24 user nova-compute[71321]: DEBUG nova.objects.instance [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lazy-loading 'resources' on Instance uuid 5a054fbb-bfb4-40fa-8a03-a0c201df6857 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:28:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1808317084',display_name='tempest-DeleteServersTestJSON-server-1808317084',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1808317084',id=3,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:28:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c8ee9df3d2043fb818cc565b1d3e9d2',ramdisk_id='',reservation_id='r-xo51kons',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-2075182425',owner_user_name='tempest-DeleteServersTestJSON-2075182425-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:28:39Z,user_data=None,user_id='f0d432191ea141a58407f7b21d077b58',uuid=5a054fbb-bfb4-40fa-8a03-a0c201df6857,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bea9db47-d43e-4df8-a5f2-e934e855cfa5", "address": "fa:16:3e:72:15:77", "network": {"id": "92e6cafe-3321-4251-bb51-8cd4315282b7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2087616823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c8ee9df3d2043fb818cc565b1d3e9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbea9db47-d4", "ovs_interfaceid": "bea9db47-d43e-4df8-a5f2-e934e855cfa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Converting VIF {"id": "bea9db47-d43e-4df8-a5f2-e934e855cfa5", "address": "fa:16:3e:72:15:77", "network": {"id": "92e6cafe-3321-4251-bb51-8cd4315282b7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2087616823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c8ee9df3d2043fb818cc565b1d3e9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbea9db47-d4", "ovs_interfaceid": "bea9db47-d43e-4df8-a5f2-e934e855cfa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:15:77,bridge_name='br-int',has_traffic_filtering=True,id=bea9db47-d43e-4df8-a5f2-e934e855cfa5,network=Network(92e6cafe-3321-4251-bb51-8cd4315282b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbea9db47-d4') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG os_vif [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:15:77,bridge_name='br-int',has_traffic_filtering=True,id=bea9db47-d43e-4df8-a5f2-e934e855cfa5,network=Network(92e6cafe-3321-4251-bb51-8cd4315282b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbea9db47-d4') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbea9db47-d4, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:24 user nova-compute[71321]: INFO os_vif [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:15:77,bridge_name='br-int',has_traffic_filtering=True,id=bea9db47-d43e-4df8-a5f2-e934e855cfa5,network=Network(92e6cafe-3321-4251-bb51-8cd4315282b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbea9db47-d4')
Apr 12 12:30:24 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KIAJTZVw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:30:24 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:30:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45c2396-1d0d-4b80-a44d-2568408804d4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:30:24 user nova-compute[71321]: No targets found.
Apr 12 12:30:24 user nova-compute[71321]: iSNS:
Apr 12 12:30:24 user nova-compute[71321]: No targets found.
Apr 12 12:30:24 user nova-compute[71321]: STATIC:
Apr 12 12:30:24 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569
Apr 12 12:30:24 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:30:24 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:30:24 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c
Apr 12 12:30:24 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:30:24 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:30:24 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24
Apr 12 12:30:24 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:30:24 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:30:24 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3
Apr 12 12:30:24 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:30:24 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:30:24 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc
Apr 12 12:30:24 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:30:24 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:30:24 user nova-compute[71321]: FIRMWARE:
Apr 12 12:30:24 user nova-compute[71321]: No targets found.
Apr 12 12:30:24 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:30:24 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:30:24 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec916cb4-b9a7-469d-b2c6-6f6708c445fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[082a198b-e663-4a35-bac9-64b6e1c2311b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:30:24 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:30:24 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:30:24 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:30:24 user nova-compute[71321]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c (non-flash)
Apr 12 12:30:24 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:30:24 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:30:24 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:30:24 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:30:24 user nova-compute[71321]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c (non-flash)
Apr 12 12:30:24 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef8a17a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c'): ({'sdf'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Removing single pathed devices sdf {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1ed3c6-cf36-4dfc-bdd3-dc7705dd135f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde5dad2-f2ba-49be-a1f3-bc0900e4645b]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Flushing IO for device /dev/sdf {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ef81e8-2e5e-40b9-ad22-e04a3639384d]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.054s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e87bdb0-ad30-443f-b0b7-dfda11b5d0f7]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] SCSI volumes sdf have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4355ba7d-3d73-47cb-a02d-e9fd4709e411]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac36a92-9d60-4db6-a21b-4896c597f421]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c, portal: 172.16.0.220,3260]
Apr 12 12:30:24 user nova-compute[71321]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c, portal: 172.16.0.220,3260] successful.
Apr 12 12:30:24 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG nova.compute.manager [None req-aeb7cf0e-86c1-45fd-81cb-e8d6442c5263 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:149aa9b1-4712-4377-899a-30c28b5a826c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f222fa96-93e9-463f-ae5a-ab94c6f90ebd]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] <== disconnect_volume: return (364ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:30:24 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:30:24 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Deleting instance files /opt/stack/data/nova/instances/5a054fbb-bfb4-40fa-8a03-a0c201df6857_del
Apr 12 12:30:24 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Deletion of /opt/stack/data/nova/instances/5a054fbb-bfb4-40fa-8a03-a0c201df6857_del complete
Apr 12 12:30:25 user nova-compute[71321]: INFO nova.compute.manager [None req-aeb7cf0e-86c1-45fd-81cb-e8d6442c5263 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] instance snapshotting
Apr 12 12:30:25 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-aeb7cf0e-86c1-45fd-81cb-e8d6442c5263 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Beginning live snapshot process
Apr 12 12:30:25 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Checking UEFI support for host arch (x86_64) {{(pid=71321) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1722}}
Apr 12 12:30:25 user nova-compute[71321]: INFO nova.virt.libvirt.host [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] UEFI support detected
Apr 12 12:30:25 user nova-compute[71321]: INFO nova.compute.manager [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Took 1.37 seconds to destroy the instance on the hypervisor.
Apr 12 12:30:25 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:30:25 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:30:25 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:30:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-aeb7cf0e-86c1-45fd-81cb-e8d6442c5263 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk --force-share --output=json -f qcow2 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-aeb7cf0e-86c1-45fd-81cb-e8d6442c5263 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk --force-share --output=json -f qcow2" returned: 0 in 0.193s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-aeb7cf0e-86c1-45fd-81cb-e8d6442c5263 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk --force-share --output=json -f qcow2 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-aeb7cf0e-86c1-45fd-81cb-e8d6442c5263 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk --force-share --output=json -f qcow2" returned: 0 in 0.162s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-aeb7cf0e-86c1-45fd-81cb-e8d6442c5263 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-aeb7cf0e-86c1-45fd-81cb-e8d6442c5263 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.180s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-aeb7cf0e-86c1-45fd-81cb-e8d6442c5263 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1huhdng7/aae90532c6d340e49a96d01a07b71a12.delta 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:25 user nova-compute[71321]: DEBUG nova.compute.manager [req-f44ff3dd-9dd7-462b-bee6-471110e67958 req-c93228bd-b501-4d6e-a234-e293259a81ae service nova] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Received event network-vif-deleted-bea9db47-d43e-4df8-a5f2-e934e855cfa5 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:30:25 user nova-compute[71321]: INFO nova.compute.manager [req-f44ff3dd-9dd7-462b-bee6-471110e67958 req-c93228bd-b501-4d6e-a234-e293259a81ae service nova] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Neutron deleted interface bea9db47-d43e-4df8-a5f2-e934e855cfa5; detaching it from the instance and deleting it from the info cache
Apr 12 12:30:25 user nova-compute[71321]: DEBUG nova.network.neutron [req-f44ff3dd-9dd7-462b-bee6-471110e67958 req-c93228bd-b501-4d6e-a234-e293259a81ae service nova] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:30:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-aeb7cf0e-86c1-45fd-81cb-e8d6442c5263 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1huhdng7/aae90532c6d340e49a96d01a07b71a12.delta 1073741824" returned: 0 in 0.090s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:25 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:30:25 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-aeb7cf0e-86c1-45fd-81cb-e8d6442c5263 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 12 12:30:25 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Took 0.88 seconds to deallocate network for instance.
Apr 12 12:30:25 user nova-compute[71321]: DEBUG nova.compute.manager [req-f44ff3dd-9dd7-462b-bee6-471110e67958 req-c93228bd-b501-4d6e-a234-e293259a81ae service nova] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Detach interface failed, port_id=bea9db47-d43e-4df8-a5f2-e934e855cfa5, reason: Instance 5a054fbb-bfb4-40fa-8a03-a0c201df6857 could not be found. {{(pid=71321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 12:30:26 user nova-compute[71321]: DEBUG nova.compute.manager [req-2733a7a9-b4b6-45d9-bd10-7c9873db17b2 req-213dd09d-29ca-4e6a-91d8-7743cc26f80f service nova] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Received event network-vif-plugged-bea9db47-d43e-4df8-a5f2-e934e855cfa5 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:30:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2733a7a9-b4b6-45d9-bd10-7c9873db17b2 req-213dd09d-29ca-4e6a-91d8-7743cc26f80f service nova] Acquiring lock "5a054fbb-bfb4-40fa-8a03-a0c201df6857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2733a7a9-b4b6-45d9-bd10-7c9873db17b2 req-213dd09d-29ca-4e6a-91d8-7743cc26f80f service nova] Lock "5a054fbb-bfb4-40fa-8a03-a0c201df6857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2733a7a9-b4b6-45d9-bd10-7c9873db17b2 req-213dd09d-29ca-4e6a-91d8-7743cc26f80f service nova] Lock "5a054fbb-bfb4-40fa-8a03-a0c201df6857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:26 user nova-compute[71321]: DEBUG nova.compute.manager [req-2733a7a9-b4b6-45d9-bd10-7c9873db17b2 req-213dd09d-29ca-4e6a-91d8-7743cc26f80f service nova] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] No waiting events found dispatching network-vif-plugged-bea9db47-d43e-4df8-a5f2-e934e855cfa5 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:30:26 user nova-compute[71321]: WARNING nova.compute.manager [req-2733a7a9-b4b6-45d9-bd10-7c9873db17b2 req-213dd09d-29ca-4e6a-91d8-7743cc26f80f service nova] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Received unexpected event network-vif-plugged-bea9db47-d43e-4df8-a5f2-e934e855cfa5 for instance with vm_state active and task_state deleting.
Apr 12 12:30:26 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-aeb7cf0e-86c1-45fd-81cb-e8d6442c5263 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71321) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 12:30:27 user nova-compute[71321]: INFO nova.compute.manager [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Took 1.08 seconds to detach 1 volumes for instance.
Apr 12 12:30:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-aeb7cf0e-86c1-45fd-81cb-e8d6442c5263 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71321) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 12:30:27 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-aeb7cf0e-86c1-45fd-81cb-e8d6442c5263 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 12 12:30:27 user nova-compute[71321]: DEBUG nova.privsep.utils [None req-aeb7cf0e-86c1-45fd-81cb-e8d6442c5263 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 12:30:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-aeb7cf0e-86c1-45fd-81cb-e8d6442c5263 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1huhdng7/aae90532c6d340e49a96d01a07b71a12.delta /opt/stack/data/nova/instances/snapshots/tmp1huhdng7/aae90532c6d340e49a96d01a07b71a12 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:27 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:30:27 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:30:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.491s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:27 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Deleted allocations for instance 5a054fbb-bfb4-40fa-8a03-a0c201df6857
Apr 12 12:30:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-aeb7cf0e-86c1-45fd-81cb-e8d6442c5263 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1huhdng7/aae90532c6d340e49a96d01a07b71a12.delta /opt/stack/data/nova/instances/snapshots/tmp1huhdng7/aae90532c6d340e49a96d01a07b71a12" returned: 0 in 0.277s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:27 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-aeb7cf0e-86c1-45fd-81cb-e8d6442c5263 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Snapshot extracted, beginning image upload
Apr 12 12:30:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "5a054fbb-bfb4-40fa-8a03-a0c201df6857" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.098s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:30 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-aeb7cf0e-86c1-45fd-81cb-e8d6442c5263 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Snapshot image upload complete
Apr 12 12:30:30 user nova-compute[71321]: INFO nova.compute.manager [None req-aeb7cf0e-86c1-45fd-81cb-e8d6442c5263 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Took 5.03 seconds to snapshot the instance on the hypervisor.
Apr 12 12:30:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:39 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:39 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681302624.5119662, 5a054fbb-bfb4-40fa-8a03-a0c201df6857 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:30:39 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] VM Stopped (Lifecycle Event)
Apr 12 12:30:39 user nova-compute[71321]: DEBUG nova.compute.manager [None req-942433df-79ac-44d5-bc41-7f274eaa5b9f None None] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:30:39 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:43 user nova-compute[71321]: DEBUG nova.compute.manager [req-57945fad-6866-40b1-b8a8-ae233083ea39 req-0f7c9e91-97e4-464d-ad9e-dc69a5d092f6 service nova] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Received event network-changed-69203d15-c034-4d74-915d-1fc13c89ee40 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:30:43 user nova-compute[71321]: DEBUG nova.compute.manager [req-57945fad-6866-40b1-b8a8-ae233083ea39 req-0f7c9e91-97e4-464d-ad9e-dc69a5d092f6 service nova] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Refreshing instance network info cache due to event network-changed-69203d15-c034-4d74-915d-1fc13c89ee40. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:30:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-57945fad-6866-40b1-b8a8-ae233083ea39 req-0f7c9e91-97e4-464d-ad9e-dc69a5d092f6 service nova] Acquiring lock "refresh_cache-540a69c0-488f-40cb-bdde-3e410029d4c8" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:30:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-57945fad-6866-40b1-b8a8-ae233083ea39 req-0f7c9e91-97e4-464d-ad9e-dc69a5d092f6 service nova] Acquired lock "refresh_cache-540a69c0-488f-40cb-bdde-3e410029d4c8" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:30:43 user nova-compute[71321]: DEBUG nova.network.neutron [req-57945fad-6866-40b1-b8a8-ae233083ea39 req-0f7c9e91-97e4-464d-ad9e-dc69a5d092f6 service nova] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Refreshing network info cache for port 69203d15-c034-4d74-915d-1fc13c89ee40 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:30:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "540a69c0-488f-40cb-bdde-3e410029d4c8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "540a69c0-488f-40cb-bdde-3e410029d4c8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:43 user nova-compute[71321]: DEBUG nova.objects.instance [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lazy-loading 'flavor' on Instance uuid 540a69c0-488f-40cb-bdde-3e410029d4c8 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:30:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "540a69c0-488f-40cb-bdde-3e410029d4c8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "540a69c0-488f-40cb-bdde-3e410029d4c8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "540a69c0-488f-40cb-bdde-3e410029d4c8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:44 user nova-compute[71321]: INFO nova.compute.manager [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Attaching volume e311de8d-6a47-423c-a299-4ce16f4d10f1 to /dev/vdb
Apr 12 12:30:44 user nova-compute[71321]: DEBUG os_brick.utils [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:30:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9871f746-5977-4dbd-9f73-3bc94d34a764]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7e364c-7d55-4e05-ad64-18f9c5712b66]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:44 user nova-compute[71321]: DEBUG nova.network.neutron [req-57945fad-6866-40b1-b8a8-ae233083ea39 req-0f7c9e91-97e4-464d-ad9e-dc69a5d092f6 service nova] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Updated VIF entry in instance network info cache for port 69203d15-c034-4d74-915d-1fc13c89ee40. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:30:44 user nova-compute[71321]: DEBUG nova.network.neutron [req-57945fad-6866-40b1-b8a8-ae233083ea39 req-0f7c9e91-97e4-464d-ad9e-dc69a5d092f6 service nova] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Updating instance_info_cache with network_info: [{"id": "69203d15-c034-4d74-915d-1fc13c89ee40", "address": "fa:16:3e:1b:12:96", "network": {"id": "7e291b14-2505-4769-a423-3025cafb6fbc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-752511885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c4688a3b0b429fb12d12ab7bd14e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69203d15-c0", "ovs_interfaceid": "69203d15-c034-4d74-915d-1fc13c89ee40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:30:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-57945fad-6866-40b1-b8a8-ae233083ea39 req-0f7c9e91-97e4-464d-ad9e-dc69a5d092f6 service nova] Releasing lock "refresh_cache-540a69c0-488f-40cb-bdde-3e410029d4c8" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:30:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4137e2-a214-4573-93d1-f5042dccbe17]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f52fb12-3ead-4498-80fd-7673f31075b0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:30:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:30:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:30:44 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:30:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ee1871-93bc-4c5c-8012-d101a47d40da]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:30:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:30:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:30:44 user nova-compute[71321]: DEBUG os_brick.utils [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:30:44 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Updating existing volume attachment record: 7700643c-9aeb-4f5e-9f85-5811b0c1a328 {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:30:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:44 user nova-compute[71321]: DEBUG nova.compute.manager [req-3e2fc118-ba46-4b04-be88-c329299c270a req-f3666317-4987-4fbb-9c16-341f91df1c4f service nova] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Received event network-changed-7db9ebe7-8544-46eb-8d75-929d0422278f {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:30:44 user nova-compute[71321]: DEBUG nova.compute.manager [req-3e2fc118-ba46-4b04-be88-c329299c270a req-f3666317-4987-4fbb-9c16-341f91df1c4f service nova] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Refreshing instance network info cache due to event network-changed-7db9ebe7-8544-46eb-8d75-929d0422278f. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:30:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3e2fc118-ba46-4b04-be88-c329299c270a req-f3666317-4987-4fbb-9c16-341f91df1c4f service nova] Acquiring lock "refresh_cache-2f3ff25a-522c-431b-a177-85177401c7a9" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:30:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3e2fc118-ba46-4b04-be88-c329299c270a req-f3666317-4987-4fbb-9c16-341f91df1c4f service nova] Acquired lock "refresh_cache-2f3ff25a-522c-431b-a177-85177401c7a9" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:30:44 user nova-compute[71321]: DEBUG nova.network.neutron [req-3e2fc118-ba46-4b04-be88-c329299c270a req-f3666317-4987-4fbb-9c16-341f91df1c4f service nova] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Refreshing network info cache for port 7db9ebe7-8544-46eb-8d75-929d0422278f {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:30:45 user nova-compute[71321]: DEBUG nova.network.neutron [req-3e2fc118-ba46-4b04-be88-c329299c270a req-f3666317-4987-4fbb-9c16-341f91df1c4f service nova] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Updated VIF entry in instance network info cache for port 7db9ebe7-8544-46eb-8d75-929d0422278f. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:30:45 user nova-compute[71321]: DEBUG nova.network.neutron [req-3e2fc118-ba46-4b04-be88-c329299c270a req-f3666317-4987-4fbb-9c16-341f91df1c4f service nova] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Updating instance_info_cache with network_info: [{"id": "7db9ebe7-8544-46eb-8d75-929d0422278f", "address": "fa:16:3e:aa:c6:e9", "network": {"id": "ed1e01b0-282c-4171-88ab-4f0eb80724e2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-826776752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02f3f538463546f9a0eab47df52e2f56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7db9ebe7-85", "ovs_interfaceid": "7db9ebe7-8544-46eb-8d75-929d0422278f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:30:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3e2fc118-ba46-4b04-be88-c329299c270a req-f3666317-4987-4fbb-9c16-341f91df1c4f service nova] Releasing lock "refresh_cache-2f3ff25a-522c-431b-a177-85177401c7a9" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:30:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "2f3ff25a-522c-431b-a177-85177401c7a9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "2f3ff25a-522c-431b-a177-85177401c7a9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:46 user nova-compute[71321]: DEBUG nova.objects.instance [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lazy-loading 'flavor' on Instance uuid 2f3ff25a-522c-431b-a177-85177401c7a9 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:30:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "2f3ff25a-522c-431b-a177-85177401c7a9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:46 user nova-compute[71321]: DEBUG nova.compute.manager [req-caffee29-90b1-4d14-a2d6-e457b126f018 req-591c75a2-a54e-4070-b6a7-6fc4cd2e074f service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Received event network-changed-201eadd8-c760-4862-bcce-bcff996371f9 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:30:46 user nova-compute[71321]: DEBUG nova.compute.manager [req-caffee29-90b1-4d14-a2d6-e457b126f018 req-591c75a2-a54e-4070-b6a7-6fc4cd2e074f service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Refreshing instance network info cache due to event network-changed-201eadd8-c760-4862-bcce-bcff996371f9. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:30:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-caffee29-90b1-4d14-a2d6-e457b126f018 req-591c75a2-a54e-4070-b6a7-6fc4cd2e074f service nova] Acquiring lock "refresh_cache-79bee3fe-3300-4a28-b079-1bafaa1033c4" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:30:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-caffee29-90b1-4d14-a2d6-e457b126f018 req-591c75a2-a54e-4070-b6a7-6fc4cd2e074f service nova] Acquired lock "refresh_cache-79bee3fe-3300-4a28-b079-1bafaa1033c4" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:30:46 user nova-compute[71321]: DEBUG nova.network.neutron [req-caffee29-90b1-4d14-a2d6-e457b126f018 req-591c75a2-a54e-4070-b6a7-6fc4cd2e074f service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Refreshing network info cache for port 201eadd8-c760-4862-bcce-bcff996371f9 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:30:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "2f3ff25a-522c-431b-a177-85177401c7a9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "2f3ff25a-522c-431b-a177-85177401c7a9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:46 user nova-compute[71321]: INFO nova.compute.manager [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Attaching volume 43cc7387-42a1-4c71-bb86-64ec15a30ec9 to /dev/sdc
Apr 12 12:30:46 user nova-compute[71321]: DEBUG os_brick.utils [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:30:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:46 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3e8ed1-3aa7-473e-89ac-58e8765e256d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:46 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[de02b378-8e02-4e2c-bdd8-d822bcb72224]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:46 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4e16d7-24c4-4d10-a338-aecca727a3f6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:46 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[20452a6e-1ee2-4509-a9f9-746a81ab521e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:30:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:30:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:30:46 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:30:46 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82ab10d-3664-42f2-ac26-9d0ff080e60d]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:30:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:30:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:30:46 user nova-compute[71321]: DEBUG os_brick.utils [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:30:46 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Updating existing volume attachment record: 6428158a-18e4-4600-ae22-2e14d4dceea3 {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:30:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "interface-79bee3fe-3300-4a28-b079-1bafaa1033c4-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "interface-79bee3fe-3300-4a28-b079-1bafaa1033c4-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:47 user nova-compute[71321]: DEBUG nova.objects.instance [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lazy-loading 'flavor' on Instance uuid 79bee3fe-3300-4a28-b079-1bafaa1033c4 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:30:47 user nova-compute[71321]: DEBUG nova.objects.instance [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lazy-loading 'pci_requests' on Instance uuid 79bee3fe-3300-4a28-b079-1bafaa1033c4 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:30:47 user nova-compute[71321]: DEBUG nova.network.neutron [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:30:47 user nova-compute[71321]: DEBUG nova.policy [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2ff191ffb9604795bab6ada1eafd41ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd2a4a665514d0eb31653775b67356a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:30:47 user nova-compute[71321]: DEBUG nova.network.neutron [req-caffee29-90b1-4d14-a2d6-e457b126f018 req-591c75a2-a54e-4070-b6a7-6fc4cd2e074f service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Updated VIF entry in instance network info cache for port 201eadd8-c760-4862-bcce-bcff996371f9. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:30:47 user nova-compute[71321]: DEBUG nova.network.neutron [req-caffee29-90b1-4d14-a2d6-e457b126f018 req-591c75a2-a54e-4070-b6a7-6fc4cd2e074f service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Updating instance_info_cache with network_info: [{"id": "201eadd8-c760-4862-bcce-bcff996371f9", "address": "fa:16:3e:4a:27:fd", "network": {"id": "a751f1e2-998e-4446-b94e-4bab0dc80db7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-990400052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dd2a4a665514d0eb31653775b67356a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201eadd8-c7", "ovs_interfaceid": "201eadd8-c760-4862-bcce-bcff996371f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:30:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-caffee29-90b1-4d14-a2d6-e457b126f018 req-591c75a2-a54e-4070-b6a7-6fc4cd2e074f service nova] Releasing lock "refresh_cache-79bee3fe-3300-4a28-b079-1bafaa1033c4" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:30:48 user nova-compute[71321]: DEBUG nova.network.neutron [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Successfully created port: 8438a9df-803e-44da-a2b6-b394bd23fbb1 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:30:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:30:48 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DRaPIpfK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:30:48 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:30:48 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:30:48 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:30:48 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:30:48 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:30:48 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:30:48 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:30:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:48 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[823fed53-f795-4a58-86f7-8f4b7df16aae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:48 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:30:48 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df60a51-ee94-4eb4-8893-25118aa05cc7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1] added
Apr 12 12:30:49 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d7b777-1206-4f27-a13e-97ececcbe4d1]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d13758-2cab-4291-ae5d-aa45c8821652]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DRaPIpfK {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DRaPIpfK" returned: 0 in 0.029s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf82e56-4796-4d81-b1a2-a433363949b9]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DRaPIpfK'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49e7392-ca48-4348-a0b0-790b46f5c47e]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c068eee-c546-41b2-886d-d746e5e13228]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:30:49 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:30:49 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:30:49 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:30:49 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:30:49 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:30:49 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:30:49 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:30:49 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[304c82ce-7105-4144-833c-b2c2c7901bdb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1, portal: 172.16.0.220,3260]
Apr 12 12:30:49 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1, portal: 172.16.0.220,3260] successful.
Apr 12 12:30:49 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[438931e8-c569-4c10-961a-ea86bdf540a5]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[864d8f67-7573-45c9-b0dc-86664093e562]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:30:49 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:30:49 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:30:49 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:30:49 user nova-compute[71321]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)
Apr 12 12:30:49 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:30:49 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:30:49 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:30:49 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:30:49 user nova-compute[71321]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)
Apr 12 12:30:49 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2983b2-62c2-442b-a526-87a18400bf06]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DRaPIpfK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG nova.network.neutron [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Successfully updated port: 8438a9df-803e-44da-a2b6-b394bd23fbb1 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "refresh_cache-79bee3fe-3300-4a28-b079-1bafaa1033c4" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquired lock "refresh_cache-79bee3fe-3300-4a28-b079-1bafaa1033c4" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG nova.network.neutron [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG nova.compute.manager [req-486614ad-66ef-4acf-a81e-bed498079b6f req-3f2da9f0-f7b7-4d63-bb39-8326f48edf99 service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Received event network-changed-8438a9df-803e-44da-a2b6-b394bd23fbb1 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG nova.compute.manager [req-486614ad-66ef-4acf-a81e-bed498079b6f req-3f2da9f0-f7b7-4d63-bb39-8326f48edf99 service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Refreshing instance network info cache due to event network-changed-8438a9df-803e-44da-a2b6-b394bd23fbb1. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-486614ad-66ef-4acf-a81e-bed498079b6f req-3f2da9f0-f7b7-4d63-bb39-8326f48edf99 service nova] Acquiring lock "refresh_cache-79bee3fe-3300-4a28-b079-1bafaa1033c4" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG nova.network.neutron [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Updating instance_info_cache with network_info: [{"id": "201eadd8-c760-4862-bcce-bcff996371f9", "address": "fa:16:3e:4a:27:fd", "network": {"id": "a751f1e2-998e-4446-b94e-4bab0dc80db7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-990400052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dd2a4a665514d0eb31653775b67356a", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201eadd8-c7", "ovs_interfaceid": "201eadd8-c760-4862-bcce-bcff996371f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8438a9df-803e-44da-a2b6-b394bd23fbb1", "address": "fa:16:3e:10:ea:5b", "network": {"id": "fa236fb1-e347-4c0e-bb34-51cf6d7dd7f9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-842608701", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0dd2a4a665514d0eb31653775b67356a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8438a9df-80", "ovs_interfaceid": "8438a9df-803e-44da-a2b6-b394bd23fbb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Releasing lock "refresh_cache-79bee3fe-3300-4a28-b079-1bafaa1033c4" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-486614ad-66ef-4acf-a81e-bed498079b6f req-3f2da9f0-f7b7-4d63-bb39-8326f48edf99 service nova] Acquired lock "refresh_cache-79bee3fe-3300-4a28-b079-1bafaa1033c4" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG nova.network.neutron [req-486614ad-66ef-4acf-a81e-bed498079b6f req-3f2da9f0-f7b7-4d63-bb39-8326f48edf99 service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Refreshing network info cache for port 8438a9df-803e-44da-a2b6-b394bd23fbb1 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:28:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-656063872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-656063872',id=8,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxGfNEhwxyml0RYHshQIBVlikZPUICMVOtWr1cX5kE9lM3qDUztZplY9zWTLExsTj4Jyt4GyZTZtlPvLt0Z2/a5v2pzKXPmtIr/OlOJ6S/2MsrCvF+uqljaJkNsq+Gqvw==',key_name='tempest-keypair-134546144',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:29:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0dd2a4a665514d0eb31653775b67356a',ramdisk_id='',reservation_id='r-u0qzq363',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1949865572',owner_user_name='tempest-TaggedAttachmentsTest-1949865572-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:29:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ff191ffb9604795bab6ada1eafd41ff',uuid=79bee3fe-3300-4a28-b079-1bafaa1033c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8438a9df-803e-44da-a2b6-b394bd23fbb1", "address": "fa:16:3e:10:ea:5b", "network": {"id": "fa236fb1-e347-4c0e-bb34-51cf6d7dd7f9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-842608701", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0dd2a4a665514d0eb31653775b67356a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8438a9df-80", "ovs_interfaceid": "8438a9df-803e-44da-a2b6-b394bd23fbb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Converting VIF {"id": "8438a9df-803e-44da-a2b6-b394bd23fbb1", "address": "fa:16:3e:10:ea:5b", "network": {"id": "fa236fb1-e347-4c0e-bb34-51cf6d7dd7f9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-842608701", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0dd2a4a665514d0eb31653775b67356a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8438a9df-80", "ovs_interfaceid": "8438a9df-803e-44da-a2b6-b394bd23fbb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:ea:5b,bridge_name='br-int',has_traffic_filtering=True,id=8438a9df-803e-44da-a2b6-b394bd23fbb1,network=Network(fa236fb1-e347-4c0e-bb34-51cf6d7dd7f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8438a9df-80') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG os_vif [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:ea:5b,bridge_name='br-int',has_traffic_filtering=True,id=8438a9df-803e-44da-a2b6-b394bd23fbb1,network=Network(fa236fb1-e347-4c0e-bb34-51cf6d7dd7f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8438a9df-80') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8438a9df-80, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8438a9df-80, col_values=(('external_ids', {'iface-id': '8438a9df-803e-44da-a2b6-b394bd23fbb1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:ea:5b', 'vm-uuid': '79bee3fe-3300-4a28-b079-1bafaa1033c4'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:50 user nova-compute[71321]: INFO os_vif [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:ea:5b,bridge_name='br-int',has_traffic_filtering=True,id=8438a9df-803e-44da-a2b6-b394bd23fbb1,network=Network(fa236fb1-e347-4c0e-bb34-51cf6d7dd7f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8438a9df-80')
Apr 12 12:30:50 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:28:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-656063872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-656063872',id=8,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxGfNEhwxyml0RYHshQIBVlikZPUICMVOtWr1cX5kE9lM3qDUztZplY9zWTLExsTj4Jyt4GyZTZtlPvLt0Z2/a5v2pzKXPmtIr/OlOJ6S/2MsrCvF+uqljaJkNsq+Gqvw==',key_name='tempest-keypair-134546144',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:29:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0dd2a4a665514d0eb31653775b67356a',ramdisk_id='',reservation_id='r-u0qzq363',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1949865572',owner_user_name='tempest-TaggedAttachmentsTest-1949865572-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:29:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ff191ffb9604795bab6ada1eafd41ff',uuid=79bee3fe-3300-4a28-b079-1bafaa1033c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8438a9df-803e-44da-a2b6-b394bd23fbb1", "address": "fa:16:3e:10:ea:5b", "network": {"id": "fa236fb1-e347-4c0e-bb34-51cf6d7dd7f9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-842608701", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0dd2a4a665514d0eb31653775b67356a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8438a9df-80", "ovs_interfaceid": "8438a9df-803e-44da-a2b6-b394bd23fbb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Converting VIF {"id": "8438a9df-803e-44da-a2b6-b394bd23fbb1", "address": "fa:16:3e:10:ea:5b", "network": {"id": "fa236fb1-e347-4c0e-bb34-51cf6d7dd7f9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-842608701", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0dd2a4a665514d0eb31653775b67356a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8438a9df-80", "ovs_interfaceid": "8438a9df-803e-44da-a2b6-b394bd23fbb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:ea:5b,bridge_name='br-int',has_traffic_filtering=True,id=8438a9df-803e-44da-a2b6-b394bd23fbb1,network=Network(fa236fb1-e347-4c0e-bb34-51cf6d7dd7f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8438a9df-80') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] attach device xml: <interface type="ethernet">
Apr 12 12:30:50 user nova-compute[71321]:   <mac address="fa:16:3e:10:ea:5b"/>
Apr 12 12:30:50 user nova-compute[71321]:   <model type="virtio"/>
Apr 12 12:30:50 user nova-compute[71321]:   <mtu size="1442"/>
Apr 12 12:30:50 user nova-compute[71321]:   <target dev="tap8438a9df-80"/>
Apr 12 12:30:50 user nova-compute[71321]: </interface>
Apr 12 12:30:50 user nova-compute[71321]:  {{(pid=71321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23036656332633865', 'path': '/dev/sdf'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036656332633865', 'path': '/dev/sdf'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG nova.objects.instance [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lazy-loading 'flavor' on Instance uuid 540a69c0-488f-40cb-bdde-3e410029d4c8 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 12:30:50 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:30:50 user nova-compute[71321]:   <source dev="/dev/sdf"/>
Apr 12 12:30:50 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:30:50 user nova-compute[71321]:   <serial>e311de8d-6a47-423c-a299-4ce16f4d10f1</serial>
Apr 12 12:30:50 user nova-compute[71321]: </disk>
Apr 12 12:30:50 user nova-compute[71321]:  {{(pid=71321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] No BDM found with device name hda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] No VIF found with MAC fa:16:3e:4a:27:fd, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:30:50 user nova-compute[71321]:   <nova:package version="0.0.0"/>
Apr 12 12:30:50 user nova-compute[71321]:   <nova:name>tempest-device-tagging-server-656063872</nova:name>
Apr 12 12:30:50 user nova-compute[71321]:   <nova:creationTime>2023-04-12 12:30:50</nova:creationTime>
Apr 12 12:30:50 user nova-compute[71321]:   <nova:flavor name="m1.nano">
Apr 12 12:30:50 user nova-compute[71321]:     <nova:memory>128</nova:memory>
Apr 12 12:30:50 user nova-compute[71321]:     <nova:disk>1</nova:disk>
Apr 12 12:30:50 user nova-compute[71321]:     <nova:swap>0</nova:swap>
Apr 12 12:30:50 user nova-compute[71321]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:30:50 user nova-compute[71321]:     <nova:vcpus>1</nova:vcpus>
Apr 12 12:30:50 user nova-compute[71321]:   </nova:flavor>
Apr 12 12:30:50 user nova-compute[71321]:   <nova:owner>
Apr 12 12:30:50 user nova-compute[71321]:     <nova:user uuid="2ff191ffb9604795bab6ada1eafd41ff">tempest-TaggedAttachmentsTest-1949865572-project-member</nova:user>
Apr 12 12:30:50 user nova-compute[71321]:     <nova:project uuid="0dd2a4a665514d0eb31653775b67356a">tempest-TaggedAttachmentsTest-1949865572</nova:project>
Apr 12 12:30:50 user nova-compute[71321]:   </nova:owner>
Apr 12 12:30:50 user nova-compute[71321]:   <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:30:50 user nova-compute[71321]:   <nova:ports>
Apr 12 12:30:50 user nova-compute[71321]:     <nova:port uuid="201eadd8-c760-4862-bcce-bcff996371f9">
Apr 12 12:30:50 user nova-compute[71321]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 12:30:50 user nova-compute[71321]:     </nova:port>
Apr 12 12:30:50 user nova-compute[71321]:     <nova:port uuid="8438a9df-803e-44da-a2b6-b394bd23fbb1">
Apr 12 12:30:50 user nova-compute[71321]:       <nova:ip type="fixed" address="10.10.10.162" ipVersion="4"/>
Apr 12 12:30:50 user nova-compute[71321]:     </nova:port>
Apr 12 12:30:50 user nova-compute[71321]:   </nova:ports>
Apr 12 12:30:50 user nova-compute[71321]: </nova:instance>
Apr 12 12:30:50 user nova-compute[71321]:  {{(pid=71321) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "interface-79bee3fe-3300-4a28-b079-1bafaa1033c4-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.708s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:30:50 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] No VIF found with MAC fa:16:3e:1b:12:96, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG nova.network.neutron [req-486614ad-66ef-4acf-a81e-bed498079b6f req-3f2da9f0-f7b7-4d63-bb39-8326f48edf99 service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Updated VIF entry in instance network info cache for port 8438a9df-803e-44da-a2b6-b394bd23fbb1. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG nova.network.neutron [req-486614ad-66ef-4acf-a81e-bed498079b6f req-3f2da9f0-f7b7-4d63-bb39-8326f48edf99 service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Updating instance_info_cache with network_info: [{"id": "201eadd8-c760-4862-bcce-bcff996371f9", "address": "fa:16:3e:4a:27:fd", "network": {"id": "a751f1e2-998e-4446-b94e-4bab0dc80db7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-990400052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dd2a4a665514d0eb31653775b67356a", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201eadd8-c7", "ovs_interfaceid": "201eadd8-c760-4862-bcce-bcff996371f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8438a9df-803e-44da-a2b6-b394bd23fbb1", "address": "fa:16:3e:10:ea:5b", "network": {"id": "fa236fb1-e347-4c0e-bb34-51cf6d7dd7f9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-842608701", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0dd2a4a665514d0eb31653775b67356a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8438a9df-80", "ovs_interfaceid": "8438a9df-803e-44da-a2b6-b394bd23fbb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-486614ad-66ef-4acf-a81e-bed498079b6f req-3f2da9f0-f7b7-4d63-bb39-8326f48edf99 service nova] Releasing lock "refresh_cache-79bee3fe-3300-4a28-b079-1bafaa1033c4" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "79bee3fe-3300-4a28-b079-1bafaa1033c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "79bee3fe-3300-4a28-b079-1bafaa1033c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG nova.objects.instance [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lazy-loading 'flavor' on Instance uuid 79bee3fe-3300-4a28-b079-1bafaa1033c4 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "540a69c0-488f-40cb-bdde-3e410029d4c8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.030s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "79bee3fe-3300-4a28-b079-1bafaa1033c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "79bee3fe-3300-4a28-b079-1bafaa1033c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "79bee3fe-3300-4a28-b079-1bafaa1033c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:51 user nova-compute[71321]: INFO nova.compute.manager [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Attaching volume 690fc6dc-8836-419f-8039-0584b2561e4b to /dev/vdb
Apr 12 12:30:51 user nova-compute[71321]: DEBUG os_brick.utils [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c880919a-72c0-4c80-9b0f-45ffe6fb8f27]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acfe459-f607-4f8f-aec8-5d6c53524534]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58ba520-781d-4b4b-ae48-73946a1250f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4cd314-552e-4af6-8d9e-9cf55fa48f2d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bBRylaKq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:30:51 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:30:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:30:51 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:30:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:30:51 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:30:51 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d84f3f4-0898-4698-8dbc-d72c10faf83a]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG os_brick.utils [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Updating existing volume attachment record: 319f00a8-c3ed-4e19-8861-5212eef43295 {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG nova.compute.manager [req-911c9efe-b664-4dfe-879f-aca8d6cc0a8f req-aeb969a3-c21a-467a-8f6c-1ef3dd82258e service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Received event network-vif-plugged-8438a9df-803e-44da-a2b6-b394bd23fbb1 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-911c9efe-b664-4dfe-879f-aca8d6cc0a8f req-aeb969a3-c21a-467a-8f6c-1ef3dd82258e service nova] Acquiring lock "79bee3fe-3300-4a28-b079-1bafaa1033c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-911c9efe-b664-4dfe-879f-aca8d6cc0a8f req-aeb969a3-c21a-467a-8f6c-1ef3dd82258e service nova] Lock "79bee3fe-3300-4a28-b079-1bafaa1033c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-911c9efe-b664-4dfe-879f-aca8d6cc0a8f req-aeb969a3-c21a-467a-8f6c-1ef3dd82258e service nova] Lock "79bee3fe-3300-4a28-b079-1bafaa1033c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG nova.compute.manager [req-911c9efe-b664-4dfe-879f-aca8d6cc0a8f req-aeb969a3-c21a-467a-8f6c-1ef3dd82258e service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] No waiting events found dispatching network-vif-plugged-8438a9df-803e-44da-a2b6-b394bd23fbb1 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:30:51 user nova-compute[71321]: WARNING nova.compute.manager [req-911c9efe-b664-4dfe-879f-aca8d6cc0a8f req-aeb969a3-c21a-467a-8f6c-1ef3dd82258e service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Received unexpected event network-vif-plugged-8438a9df-803e-44da-a2b6-b394bd23fbb1 for instance with vm_state active and task_state None.
Apr 12 12:30:51 user nova-compute[71321]: DEBUG nova.compute.manager [req-911c9efe-b664-4dfe-879f-aca8d6cc0a8f req-aeb969a3-c21a-467a-8f6c-1ef3dd82258e service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Received event network-vif-plugged-8438a9df-803e-44da-a2b6-b394bd23fbb1 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-911c9efe-b664-4dfe-879f-aca8d6cc0a8f req-aeb969a3-c21a-467a-8f6c-1ef3dd82258e service nova] Acquiring lock "79bee3fe-3300-4a28-b079-1bafaa1033c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-911c9efe-b664-4dfe-879f-aca8d6cc0a8f req-aeb969a3-c21a-467a-8f6c-1ef3dd82258e service nova] Lock "79bee3fe-3300-4a28-b079-1bafaa1033c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-911c9efe-b664-4dfe-879f-aca8d6cc0a8f req-aeb969a3-c21a-467a-8f6c-1ef3dd82258e service nova] Lock "79bee3fe-3300-4a28-b079-1bafaa1033c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG nova.compute.manager [req-911c9efe-b664-4dfe-879f-aca8d6cc0a8f req-aeb969a3-c21a-467a-8f6c-1ef3dd82258e service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] No waiting events found dispatching network-vif-plugged-8438a9df-803e-44da-a2b6-b394bd23fbb1 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:30:51 user nova-compute[71321]: WARNING nova.compute.manager [req-911c9efe-b664-4dfe-879f-aca8d6cc0a8f req-aeb969a3-c21a-467a-8f6c-1ef3dd82258e service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Received unexpected event network-vif-plugged-8438a9df-803e-44da-a2b6-b394bd23fbb1 for instance with vm_state active and task_state None.
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac830ff-7d6a-402a-809d-3e1ffe4c6c6d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:30:51 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e02001-197d-4036-af29-4553788b70db]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9] added
Apr 12 12:30:51 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d683f9-489f-400d-bb9c-b12d49511e40]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb050eee-31f7-4817-9bf5-8d6326e6c6a2]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bBRylaKq {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bBRylaKq" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf65fad-781a-442b-afc3-e83f549153c9]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bBRylaKq'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c59b746-68dd-4d17-9d29-e06a5702e157]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2c6bf1-dc4b-463f-a09f-4efd20deec0a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:30:51 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:30:51 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:30:51 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:30:51 user nova-compute[71321]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)
Apr 12 12:30:51 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:30:51 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:30:51 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:30:51 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:30:51 user nova-compute[71321]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)
Apr 12 12:30:51 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9db8fa-bffd-402c-a23e-5148afc0f42d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9, portal: 172.16.0.220,3260]
Apr 12 12:30:51 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9, portal: 172.16.0.220,3260] successful.
Apr 12 12:30:51 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[59087d59-5126-4ca4-997c-b6d81d5c7efc]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a03663-1845-4cd4-9af3-6cd84bae3c38]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:30:51 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:30:51 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:30:51 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:30:51 user nova-compute[71321]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)
Apr 12 12:30:51 user nova-compute[71321]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9 (non-flash)
Apr 12 12:30:51 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:30:51 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:30:51 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:30:51 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:30:51 user nova-compute[71321]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)
Apr 12 12:30:51 user nova-compute[71321]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9 (non-flash)
Apr 12 12:30:51 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[41efa67a-7e47-433d-818f-9c8cc6b8b6f4]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:30:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bBRylaKq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:30:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Acquiring lock "540a69c0-488f-40cb-bdde-3e410029d4c8" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Lock "540a69c0-488f-40cb-bdde-3e410029d4c8" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:52 user nova-compute[71321]: DEBUG os_brick.utils [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:30:52 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:52 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:52 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a519216-ecfc-4f7d-8f18-b1b99f63945c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:52 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:52 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:52 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2c9d92-524c-4f00-9a8c-700bf82ebd43]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:52 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:52 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:52 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[22171381-5c87-4d94-a07d-4291279836ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:52 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01c5980-2937-403f-b99f-2da85bec3523]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:52 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:52 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:30:52 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:30:52 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:52 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:30:52 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:30:52 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1968bb65-29bf-4d98-b694-ffb31969810e]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:52 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:30:52 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:30:52 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:30:52 user nova-compute[71321]: DEBUG os_brick.utils [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:30:52 user nova-compute[71321]: INFO nova.compute.manager [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Swapping volume e311de8d-6a47-423c-a299-4ce16f4d10f1 for 173c47c1-0f4e-43d9-b90f-c6c458b25d5b
Apr 12 12:30:52 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:30:52 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23765303137656263', 'path': '/dev/sdg'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:30:52 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765303137656263', 'path': '/dev/sdg'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:30:52 user nova-compute[71321]: DEBUG nova.objects.instance [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lazy-loading 'flavor' on Instance uuid 2f3ff25a-522c-431b-a177-85177401c7a9 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:30:52 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 12:30:52 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:30:52 user nova-compute[71321]:   <source dev="/dev/sdg"/>
Apr 12 12:30:52 user nova-compute[71321]:   <target dev="sdc" bus="scsi"/>
Apr 12 12:30:52 user nova-compute[71321]:   <serial>43cc7387-42a1-4c71-bb86-64ec15a30ec9</serial>
Apr 12 12:30:52 user nova-compute[71321]:   <address type="drive" controller="0" unit="2"/>
Apr 12 12:30:52 user nova-compute[71321]: </disk>
Apr 12 12:30:52 user nova-compute[71321]:  {{(pid=71321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 12:30:53 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] No BDM found with device name sda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:30:53 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:30:53 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] No BDM found with device name sdc, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:30:53 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] No VIF found with MAC fa:16:3e:aa:c6:e9, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:30:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "2f3ff25a-522c-431b-a177-85177401c7a9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.726s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "2f3ff25a-522c-431b-a177-85177401c7a9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "2f3ff25a-522c-431b-a177-85177401c7a9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:54 user nova-compute[71321]: INFO nova.compute.manager [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Detaching volume 43cc7387-42a1-4c71-bb86-64ec15a30ec9
Apr 12 12:30:54 user nova-compute[71321]: INFO nova.virt.block_device [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Attempting to driver detach volume 43cc7387-42a1-4c71-bb86-64ec15a30ec9 from mountpoint /dev/sdc
Apr 12 12:30:54 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Attempting to detach device sdc from instance 2f3ff25a-522c-431b-a177-85177401c7a9 from the persistent domain config. {{(pid=71321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 12:30:54 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:30:54 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:30:54 user nova-compute[71321]:   <source dev="/dev/sdg"/>
Apr 12 12:30:54 user nova-compute[71321]:   <target dev="sdc" bus="scsi"/>
Apr 12 12:30:54 user nova-compute[71321]:   <serial>43cc7387-42a1-4c71-bb86-64ec15a30ec9</serial>
Apr 12 12:30:54 user nova-compute[71321]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 12 12:30:54 user nova-compute[71321]: </disk>
Apr 12 12:30:54 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:30:54 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Successfully detached device sdc from instance 2f3ff25a-522c-431b-a177-85177401c7a9 from the persistent domain config.
Apr 12 12:30:54 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 2f3ff25a-522c-431b-a177-85177401c7a9 from the live domain config. {{(pid=71321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 12:30:54 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:30:54 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:30:54 user nova-compute[71321]:   <source dev="/dev/sdg"/>
Apr 12 12:30:54 user nova-compute[71321]:   <target dev="sdc" bus="scsi"/>
Apr 12 12:30:54 user nova-compute[71321]:   <serial>43cc7387-42a1-4c71-bb86-64ec15a30ec9</serial>
Apr 12 12:30:54 user nova-compute[71321]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 12 12:30:54 user nova-compute[71321]: </disk>
Apr 12 12:30:54 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Received event <DeviceRemovedEvent: 1681302655.3354897, 2f3ff25a-522c-431b-a177-85177401c7a9 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 2f3ff25a-522c-431b-a177-85177401c7a9 {{(pid=71321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 12:30:55 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Successfully detached device sdc from instance 2f3ff25a-522c-431b-a177-85177401c7a9 from the live domain config.
Apr 12 12:30:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bBRylaKq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:30:55 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:30:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0c9023-05f3-4245-b721-f75862e78cad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:30:55 user nova-compute[71321]: No targets found.
Apr 12 12:30:55 user nova-compute[71321]: iSNS:
Apr 12 12:30:55 user nova-compute[71321]: No targets found.
Apr 12 12:30:55 user nova-compute[71321]: STATIC:
Apr 12 12:30:55 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1
Apr 12 12:30:55 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:30:55 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:30:55 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569
Apr 12 12:30:55 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:30:55 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:30:55 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24
Apr 12 12:30:55 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:30:55 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:30:55 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3
Apr 12 12:30:55 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:30:55 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:30:55 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9
Apr 12 12:30:55 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:30:55 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:30:55 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc
Apr 12 12:30:55 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:30:55 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:30:55 user nova-compute[71321]: FIRMWARE:
Apr 12 12:30:55 user nova-compute[71321]: No targets found.
Apr 12 12:30:55 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:30:55 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:30:55 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fad4631-f353-4640-8020-1f59b9d24fe0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4f82dd-b848-42cc-8133-5fb0a2b77daf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:30:55 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:30:55 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:30:55 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:30:55 user nova-compute[71321]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)
Apr 12 12:30:55 user nova-compute[71321]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9 (non-flash)
Apr 12 12:30:55 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:30:55 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:30:55 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:30:55 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:30:55 user nova-compute[71321]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)
Apr 12 12:30:55 user nova-compute[71321]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9 (non-flash)
Apr 12 12:30:55 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef642c5d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9'): ({'sdg'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Removing single pathed devices sdg {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30c25d1-6dd3-454e-95e4-52d12ad1ee40]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0675debe-cd44-4834-a76b-fd5c057549f3]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Flushing IO for device /dev/sdg {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[16aa8e8d-e04c-4b33-8c3f-88989f60ef27]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.036s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[5077844c-69da-44d9-b7c8-2ad27eb10263]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] SCSI volumes sdg have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81db746-ec8b-4d7c-b849-ab621029b1d3]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b493c5a-060a-47e4-9e03-357e75f51255]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9, portal: 172.16.0.220,3260]
Apr 12 12:30:55 user nova-compute[71321]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9, portal: 172.16.0.220,3260] successful.
Apr 12 12:30:55 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43cc7387-42a1-4c71-bb86-64ec15a30ec9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[344f14c2-12ee-4f94-95b1-0c2b7d5e0d56]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] <== disconnect_volume: return (344ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kmDIzbOZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:30:55 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:30:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:30:55 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:30:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:30:55 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[59122a2b-00e8-4a0a-bfa0-832d99c36dfc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:30:55 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28327b9-8433-4cb4-a67c-7d85a0783686]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b] added
Apr 12 12:30:55 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37da3eb-0123-4960-9d17-588bb98ca185]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[864414c9-58d5-4cdc-9095-0caed9b8204a]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kmDIzbOZ {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kmDIzbOZ" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9465f396-e95a-4e80-bff8-7a4ff3d37077]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kmDIzbOZ'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[05087d0b-7190-45df-859a-191323526031]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:56 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[286df9b9-448d-42a5-93ed-3c1f4c5e55a2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:56 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:30:56 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:30:56 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:30:56 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:30:56 user nova-compute[71321]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)
Apr 12 12:30:56 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:30:56 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:30:56 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:30:56 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:30:56 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:30:56 user nova-compute[71321]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)
Apr 12 12:30:56 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:30:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:56 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa7e569-7ac5-412f-9980-6d2ec5e025bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:56 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b, portal: 172.16.0.220,3260]
Apr 12 12:30:56 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b, portal: 172.16.0.220,3260] successful.
Apr 12 12:30:56 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:56 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b703277-0e12-428d-a694-6c3ababd37aa]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:56 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:56 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6dfa0b0-928e-4c78-b048-819888ab8f35]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:56 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:30:56 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:30:56 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:30:56 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:30:56 user nova-compute[71321]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)
Apr 12 12:30:56 user nova-compute[71321]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b (non-flash)
Apr 12 12:30:56 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:30:56 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:30:56 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:30:56 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:30:56 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:30:56 user nova-compute[71321]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)
Apr 12 12:30:56 user nova-compute[71321]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b (non-flash)
Apr 12 12:30:56 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:30:56 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:30:56 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:30:56 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] HCTL ('38', '-', '-', 0) found on session 9 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:30:56 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:30:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:56 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fc3cec-45d6-4473-b7b6-6d26ebb094e8]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:56 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Searching for a device in session 9 and hctl ['38', '*', '*', 0] yield: None {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:30:56 user nova-compute[71321]: DEBUG nova.objects.instance [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lazy-loading 'flavor' on Instance uuid 2f3ff25a-522c-431b-a177-85177401c7a9 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:30:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "2f3ff25a-522c-431b-a177-85177401c7a9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.757s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EIrGTaQl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '540a69c0-488f-40cb-bdde-3e410029d4c8', 'attached_at': '', 'detached_at': '', 'volume_id': '173c47c1-0f4e-43d9-b90f-c6c458b25d5b', 'serial': '173c47c1-0f4e-43d9-b90f-c6c458b25d5b'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DRaPIpfK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '540a69c0-488f-40cb-bdde-3e410029d4c8', 'attached_at': '', 'detached_at': '', 'volume_id': 'e311de8d-6a47-423c-a299-4ce16f4d10f1', 'serial'} {{(pid=71321) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 12 12:30:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:30:56 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EIrGTaQl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:30:56 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:30:56 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Searching for a device in session 9 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kmDIzbOZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23564636631363561', 'path': '/dev/sdg'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564636631363561', 'path': '/dev/sdg'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.452s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:30:57 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:30:57 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:30:57 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG nova.objects.instance [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lazy-loading 'flavor' on Instance uuid 79bee3fe-3300-4a28-b079-1bafaa1033c4 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[746d286d-29c2-499c-a8aa-1ff2cf4d0aa8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:30:57 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 12:30:57 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:30:57 user nova-compute[71321]:   <source dev="/dev/sdg"/>
Apr 12 12:30:57 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:30:57 user nova-compute[71321]:   <serial>690fc6dc-8836-419f-8039-0584b2561e4b</serial>
Apr 12 12:30:57 user nova-compute[71321]: </disk>
Apr 12 12:30:57 user nova-compute[71321]:  {{(pid=71321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f9d655-91cd-4971-a60c-8ed86a9d5824]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b] added
Apr 12 12:30:57 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6eca55-a1b3-4c53-a892-3f0bad9e943b]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0b60d1-a3f9-49a7-b034-2b3fdeec3d1d]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EIrGTaQl {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EIrGTaQl" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeddfd6d-df53-4f18-83f1-28ffc45e5d71]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EIrGTaQl'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d321d5-30b4-4893-b645-0f9c28bf7d01]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6f4ef9-d567-4591-aa10-7f4c303baa68]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:30:57 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:30:57 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:30:57 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:30:57 user nova-compute[71321]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)
Apr 12 12:30:57 user nova-compute[71321]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b (non-flash)
Apr 12 12:30:57 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:30:57 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:30:57 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:30:57 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:30:57 user nova-compute[71321]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)
Apr 12 12:30:57 user nova-compute[71321]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b (non-flash)
Apr 12 12:30:57 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-6c349f92-85f0-4170-a1f0-8b9225b4221f tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "2f3ff25a-522c-431b-a177-85177401c7a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-6c349f92-85f0-4170-a1f0-8b9225b4221f tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "2f3ff25a-522c-431b-a177-85177401c7a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-6c349f92-85f0-4170-a1f0-8b9225b4221f tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "2f3ff25a-522c-431b-a177-85177401c7a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-6c349f92-85f0-4170-a1f0-8b9225b4221f tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "2f3ff25a-522c-431b-a177-85177401c7a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-6c349f92-85f0-4170-a1f0-8b9225b4221f tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "2f3ff25a-522c-431b-a177-85177401c7a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:57 user nova-compute[71321]: INFO nova.compute.manager [None req-6c349f92-85f0-4170-a1f0-8b9225b4221f tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Terminating instance
Apr 12 12:30:57 user nova-compute[71321]: DEBUG nova.compute.manager [None req-6c349f92-85f0-4170-a1f0-8b9225b4221f tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d844a0-c05f-427b-a39d-5ddd63cb6b17]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b, portal: 172.16.0.220,3260]
Apr 12 12:30:57 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b, portal: 172.16.0.220,3260] successful.
Apr 12 12:30:57 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23f57ad-04fc-49a0-a7c1-722e07e51f46]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[084fbbfb-f51e-469b-83a6-4bdc1855ae82]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b (non-flash)
Apr 12 12:30:57 user nova-compute[71321]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:30:57 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:30:57 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:30:57 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:30:57 user nova-compute[71321]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)
Apr 12 12:30:57 user nova-compute[71321]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b (non-flash)
Apr 12 12:30:57 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b (non-flash)
Apr 12 12:30:57 user nova-compute[71321]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:30:57 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:30:57 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:30:57 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:30:57 user nova-compute[71321]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)
Apr 12 12:30:57 user nova-compute[71321]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b (non-flash)
Apr 12 12:30:57 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] HCTL ('39', '-', '-', 0) found on session 10 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.025s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6820903e-aef4-4a7a-a35e-01a90bd89728]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Searching for a device in session 10 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EIrGTaQl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] No BDM found with device name hda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] No VIF found with MAC fa:16:3e:4a:27:fd, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "79bee3fe-3300-4a28-b079-1bafaa1033c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.461s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG nova.compute.manager [req-68bd7ea9-44a7-4e73-9ae5-8c723dec7fc7 req-94464d23-7451-4869-b2e3-5fa2d063a682 service nova] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Received event network-vif-unplugged-7db9ebe7-8544-46eb-8d75-929d0422278f {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-68bd7ea9-44a7-4e73-9ae5-8c723dec7fc7 req-94464d23-7451-4869-b2e3-5fa2d063a682 service nova] Acquiring lock "2f3ff25a-522c-431b-a177-85177401c7a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-68bd7ea9-44a7-4e73-9ae5-8c723dec7fc7 req-94464d23-7451-4869-b2e3-5fa2d063a682 service nova] Lock "2f3ff25a-522c-431b-a177-85177401c7a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-68bd7ea9-44a7-4e73-9ae5-8c723dec7fc7 req-94464d23-7451-4869-b2e3-5fa2d063a682 service nova] Lock "2f3ff25a-522c-431b-a177-85177401c7a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG nova.compute.manager [req-68bd7ea9-44a7-4e73-9ae5-8c723dec7fc7 req-94464d23-7451-4869-b2e3-5fa2d063a682 service nova] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] No waiting events found dispatching network-vif-unplugged-7db9ebe7-8544-46eb-8d75-929d0422278f {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:30:57 user nova-compute[71321]: DEBUG nova.compute.manager [req-68bd7ea9-44a7-4e73-9ae5-8c723dec7fc7 req-94464d23-7451-4869-b2e3-5fa2d063a682 service nova] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Received event network-vif-unplugged-7db9ebe7-8544-46eb-8d75-929d0422278f for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:30:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:58 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Instance destroyed successfully.
Apr 12 12:30:58 user nova-compute[71321]: DEBUG nova.objects.instance [None req-6c349f92-85f0-4170-a1f0-8b9225b4221f tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lazy-loading 'resources' on Instance uuid 2f3ff25a-522c-431b-a177-85177401c7a9 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:30:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:58 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-6c349f92-85f0-4170-a1f0-8b9225b4221f tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:28:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-662121220',display_name='tempest-AttachSCSIVolumeTestJSON-server-662121220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-662121220',id=7,image_ref='875251de-7186-4c31-a652-86e2ae4f852c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGoVgvWo88zPXxgfw7yjbHEryzhu42eYfncF0zIc/WtRssu6+d2LdfKHNGIeYY5Ua3QamFBJReIJokD0D4DEooB6gLRQnf+LJjd3K8nLB1AaWWi0tP4V51n7O7M9NtNegg==',key_name='tempest-keypair-817895902',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:29:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02f3f538463546f9a0eab47df52e2f56',ramdisk_id='',reservation_id='r-cwyrgmo6',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='875251de-7186-4c31-a652-86e2ae4f852c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2004507714',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2004507714-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:29:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66e3fb7903c94cd6a2a709ca0e133ce2',uuid=2f3ff25a-522c-431b-a177-85177401c7a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7db9ebe7-8544-46eb-8d75-929d0422278f", "address": "fa:16:3e:aa:c6:e9", "network": {"id": "ed1e01b0-282c-4171-88ab-4f0eb80724e2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-826776752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02f3f538463546f9a0eab47df52e2f56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7db9ebe7-85", "ovs_interfaceid": "7db9ebe7-8544-46eb-8d75-929d0422278f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:30:58 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-6c349f92-85f0-4170-a1f0-8b9225b4221f tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Converting VIF {"id": "7db9ebe7-8544-46eb-8d75-929d0422278f", "address": "fa:16:3e:aa:c6:e9", "network": {"id": "ed1e01b0-282c-4171-88ab-4f0eb80724e2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-826776752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02f3f538463546f9a0eab47df52e2f56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7db9ebe7-85", "ovs_interfaceid": "7db9ebe7-8544-46eb-8d75-929d0422278f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:30:58 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-6c349f92-85f0-4170-a1f0-8b9225b4221f tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:c6:e9,bridge_name='br-int',has_traffic_filtering=True,id=7db9ebe7-8544-46eb-8d75-929d0422278f,network=Network(ed1e01b0-282c-4171-88ab-4f0eb80724e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7db9ebe7-85') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:30:58 user nova-compute[71321]: DEBUG os_vif [None req-6c349f92-85f0-4170-a1f0-8b9225b4221f tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:c6:e9,bridge_name='br-int',has_traffic_filtering=True,id=7db9ebe7-8544-46eb-8d75-929d0422278f,network=Network(ed1e01b0-282c-4171-88ab-4f0eb80724e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7db9ebe7-85') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:30:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7db9ebe7-85, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:30:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:58 user nova-compute[71321]: INFO os_vif [None req-6c349f92-85f0-4170-a1f0-8b9225b4221f tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:c6:e9,bridge_name='br-int',has_traffic_filtering=True,id=7db9ebe7-8544-46eb-8d75-929d0422278f,network=Network(ed1e01b0-282c-4171-88ab-4f0eb80724e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7db9ebe7-85')
Apr 12 12:30:58 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-6c349f92-85f0-4170-a1f0-8b9225b4221f tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Deleting instance files /opt/stack/data/nova/instances/2f3ff25a-522c-431b-a177-85177401c7a9_del
Apr 12 12:30:58 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-6c349f92-85f0-4170-a1f0-8b9225b4221f tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Deletion of /opt/stack/data/nova/instances/2f3ff25a-522c-431b-a177-85177401c7a9_del complete
Apr 12 12:30:58 user nova-compute[71321]: INFO nova.compute.manager [None req-6c349f92-85f0-4170-a1f0-8b9225b4221f tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 12 12:30:58 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-6c349f92-85f0-4170-a1f0-8b9225b4221f tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:30:58 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:30:58 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:30:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "79bee3fe-3300-4a28-b079-1bafaa1033c4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "79bee3fe-3300-4a28-b079-1bafaa1033c4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:58 user nova-compute[71321]: INFO nova.compute.manager [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Detaching volume 690fc6dc-8836-419f-8039-0584b2561e4b
Apr 12 12:30:58 user nova-compute[71321]: INFO nova.virt.block_device [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Attempting to driver detach volume 690fc6dc-8836-419f-8039-0584b2561e4b from mountpoint /dev/vdb
Apr 12 12:30:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:30:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] <== connect_volume: return (1815ms) {'type': 'block', 'scsi_wwn': '26462393939646539', 'path': '/dev/sdh'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:30:58 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462393939646539', 'path': '/dev/sdh'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:30:58 user nova-compute[71321]: DEBUG nova.objects.instance [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Lazy-loading 'flavor' on Instance uuid 540a69c0-488f-40cb-bdde-3e410029d4c8 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:30:58 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Attempting to detach device vdb from instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 from the persistent domain config. {{(pid=71321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 12:30:58 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:30:58 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:30:58 user nova-compute[71321]:   <source dev="/dev/sdg"/>
Apr 12 12:30:58 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:30:58 user nova-compute[71321]:   <serial>690fc6dc-8836-419f-8039-0584b2561e4b</serial>
Apr 12 12:30:58 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 12 12:30:58 user nova-compute[71321]: </disk>
Apr 12 12:30:58 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:30:58 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Successfully detached device vdb from instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 from the persistent domain config.
Apr 12 12:30:58 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 from the live domain config. {{(pid=71321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 12:30:58 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:30:58 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:30:58 user nova-compute[71321]:   <source dev="/dev/sdg"/>
Apr 12 12:30:58 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:30:58 user nova-compute[71321]:   <serial>690fc6dc-8836-419f-8039-0584b2561e4b</serial>
Apr 12 12:30:58 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 12 12:30:58 user nova-compute[71321]: </disk>
Apr 12 12:30:58 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Received event <DeviceRemovedEvent: 1681302659.2208607, 79bee3fe-3300-4a28-b079-1bafaa1033c4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 {{(pid=71321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 12:30:59 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Successfully detached device vdb from instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 from the live domain config.
Apr 12 12:30:59 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kmDIzbOZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:30:59 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:30:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfe6765-cac0-4b64-964f-da89072aef3c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:30:59 user nova-compute[71321]: No targets found.
Apr 12 12:30:59 user nova-compute[71321]: iSNS:
Apr 12 12:30:59 user nova-compute[71321]: No targets found.
Apr 12 12:30:59 user nova-compute[71321]: STATIC:
Apr 12 12:30:59 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1
Apr 12 12:30:59 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:30:59 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:30:59 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569
Apr 12 12:30:59 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:30:59 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:30:59 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b
Apr 12 12:30:59 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:30:59 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:30:59 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24
Apr 12 12:30:59 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:30:59 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:30:59 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3
Apr 12 12:30:59 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:30:59 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:30:59 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc
Apr 12 12:30:59 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:30:59 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:30:59 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b
Apr 12 12:30:59 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:30:59 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:30:59 user nova-compute[71321]: FIRMWARE:
Apr 12 12:30:59 user nova-compute[71321]: No targets found.
Apr 12 12:30:59 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:30:59 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:30:59 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=71321) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a146b723-97de-4c2c-b5ca-9843dce3aef5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a5c7a5-7877-4c74-8a66-536637f6e9ca]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b (non-flash)
Apr 12 12:30:59 user nova-compute[71321]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:30:59 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:30:59 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:30:59 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:30:59 user nova-compute[71321]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)
Apr 12 12:30:59 user nova-compute[71321]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b (non-flash)
Apr 12 12:30:59 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b (non-flash)
Apr 12 12:30:59 user nova-compute[71321]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:30:59 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:30:59 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:30:59 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:30:59 user nova-compute[71321]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)
Apr 12 12:30:59 user nova-compute[71321]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b (non-flash)
Apr 12 12:30:59 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef8a1d8ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b'): ({'sdg'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Removing single pathed devices sdg {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b4cadd-4a6d-4751-b97b-2fc460a1a54d]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.026s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fbab42-b52d-4d89-8b6d-7072a2e0b142]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Flushing IO for device /dev/sdg {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54cbc5d-1977-418c-a64d-52126762131d]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.065s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef44abaf-5bf4-453f-a054-593ee3366713]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] SCSI volumes sdg have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53fdcc6-11d6-4220-9e17-619e6a2fc1e9]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ced38fb-1913-4b86-9727-3122682605b9]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b, portal: 172.16.0.220,3260]
Apr 12 12:30:59 user nova-compute[71321]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b, portal: 172.16.0.220,3260] successful.
Apr 12 12:30:59 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:690fc6dc-8836-419f-8039-0584b2561e4b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0b66fb-dbfa-4390-a0ff-e1c471f1ddc7]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.468s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] <== disconnect_volume: return (469ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] COPY block job progress, current cursor: 170917888 final cursor: 1073741824 {{(pid=71321) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:30:59 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Took 1.62 seconds to deallocate network for instance.
Apr 12 12:30:59 user nova-compute[71321]: DEBUG nova.compute.manager [req-8ee533b7-69df-4e6e-804f-144a8bb28fff req-c2dc18a5-bc35-44b4-80c5-cda9f844cd27 service nova] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Received event network-vif-plugged-7db9ebe7-8544-46eb-8d75-929d0422278f {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-8ee533b7-69df-4e6e-804f-144a8bb28fff req-c2dc18a5-bc35-44b4-80c5-cda9f844cd27 service nova] Acquiring lock "2f3ff25a-522c-431b-a177-85177401c7a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-8ee533b7-69df-4e6e-804f-144a8bb28fff req-c2dc18a5-bc35-44b4-80c5-cda9f844cd27 service nova] Lock "2f3ff25a-522c-431b-a177-85177401c7a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-8ee533b7-69df-4e6e-804f-144a8bb28fff req-c2dc18a5-bc35-44b4-80c5-cda9f844cd27 service nova] Lock "2f3ff25a-522c-431b-a177-85177401c7a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG nova.compute.manager [req-8ee533b7-69df-4e6e-804f-144a8bb28fff req-c2dc18a5-bc35-44b4-80c5-cda9f844cd27 service nova] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] No waiting events found dispatching network-vif-plugged-7db9ebe7-8544-46eb-8d75-929d0422278f {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:30:59 user nova-compute[71321]: WARNING nova.compute.manager [req-8ee533b7-69df-4e6e-804f-144a8bb28fff req-c2dc18a5-bc35-44b4-80c5-cda9f844cd27 service nova] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Received unexpected event network-vif-plugged-7db9ebe7-8544-46eb-8d75-929d0422278f for instance with vm_state active and task_state deleting.
Apr 12 12:30:59 user nova-compute[71321]: DEBUG nova.compute.manager [req-3b2879ab-a98b-4d45-813a-d22cc7e72a3b req-e6425304-fc49-46cf-8120-d7053439f087 service nova] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Received event network-vif-deleted-7db9ebe7-8544-46eb-8d75-929d0422278f {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:30:59 user nova-compute[71321]: INFO nova.compute.manager [req-3b2879ab-a98b-4d45-813a-d22cc7e72a3b req-e6425304-fc49-46cf-8120-d7053439f087 service nova] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Neutron deleted interface 7db9ebe7-8544-46eb-8d75-929d0422278f; detaching it from the instance and deleting it from the info cache
Apr 12 12:30:59 user nova-compute[71321]: DEBUG nova.network.neutron [req-3b2879ab-a98b-4d45-813a-d22cc7e72a3b req-e6425304-fc49-46cf-8120-d7053439f087 service nova] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG nova.compute.manager [req-3b2879ab-a98b-4d45-813a-d22cc7e72a3b req-e6425304-fc49-46cf-8120-d7053439f087 service nova] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Detach interface failed, port_id=7db9ebe7-8544-46eb-8d75-929d0422278f, reason: Instance 2f3ff25a-522c-431b-a177-85177401c7a9 could not be found. {{(pid=71321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-6c349f92-85f0-4170-a1f0-8b9225b4221f tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:30:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-6c349f92-85f0-4170-a1f0-8b9225b4221f tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:00 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] COPY block job progress, current cursor: 273678336 final cursor: 1073741824 {{(pid=71321) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 12:31:00 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-6c349f92-85f0-4170-a1f0-8b9225b4221f tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:31:00 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-6c349f92-85f0-4170-a1f0-8b9225b4221f tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:31:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-6c349f92-85f0-4170-a1f0-8b9225b4221f tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.474s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:00 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-6c349f92-85f0-4170-a1f0-8b9225b4221f tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Deleted allocations for instance 2f3ff25a-522c-431b-a177-85177401c7a9
Apr 12 12:31:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-6c349f92-85f0-4170-a1f0-8b9225b4221f tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "2f3ff25a-522c-431b-a177-85177401c7a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.234s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:00 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] COPY block job progress, current cursor: 401604608 final cursor: 1073741824 {{(pid=71321) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 12:31:01 user nova-compute[71321]: DEBUG nova.objects.instance [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lazy-loading 'flavor' on Instance uuid 79bee3fe-3300-4a28-b079-1bafaa1033c4 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:31:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "79bee3fe-3300-4a28-b079-1bafaa1033c4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.705s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] COPY block job progress, current cursor: 540016640 final cursor: 1073741824 {{(pid=71321) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 12:31:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] COPY block job progress, current cursor: 752877568 final cursor: 1073741824 {{(pid=71321) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 12:31:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "interface-79bee3fe-3300-4a28-b079-1bafaa1033c4-8438a9df-803e-44da-a2b6-b394bd23fbb1" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "interface-79bee3fe-3300-4a28-b079-1bafaa1033c4-8438a9df-803e-44da-a2b6-b394bd23fbb1" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:01 user nova-compute[71321]: DEBUG nova.objects.instance [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lazy-loading 'flavor' on Instance uuid 79bee3fe-3300-4a28-b079-1bafaa1033c4 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:31:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:28:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-656063872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-656063872',id=8,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxGfNEhwxyml0RYHshQIBVlikZPUICMVOtWr1cX5kE9lM3qDUztZplY9zWTLExsTj4Jyt4GyZTZtlPvLt0Z2/a5v2pzKXPmtIr/OlOJ6S/2MsrCvF+uqljaJkNsq+Gqvw==',key_name='tempest-keypair-134546144',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:29:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0dd2a4a665514d0eb31653775b67356a',ramdisk_id='',reservation_id='r-u0qzq363',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1949865572',owner_user_name='tempest-TaggedAttachmentsTest-1949865572-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:29:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ff191ffb9604795bab6ada1eafd41ff',uuid=79bee3fe-3300-4a28-b079-1bafaa1033c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8438a9df-803e-44da-a2b6-b394bd23fbb1", "address": "fa:16:3e:10:ea:5b", "network": {"id": "fa236fb1-e347-4c0e-bb34-51cf6d7dd7f9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-842608701", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0dd2a4a665514d0eb31653775b67356a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8438a9df-80", "ovs_interfaceid": "8438a9df-803e-44da-a2b6-b394bd23fbb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:31:01 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Converting VIF {"id": "8438a9df-803e-44da-a2b6-b394bd23fbb1", "address": "fa:16:3e:10:ea:5b", "network": {"id": "fa236fb1-e347-4c0e-bb34-51cf6d7dd7f9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-842608701", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0dd2a4a665514d0eb31653775b67356a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8438a9df-80", "ovs_interfaceid": "8438a9df-803e-44da-a2b6-b394bd23fbb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:31:01 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:ea:5b,bridge_name='br-int',has_traffic_filtering=True,id=8438a9df-803e-44da-a2b6-b394bd23fbb1,network=Network(fa236fb1-e347-4c0e-bb34-51cf6d7dd7f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8438a9df-80') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:31:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:10:ea:5b"/><model type="virtio"/><mtu size="1442"/><target dev="tap8438a9df-80"/></interface> {{(pid=71321) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 12:31:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:10:ea:5b"/><model type="virtio"/><mtu size="1442"/><target dev="tap8438a9df-80"/></interface> {{(pid=71321) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 12:31:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Attempting to detach device tap8438a9df-80 from instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 from the persistent domain config. {{(pid=71321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 12:31:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] detach device xml: <interface type="ethernet">
Apr 12 12:31:01 user nova-compute[71321]:   <mac address="fa:16:3e:10:ea:5b"/>
Apr 12 12:31:01 user nova-compute[71321]:   <model type="virtio"/>
Apr 12 12:31:01 user nova-compute[71321]:   <mtu size="1442"/>
Apr 12 12:31:01 user nova-compute[71321]:   <target dev="tap8438a9df-80"/>
Apr 12 12:31:01 user nova-compute[71321]: </interface>
Apr 12 12:31:01 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:31:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:10:ea:5b"/><model type="virtio"/><mtu size="1442"/><target dev="tap8438a9df-80"/></interface> {{(pid=71321) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 12:31:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:10:ea:5b"/><model type="virtio"/><mtu size="1442"/><target dev="tap8438a9df-80"/></interface>not found in domain: <domain type='kvm' id='8'>
Apr 12 12:31:01 user nova-compute[71321]:   <name>instance-00000008</name>
Apr 12 12:31:01 user nova-compute[71321]:   <uuid>79bee3fe-3300-4a28-b079-1bafaa1033c4</uuid>
Apr 12 12:31:01 user nova-compute[71321]:   <metadata>
Apr 12 12:31:01 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:31:01 user nova-compute[71321]:   <nova:package version="0.0.0"/>
Apr 12 12:31:01 user nova-compute[71321]:   <nova:name>tempest-device-tagging-server-656063872</nova:name>
Apr 12 12:31:01 user nova-compute[71321]:   <nova:creationTime>2023-04-12 12:30:50</nova:creationTime>
Apr 12 12:31:01 user nova-compute[71321]:   <nova:flavor name="m1.nano">
Apr 12 12:31:01 user nova-compute[71321]:     <nova:memory>128</nova:memory>
Apr 12 12:31:01 user nova-compute[71321]:     <nova:disk>1</nova:disk>
Apr 12 12:31:01 user nova-compute[71321]:     <nova:swap>0</nova:swap>
Apr 12 12:31:01 user nova-compute[71321]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:31:01 user nova-compute[71321]:     <nova:vcpus>1</nova:vcpus>
Apr 12 12:31:01 user nova-compute[71321]:   </nova:flavor>
Apr 12 12:31:01 user nova-compute[71321]:   <nova:owner>
Apr 12 12:31:01 user nova-compute[71321]:     <nova:user uuid="2ff191ffb9604795bab6ada1eafd41ff">tempest-TaggedAttachmentsTest-1949865572-project-member</nova:user>
Apr 12 12:31:01 user nova-compute[71321]:     <nova:project uuid="0dd2a4a665514d0eb31653775b67356a">tempest-TaggedAttachmentsTest-1949865572</nova:project>
Apr 12 12:31:01 user nova-compute[71321]:   </nova:owner>
Apr 12 12:31:01 user nova-compute[71321]:   <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:31:01 user nova-compute[71321]:   <nova:ports>
Apr 12 12:31:01 user nova-compute[71321]:     <nova:port uuid="201eadd8-c760-4862-bcce-bcff996371f9">
Apr 12 12:31:01 user nova-compute[71321]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 12:31:01 user nova-compute[71321]:     </nova:port>
Apr 12 12:31:01 user nova-compute[71321]:     <nova:port uuid="8438a9df-803e-44da-a2b6-b394bd23fbb1">
Apr 12 12:31:01 user nova-compute[71321]:       <nova:ip type="fixed" address="10.10.10.162" ipVersion="4"/>
Apr 12 12:31:01 user nova-compute[71321]:     </nova:port>
Apr 12 12:31:01 user nova-compute[71321]:   </nova:ports>
Apr 12 12:31:01 user nova-compute[71321]: </nova:instance>
Apr 12 12:31:01 user nova-compute[71321]:   </metadata>
Apr 12 12:31:01 user nova-compute[71321]:   <memory unit='KiB'>131072</memory>
Apr 12 12:31:01 user nova-compute[71321]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 12 12:31:01 user nova-compute[71321]:   <vcpu placement='static'>1</vcpu>
Apr 12 12:31:01 user nova-compute[71321]:   <resource>
Apr 12 12:31:01 user nova-compute[71321]:     <partition>/machine</partition>
Apr 12 12:31:01 user nova-compute[71321]:   </resource>
Apr 12 12:31:01 user nova-compute[71321]:   <sysinfo type='smbios'>
Apr 12 12:31:01 user nova-compute[71321]:     <system>
Apr 12 12:31:01 user nova-compute[71321]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 12 12:31:01 user nova-compute[71321]:       <entry name='product'>OpenStack Nova</entry>
Apr 12 12:31:01 user nova-compute[71321]:       <entry name='version'>0.0.0</entry>
Apr 12 12:31:01 user nova-compute[71321]:       <entry name='serial'>79bee3fe-3300-4a28-b079-1bafaa1033c4</entry>
Apr 12 12:31:01 user nova-compute[71321]:       <entry name='uuid'>79bee3fe-3300-4a28-b079-1bafaa1033c4</entry>
Apr 12 12:31:01 user nova-compute[71321]:       <entry name='family'>Virtual Machine</entry>
Apr 12 12:31:01 user nova-compute[71321]:     </system>
Apr 12 12:31:01 user nova-compute[71321]:   </sysinfo>
Apr 12 12:31:01 user nova-compute[71321]:   <os>
Apr 12 12:31:01 user nova-compute[71321]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 12 12:31:01 user nova-compute[71321]:     <boot dev='hd'/>
Apr 12 12:31:01 user nova-compute[71321]:     <smbios mode='sysinfo'/>
Apr 12 12:31:01 user nova-compute[71321]:   </os>
Apr 12 12:31:01 user nova-compute[71321]:   <features>
Apr 12 12:31:01 user nova-compute[71321]:     <acpi/>
Apr 12 12:31:01 user nova-compute[71321]:     <apic/>
Apr 12 12:31:01 user nova-compute[71321]:     <vmcoreinfo state='on'/>
Apr 12 12:31:01 user nova-compute[71321]:   </features>
Apr 12 12:31:01 user nova-compute[71321]:   <cpu mode='custom' match='exact' check='full'>
Apr 12 12:31:01 user nova-compute[71321]:     <model fallback='forbid'>Nehalem</model>
Apr 12 12:31:01 user nova-compute[71321]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 12 12:31:01 user nova-compute[71321]:     <feature policy='require' name='vme'/>
Apr 12 12:31:01 user nova-compute[71321]:     <feature policy='require' name='x2apic'/>
Apr 12 12:31:01 user nova-compute[71321]:     <feature policy='require' name='hypervisor'/>
Apr 12 12:31:01 user nova-compute[71321]:   </cpu>
Apr 12 12:31:01 user nova-compute[71321]:   <clock offset='utc'>
Apr 12 12:31:01 user nova-compute[71321]:     <timer name='pit' tickpolicy='delay'/>
Apr 12 12:31:01 user nova-compute[71321]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 12 12:31:01 user nova-compute[71321]:     <timer name='hpet' present='no'/>
Apr 12 12:31:01 user nova-compute[71321]:   </clock>
Apr 12 12:31:01 user nova-compute[71321]:   <on_poweroff>destroy</on_poweroff>
Apr 12 12:31:01 user nova-compute[71321]:   <on_reboot>restart</on_reboot>
Apr 12 12:31:01 user nova-compute[71321]:   <on_crash>destroy</on_crash>
Apr 12 12:31:01 user nova-compute[71321]:   <devices>
Apr 12 12:31:01 user nova-compute[71321]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 12 12:31:01 user nova-compute[71321]:     <disk type='file' device='disk'>
Apr 12 12:31:01 user nova-compute[71321]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 12 12:31:01 user nova-compute[71321]:       <source file='/opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/disk' index='2'/>
Apr 12 12:31:01 user nova-compute[71321]:       <backingStore type='file' index='3'>
Apr 12 12:31:01 user nova-compute[71321]:         <format type='raw'/>
Apr 12 12:31:01 user nova-compute[71321]:         <source file='/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787'/>
Apr 12 12:31:01 user nova-compute[71321]:         <backingStore/>
Apr 12 12:31:01 user nova-compute[71321]:       </backingStore>
Apr 12 12:31:01 user nova-compute[71321]:       <target dev='vda' bus='virtio'/>
Apr 12 12:31:01 user nova-compute[71321]:       <alias name='virtio-disk0'/>
Apr 12 12:31:01 user nova-compute[71321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 12 12:31:01 user nova-compute[71321]:     </disk>
Apr 12 12:31:01 user nova-compute[71321]:     <disk type='file' device='cdrom'>
Apr 12 12:31:01 user nova-compute[71321]:       <driver name='qemu' type='raw' cache='none'/>
Apr 12 12:31:01 user nova-compute[71321]:       <source file='/opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/disk.config' index='1'/>
Apr 12 12:31:01 user nova-compute[71321]:       <backingStore/>
Apr 12 12:31:01 user nova-compute[71321]:       <target dev='hda' bus='ide'/>
Apr 12 12:31:01 user nova-compute[71321]:       <readonly/>
Apr 12 12:31:01 user nova-compute[71321]:       <alias name='ide0-0-0'/>
Apr 12 12:31:01 user nova-compute[71321]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 12 12:31:01 user nova-compute[71321]:     </disk>
Apr 12 12:31:01 user nova-compute[71321]:     <controller type='usb' index='0' model='none'>
Apr 12 12:31:01 user nova-compute[71321]:       <alias name='usb'/>
Apr 12 12:31:01 user nova-compute[71321]:     </controller>
Apr 12 12:31:01 user nova-compute[71321]:     <controller type='pci' index='0' model='pci-root'>
Apr 12 12:31:01 user nova-compute[71321]:       <alias name='pci.0'/>
Apr 12 12:31:01 user nova-compute[71321]:     </controller>
Apr 12 12:31:01 user nova-compute[71321]:     <controller type='ide' index='0'>
Apr 12 12:31:01 user nova-compute[71321]:       <alias name='ide'/>
Apr 12 12:31:01 user nova-compute[71321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 12 12:31:01 user nova-compute[71321]:     </controller>
Apr 12 12:31:01 user nova-compute[71321]:     <interface type='ethernet'>
Apr 12 12:31:01 user nova-compute[71321]:       <mac address='fa:16:3e:4a:27:fd'/>
Apr 12 12:31:01 user nova-compute[71321]:       <target dev='tap201eadd8-c7'/>
Apr 12 12:31:01 user nova-compute[71321]:       <model type='virtio'/>
Apr 12 12:31:01 user nova-compute[71321]:       <mtu size='1442'/>
Apr 12 12:31:01 user nova-compute[71321]:       <alias name='net0'/>
Apr 12 12:31:01 user nova-compute[71321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 12 12:31:01 user nova-compute[71321]:     </interface>
Apr 12 12:31:01 user nova-compute[71321]:     <interface type='ethernet'>
Apr 12 12:31:01 user nova-compute[71321]:       <mac address='fa:16:3e:10:ea:5b'/>
Apr 12 12:31:01 user nova-compute[71321]:       <target dev='tap8438a9df-80'/>
Apr 12 12:31:01 user nova-compute[71321]:       <model type='virtio'/>
Apr 12 12:31:01 user nova-compute[71321]:       <mtu size='1442'/>
Apr 12 12:31:01 user nova-compute[71321]:       <alias name='net1'/>
Apr 12 12:31:01 user nova-compute[71321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 12 12:31:01 user nova-compute[71321]:     </interface>
Apr 12 12:31:01 user nova-compute[71321]:     <serial type='pty'>
Apr 12 12:31:01 user nova-compute[71321]:       <source path='/dev/pts/7'/>
Apr 12 12:31:01 user nova-compute[71321]:       <log file='/opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/console.log' append='off'/>
Apr 12 12:31:01 user nova-compute[71321]:       <target type='isa-serial' port='0'>
Apr 12 12:31:01 user nova-compute[71321]:         <model name='isa-serial'/>
Apr 12 12:31:01 user nova-compute[71321]:       </target>
Apr 12 12:31:01 user nova-compute[71321]:       <alias name='serial0'/>
Apr 12 12:31:01 user nova-compute[71321]:     </serial>
Apr 12 12:31:01 user nova-compute[71321]:     <console type='pty' tty='/dev/pts/7'>
Apr 12 12:31:01 user nova-compute[71321]:       <source path='/dev/pts/7'/>
Apr 12 12:31:01 user nova-compute[71321]:       <log file='/opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/console.log' append='off'/>
Apr 12 12:31:01 user nova-compute[71321]:       <target type='serial' port='0'/>
Apr 12 12:31:01 user nova-compute[71321]:       <alias name='serial0'/>
Apr 12 12:31:01 user nova-compute[71321]:     </console>
Apr 12 12:31:01 user nova-compute[71321]:     <input type='mouse' bus='ps2'>
Apr 12 12:31:01 user nova-compute[71321]:       <alias name='input0'/>
Apr 12 12:31:01 user nova-compute[71321]:     </input>
Apr 12 12:31:01 user nova-compute[71321]:     <input type='keyboard' bus='ps2'>
Apr 12 12:31:01 user nova-compute[71321]:       <alias name='input1'/>
Apr 12 12:31:01 user nova-compute[71321]:     </input>
Apr 12 12:31:01 user nova-compute[71321]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Apr 12 12:31:01 user nova-compute[71321]:       <listen type='address' address='0.0.0.0'/>
Apr 12 12:31:01 user nova-compute[71321]:     </graphics>
Apr 12 12:31:01 user nova-compute[71321]:     <audio id='1' type='none'/>
Apr 12 12:31:01 user nova-compute[71321]:     <video>
Apr 12 12:31:01 user nova-compute[71321]:       <model type='virtio' heads='1' primary='yes'/>
Apr 12 12:31:01 user nova-compute[71321]:       <alias name='video0'/>
Apr 12 12:31:01 user nova-compute[71321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 12 12:31:01 user nova-compute[71321]:     </video>
Apr 12 12:31:01 user nova-compute[71321]:     <memballoon model='virtio'>
Apr 12 12:31:01 user nova-compute[71321]:       <stats period='10'/>
Apr 12 12:31:01 user nova-compute[71321]:       <alias name='balloon0'/>
Apr 12 12:31:01 user nova-compute[71321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 12 12:31:01 user nova-compute[71321]:     </memballoon>
Apr 12 12:31:01 user nova-compute[71321]:     <rng model='virtio'>
Apr 12 12:31:01 user nova-compute[71321]:       <backend model='random'>/dev/urandom</backend>
Apr 12 12:31:01 user nova-compute[71321]:       <alias name='rng0'/>
Apr 12 12:31:01 user nova-compute[71321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 12 12:31:01 user nova-compute[71321]:     </rng>
Apr 12 12:31:01 user nova-compute[71321]:   </devices>
Apr 12 12:31:01 user nova-compute[71321]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 12 12:31:01 user nova-compute[71321]:     <label>libvirt-79bee3fe-3300-4a28-b079-1bafaa1033c4</label>
Apr 12 12:31:01 user nova-compute[71321]:     <imagelabel>libvirt-79bee3fe-3300-4a28-b079-1bafaa1033c4</imagelabel>
Apr 12 12:31:01 user nova-compute[71321]:   </seclabel>
Apr 12 12:31:01 user nova-compute[71321]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 12 12:31:01 user nova-compute[71321]:     <label>+64055:+108</label>
Apr 12 12:31:01 user nova-compute[71321]:     <imagelabel>+64055:+108</imagelabel>
Apr 12 12:31:01 user nova-compute[71321]:   </seclabel>
Apr 12 12:31:01 user nova-compute[71321]: </domain>
Apr 12 12:31:01 user nova-compute[71321]:  {{(pid=71321) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 12 12:31:01 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Successfully detached device tap8438a9df-80 from instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 from the persistent domain config.
Apr 12 12:31:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] (1/8): Attempting to detach device tap8438a9df-80 with device alias net1 from instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 from the live domain config. {{(pid=71321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 12:31:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] detach device xml: <interface type="ethernet">
Apr 12 12:31:01 user nova-compute[71321]:   <mac address="fa:16:3e:10:ea:5b"/>
Apr 12 12:31:01 user nova-compute[71321]:   <model type="virtio"/>
Apr 12 12:31:01 user nova-compute[71321]:   <mtu size="1442"/>
Apr 12 12:31:01 user nova-compute[71321]:   <target dev="tap8438a9df-80"/>
Apr 12 12:31:01 user nova-compute[71321]: </interface>
Apr 12 12:31:01 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:31:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:02 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Received event <DeviceRemovedEvent: 1681302662.2236638, 79bee3fe-3300-4a28-b079-1bafaa1033c4 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 12:31:02 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Start waiting for the detach event from libvirt for device tap8438a9df-80 with device alias net1 for instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 {{(pid=71321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 12:31:02 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:10:ea:5b"/><model type="virtio"/><mtu size="1442"/><target dev="tap8438a9df-80"/></interface> {{(pid=71321) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 12:31:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:02 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:10:ea:5b"/><model type="virtio"/><mtu size="1442"/><target dev="tap8438a9df-80"/></interface>not found in domain: <domain type='kvm' id='8'>
Apr 12 12:31:02 user nova-compute[71321]:   <name>instance-00000008</name>
Apr 12 12:31:02 user nova-compute[71321]:   <uuid>79bee3fe-3300-4a28-b079-1bafaa1033c4</uuid>
Apr 12 12:31:02 user nova-compute[71321]:   <metadata>
Apr 12 12:31:02 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:31:02 user nova-compute[71321]:   <nova:package version="0.0.0"/>
Apr 12 12:31:02 user nova-compute[71321]:   <nova:name>tempest-device-tagging-server-656063872</nova:name>
Apr 12 12:31:02 user nova-compute[71321]:   <nova:creationTime>2023-04-12 12:30:50</nova:creationTime>
Apr 12 12:31:02 user nova-compute[71321]:   <nova:flavor name="m1.nano">
Apr 12 12:31:02 user nova-compute[71321]:     <nova:memory>128</nova:memory>
Apr 12 12:31:02 user nova-compute[71321]:     <nova:disk>1</nova:disk>
Apr 12 12:31:02 user nova-compute[71321]:     <nova:swap>0</nova:swap>
Apr 12 12:31:02 user nova-compute[71321]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:31:02 user nova-compute[71321]:     <nova:vcpus>1</nova:vcpus>
Apr 12 12:31:02 user nova-compute[71321]:   </nova:flavor>
Apr 12 12:31:02 user nova-compute[71321]:   <nova:owner>
Apr 12 12:31:02 user nova-compute[71321]:     <nova:user uuid="2ff191ffb9604795bab6ada1eafd41ff">tempest-TaggedAttachmentsTest-1949865572-project-member</nova:user>
Apr 12 12:31:02 user nova-compute[71321]:     <nova:project uuid="0dd2a4a665514d0eb31653775b67356a">tempest-TaggedAttachmentsTest-1949865572</nova:project>
Apr 12 12:31:02 user nova-compute[71321]:   </nova:owner>
Apr 12 12:31:02 user nova-compute[71321]:   <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:31:02 user nova-compute[71321]:   <nova:ports>
Apr 12 12:31:02 user nova-compute[71321]:     <nova:port uuid="201eadd8-c760-4862-bcce-bcff996371f9">
Apr 12 12:31:02 user nova-compute[71321]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 12:31:02 user nova-compute[71321]:     </nova:port>
Apr 12 12:31:02 user nova-compute[71321]:     <nova:port uuid="8438a9df-803e-44da-a2b6-b394bd23fbb1">
Apr 12 12:31:02 user nova-compute[71321]:       <nova:ip type="fixed" address="10.10.10.162" ipVersion="4"/>
Apr 12 12:31:02 user nova-compute[71321]:     </nova:port>
Apr 12 12:31:02 user nova-compute[71321]:   </nova:ports>
Apr 12 12:31:02 user nova-compute[71321]: </nova:instance>
Apr 12 12:31:02 user nova-compute[71321]:   </metadata>
Apr 12 12:31:02 user nova-compute[71321]:   <memory unit='KiB'>131072</memory>
Apr 12 12:31:02 user nova-compute[71321]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 12 12:31:02 user nova-compute[71321]:   <vcpu placement='static'>1</vcpu>
Apr 12 12:31:02 user nova-compute[71321]:   <resource>
Apr 12 12:31:02 user nova-compute[71321]:     <partition>/machine</partition>
Apr 12 12:31:02 user nova-compute[71321]:   </resource>
Apr 12 12:31:02 user nova-compute[71321]:   <sysinfo type='smbios'>
Apr 12 12:31:02 user nova-compute[71321]:     <system>
Apr 12 12:31:02 user nova-compute[71321]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 12 12:31:02 user nova-compute[71321]:       <entry name='product'>OpenStack Nova</entry>
Apr 12 12:31:02 user nova-compute[71321]:       <entry name='version'>0.0.0</entry>
Apr 12 12:31:02 user nova-compute[71321]:       <entry name='serial'>79bee3fe-3300-4a28-b079-1bafaa1033c4</entry>
Apr 12 12:31:02 user nova-compute[71321]:       <entry name='uuid'>79bee3fe-3300-4a28-b079-1bafaa1033c4</entry>
Apr 12 12:31:02 user nova-compute[71321]:       <entry name='family'>Virtual Machine</entry>
Apr 12 12:31:02 user nova-compute[71321]:     </system>
Apr 12 12:31:02 user nova-compute[71321]:   </sysinfo>
Apr 12 12:31:02 user nova-compute[71321]:   <os>
Apr 12 12:31:02 user nova-compute[71321]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 12 12:31:02 user nova-compute[71321]:     <boot dev='hd'/>
Apr 12 12:31:02 user nova-compute[71321]:     <smbios mode='sysinfo'/>
Apr 12 12:31:02 user nova-compute[71321]:   </os>
Apr 12 12:31:02 user nova-compute[71321]:   <features>
Apr 12 12:31:02 user nova-compute[71321]:     <acpi/>
Apr 12 12:31:02 user nova-compute[71321]:     <apic/>
Apr 12 12:31:02 user nova-compute[71321]:     <vmcoreinfo state='on'/>
Apr 12 12:31:02 user nova-compute[71321]:   </features>
Apr 12 12:31:02 user nova-compute[71321]:   <cpu mode='custom' match='exact' check='full'>
Apr 12 12:31:02 user nova-compute[71321]:     <model fallback='forbid'>Nehalem</model>
Apr 12 12:31:02 user nova-compute[71321]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 12 12:31:02 user nova-compute[71321]:     <feature policy='require' name='vme'/>
Apr 12 12:31:02 user nova-compute[71321]:     <feature policy='require' name='x2apic'/>
Apr 12 12:31:02 user nova-compute[71321]:     <feature policy='require' name='hypervisor'/>
Apr 12 12:31:02 user nova-compute[71321]:   </cpu>
Apr 12 12:31:02 user nova-compute[71321]:   <clock offset='utc'>
Apr 12 12:31:02 user nova-compute[71321]:     <timer name='pit' tickpolicy='delay'/>
Apr 12 12:31:02 user nova-compute[71321]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 12 12:31:02 user nova-compute[71321]:     <timer name='hpet' present='no'/>
Apr 12 12:31:02 user nova-compute[71321]:   </clock>
Apr 12 12:31:02 user nova-compute[71321]:   <on_poweroff>destroy</on_poweroff>
Apr 12 12:31:02 user nova-compute[71321]:   <on_reboot>restart</on_reboot>
Apr 12 12:31:02 user nova-compute[71321]:   <on_crash>destroy</on_crash>
Apr 12 12:31:02 user nova-compute[71321]:   <devices>
Apr 12 12:31:02 user nova-compute[71321]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 12 12:31:02 user nova-compute[71321]:     <disk type='file' device='disk'>
Apr 12 12:31:02 user nova-compute[71321]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 12 12:31:02 user nova-compute[71321]:       <source file='/opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/disk' index='2'/>
Apr 12 12:31:02 user nova-compute[71321]:       <backingStore type='file' index='3'>
Apr 12 12:31:02 user nova-compute[71321]:         <format type='raw'/>
Apr 12 12:31:02 user nova-compute[71321]:         <source file='/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787'/>
Apr 12 12:31:02 user nova-compute[71321]:         <backingStore/>
Apr 12 12:31:02 user nova-compute[71321]:       </backingStore>
Apr 12 12:31:02 user nova-compute[71321]:       <target dev='vda' bus='virtio'/>
Apr 12 12:31:02 user nova-compute[71321]:       <alias name='virtio-disk0'/>
Apr 12 12:31:02 user nova-compute[71321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 12 12:31:02 user nova-compute[71321]:     </disk>
Apr 12 12:31:02 user nova-compute[71321]:     <disk type='file' device='cdrom'>
Apr 12 12:31:02 user nova-compute[71321]:       <driver name='qemu' type='raw' cache='none'/>
Apr 12 12:31:02 user nova-compute[71321]:       <source file='/opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/disk.config' index='1'/>
Apr 12 12:31:02 user nova-compute[71321]:       <backingStore/>
Apr 12 12:31:02 user nova-compute[71321]:       <target dev='hda' bus='ide'/>
Apr 12 12:31:02 user nova-compute[71321]:       <readonly/>
Apr 12 12:31:02 user nova-compute[71321]:       <alias name='ide0-0-0'/>
Apr 12 12:31:02 user nova-compute[71321]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 12 12:31:02 user nova-compute[71321]:     </disk>
Apr 12 12:31:02 user nova-compute[71321]:     <controller type='usb' index='0' model='none'>
Apr 12 12:31:02 user nova-compute[71321]:       <alias name='usb'/>
Apr 12 12:31:02 user nova-compute[71321]:     </controller>
Apr 12 12:31:02 user nova-compute[71321]:     <controller type='pci' index='0' model='pci-root'>
Apr 12 12:31:02 user nova-compute[71321]:       <alias name='pci.0'/>
Apr 12 12:31:02 user nova-compute[71321]:     </controller>
Apr 12 12:31:02 user nova-compute[71321]:     <controller type='ide' index='0'>
Apr 12 12:31:02 user nova-compute[71321]:       <alias name='ide'/>
Apr 12 12:31:02 user nova-compute[71321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 12 12:31:02 user nova-compute[71321]:     </controller>
Apr 12 12:31:02 user nova-compute[71321]:     <interface type='ethernet'>
Apr 12 12:31:02 user nova-compute[71321]:       <mac address='fa:16:3e:4a:27:fd'/>
Apr 12 12:31:02 user nova-compute[71321]:       <target dev='tap201eadd8-c7'/>
Apr 12 12:31:02 user nova-compute[71321]:       <model type='virtio'/>
Apr 12 12:31:02 user nova-compute[71321]:       <mtu size='1442'/>
Apr 12 12:31:02 user nova-compute[71321]:       <alias name='net0'/>
Apr 12 12:31:02 user nova-compute[71321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 12 12:31:02 user nova-compute[71321]:     </interface>
Apr 12 12:31:02 user nova-compute[71321]:     <serial type='pty'>
Apr 12 12:31:02 user nova-compute[71321]:       <source path='/dev/pts/7'/>
Apr 12 12:31:02 user nova-compute[71321]:       <log file='/opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/console.log' append='off'/>
Apr 12 12:31:02 user nova-compute[71321]:       <target type='isa-serial' port='0'>
Apr 12 12:31:02 user nova-compute[71321]:         <model name='isa-serial'/>
Apr 12 12:31:02 user nova-compute[71321]:       </target>
Apr 12 12:31:02 user nova-compute[71321]:       <alias name='serial0'/>
Apr 12 12:31:02 user nova-compute[71321]:     </serial>
Apr 12 12:31:02 user nova-compute[71321]:     <console type='pty' tty='/dev/pts/7'>
Apr 12 12:31:02 user nova-compute[71321]:       <source path='/dev/pts/7'/>
Apr 12 12:31:02 user nova-compute[71321]:       <log file='/opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/console.log' append='off'/>
Apr 12 12:31:02 user nova-compute[71321]:       <target type='serial' port='0'/>
Apr 12 12:31:02 user nova-compute[71321]:       <alias name='serial0'/>
Apr 12 12:31:02 user nova-compute[71321]:     </console>
Apr 12 12:31:02 user nova-compute[71321]:     <input type='mouse' bus='ps2'>
Apr 12 12:31:02 user nova-compute[71321]:       <alias name='input0'/>
Apr 12 12:31:02 user nova-compute[71321]:     </input>
Apr 12 12:31:02 user nova-compute[71321]:     <input type='keyboard' bus='ps2'>
Apr 12 12:31:02 user nova-compute[71321]:       <alias name='input1'/>
Apr 12 12:31:02 user nova-compute[71321]:     </input>
Apr 12 12:31:02 user nova-compute[71321]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Apr 12 12:31:02 user nova-compute[71321]:       <listen type='address' address='0.0.0.0'/>
Apr 12 12:31:02 user nova-compute[71321]:     </graphics>
Apr 12 12:31:02 user nova-compute[71321]:     <audio id='1' type='none'/>
Apr 12 12:31:02 user nova-compute[71321]:     <video>
Apr 12 12:31:02 user nova-compute[71321]:       <model type='virtio' heads='1' primary='yes'/>
Apr 12 12:31:02 user nova-compute[71321]:       <alias name='video0'/>
Apr 12 12:31:02 user nova-compute[71321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 12 12:31:02 user nova-compute[71321]:     </video>
Apr 12 12:31:02 user nova-compute[71321]:     <memballoon model='virtio'>
Apr 12 12:31:02 user nova-compute[71321]:       <stats period='10'/>
Apr 12 12:31:02 user nova-compute[71321]:       <alias name='balloon0'/>
Apr 12 12:31:02 user nova-compute[71321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 12 12:31:02 user nova-compute[71321]:     </memballoon>
Apr 12 12:31:02 user nova-compute[71321]:     <rng model='virtio'>
Apr 12 12:31:02 user nova-compute[71321]:       <backend model='random'>/dev/urandom</backend>
Apr 12 12:31:02 user nova-compute[71321]:       <alias name='rng0'/>
Apr 12 12:31:02 user nova-compute[71321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 12 12:31:02 user nova-compute[71321]:     </rng>
Apr 12 12:31:02 user nova-compute[71321]:   </devices>
Apr 12 12:31:02 user nova-compute[71321]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 12 12:31:02 user nova-compute[71321]:     <label>libvirt-79bee3fe-3300-4a28-b079-1bafaa1033c4</label>
Apr 12 12:31:02 user nova-compute[71321]:     <imagelabel>libvirt-79bee3fe-3300-4a28-b079-1bafaa1033c4</imagelabel>
Apr 12 12:31:02 user nova-compute[71321]:   </seclabel>
Apr 12 12:31:02 user nova-compute[71321]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 12 12:31:02 user nova-compute[71321]:     <label>+64055:+108</label>
Apr 12 12:31:02 user nova-compute[71321]:     <imagelabel>+64055:+108</imagelabel>
Apr 12 12:31:02 user nova-compute[71321]:   </seclabel>
Apr 12 12:31:02 user nova-compute[71321]: </domain>
Apr 12 12:31:02 user nova-compute[71321]:  {{(pid=71321) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 12 12:31:02 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Successfully detached device tap8438a9df-80 from instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 from the live domain config.
Apr 12 12:31:02 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:28:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-656063872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-656063872',id=8,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxGfNEhwxyml0RYHshQIBVlikZPUICMVOtWr1cX5kE9lM3qDUztZplY9zWTLExsTj4Jyt4GyZTZtlPvLt0Z2/a5v2pzKXPmtIr/OlOJ6S/2MsrCvF+uqljaJkNsq+Gqvw==',key_name='tempest-keypair-134546144',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:29:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0dd2a4a665514d0eb31653775b67356a',ramdisk_id='',reservation_id='r-u0qzq363',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1949865572',owner_user_name='tempest-TaggedAttachmentsTest-1949865572-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:29:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ff191ffb9604795bab6ada1eafd41ff',uuid=79bee3fe-3300-4a28-b079-1bafaa1033c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8438a9df-803e-44da-a2b6-b394bd23fbb1", "address": "fa:16:3e:10:ea:5b", "network": {"id": "fa236fb1-e347-4c0e-bb34-51cf6d7dd7f9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-842608701", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0dd2a4a665514d0eb31653775b67356a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8438a9df-80", "ovs_interfaceid": "8438a9df-803e-44da-a2b6-b394bd23fbb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:31:02 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Converting VIF {"id": "8438a9df-803e-44da-a2b6-b394bd23fbb1", "address": "fa:16:3e:10:ea:5b", "network": {"id": "fa236fb1-e347-4c0e-bb34-51cf6d7dd7f9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-842608701", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0dd2a4a665514d0eb31653775b67356a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8438a9df-80", "ovs_interfaceid": "8438a9df-803e-44da-a2b6-b394bd23fbb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:31:02 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:ea:5b,bridge_name='br-int',has_traffic_filtering=True,id=8438a9df-803e-44da-a2b6-b394bd23fbb1,network=Network(fa236fb1-e347-4c0e-bb34-51cf6d7dd7f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8438a9df-80') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:31:02 user nova-compute[71321]: DEBUG os_vif [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:ea:5b,bridge_name='br-int',has_traffic_filtering=True,id=8438a9df-803e-44da-a2b6-b394bd23fbb1,network=Network(fa236fb1-e347-4c0e-bb34-51cf6d7dd7f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8438a9df-80') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:31:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8438a9df-80, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:31:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:31:02 user nova-compute[71321]: INFO os_vif [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:ea:5b,bridge_name='br-int',has_traffic_filtering=True,id=8438a9df-803e-44da-a2b6-b394bd23fbb1,network=Network(fa236fb1-e347-4c0e-bb34-51cf6d7dd7f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8438a9df-80')
Apr 12 12:31:02 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:31:02 user nova-compute[71321]:   <nova:package version="0.0.0"/>
Apr 12 12:31:02 user nova-compute[71321]:   <nova:name>tempest-device-tagging-server-656063872</nova:name>
Apr 12 12:31:02 user nova-compute[71321]:   <nova:creationTime>2023-04-12 12:31:02</nova:creationTime>
Apr 12 12:31:02 user nova-compute[71321]:   <nova:flavor name="m1.nano">
Apr 12 12:31:02 user nova-compute[71321]:     <nova:memory>128</nova:memory>
Apr 12 12:31:02 user nova-compute[71321]:     <nova:disk>1</nova:disk>
Apr 12 12:31:02 user nova-compute[71321]:     <nova:swap>0</nova:swap>
Apr 12 12:31:02 user nova-compute[71321]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:31:02 user nova-compute[71321]:     <nova:vcpus>1</nova:vcpus>
Apr 12 12:31:02 user nova-compute[71321]:   </nova:flavor>
Apr 12 12:31:02 user nova-compute[71321]:   <nova:owner>
Apr 12 12:31:02 user nova-compute[71321]:     <nova:user uuid="2ff191ffb9604795bab6ada1eafd41ff">tempest-TaggedAttachmentsTest-1949865572-project-member</nova:user>
Apr 12 12:31:02 user nova-compute[71321]:     <nova:project uuid="0dd2a4a665514d0eb31653775b67356a">tempest-TaggedAttachmentsTest-1949865572</nova:project>
Apr 12 12:31:02 user nova-compute[71321]:   </nova:owner>
Apr 12 12:31:02 user nova-compute[71321]:   <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:31:02 user nova-compute[71321]:   <nova:ports>
Apr 12 12:31:02 user nova-compute[71321]:     <nova:port uuid="201eadd8-c760-4862-bcce-bcff996371f9">
Apr 12 12:31:02 user nova-compute[71321]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 12:31:02 user nova-compute[71321]:     </nova:port>
Apr 12 12:31:02 user nova-compute[71321]:   </nova:ports>
Apr 12 12:31:02 user nova-compute[71321]: </nova:instance>
Apr 12 12:31:02 user nova-compute[71321]:  {{(pid=71321) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 12 12:31:02 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] COPY block job progress, current cursor: 947912704 final cursor: 1073741824 {{(pid=71321) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 12:31:02 user nova-compute[71321]: DEBUG nova.compute.manager [req-70fc945e-a229-481f-9f48-5e6c49ca2df0 req-5910eaab-ae07-4b80-90d4-9ee1d2679ac4 service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Received event network-vif-unplugged-8438a9df-803e-44da-a2b6-b394bd23fbb1 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:02 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-70fc945e-a229-481f-9f48-5e6c49ca2df0 req-5910eaab-ae07-4b80-90d4-9ee1d2679ac4 service nova] Acquiring lock "79bee3fe-3300-4a28-b079-1bafaa1033c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:02 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-70fc945e-a229-481f-9f48-5e6c49ca2df0 req-5910eaab-ae07-4b80-90d4-9ee1d2679ac4 service nova] Lock "79bee3fe-3300-4a28-b079-1bafaa1033c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:02 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-70fc945e-a229-481f-9f48-5e6c49ca2df0 req-5910eaab-ae07-4b80-90d4-9ee1d2679ac4 service nova] Lock "79bee3fe-3300-4a28-b079-1bafaa1033c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:02 user nova-compute[71321]: DEBUG nova.compute.manager [req-70fc945e-a229-481f-9f48-5e6c49ca2df0 req-5910eaab-ae07-4b80-90d4-9ee1d2679ac4 service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] No waiting events found dispatching network-vif-unplugged-8438a9df-803e-44da-a2b6-b394bd23fbb1 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:31:02 user nova-compute[71321]: WARNING nova.compute.manager [req-70fc945e-a229-481f-9f48-5e6c49ca2df0 req-5910eaab-ae07-4b80-90d4-9ee1d2679ac4 service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Received unexpected event network-vif-unplugged-8438a9df-803e-44da-a2b6-b394bd23fbb1 for instance with vm_state active and task_state None.
Apr 12 12:31:02 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71321) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 12:31:02 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:31:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DRaPIpfK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:31:02 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:31:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:31:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:31:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7641580-b82c-42c3-a293-f0a1bea298b8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:31:03 user nova-compute[71321]: No targets found.
Apr 12 12:31:03 user nova-compute[71321]: iSNS:
Apr 12 12:31:03 user nova-compute[71321]: No targets found.
Apr 12 12:31:03 user nova-compute[71321]: STATIC:
Apr 12 12:31:03 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1
Apr 12 12:31:03 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:31:03 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:31:03 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569
Apr 12 12:31:03 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:31:03 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:31:03 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b
Apr 12 12:31:03 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:31:03 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:31:03 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24
Apr 12 12:31:03 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:31:03 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:31:03 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3
Apr 12 12:31:03 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:31:03 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:31:03 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc
Apr 12 12:31:03 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:31:03 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:31:03 user nova-compute[71321]: FIRMWARE:
Apr 12 12:31:03 user nova-compute[71321]: No targets found.
Apr 12 12:31:03 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:31:03 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:31:03 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "64589bd5-2688-4224-ba3e-8a26f9ffafaf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "64589bd5-2688-4224-ba3e-8a26f9ffafaf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "64589bd5-2688-4224-ba3e-8a26f9ffafaf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "64589bd5-2688-4224-ba3e-8a26f9ffafaf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "64589bd5-2688-4224-ba3e-8a26f9ffafaf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:03 user nova-compute[71321]: INFO nova.compute.manager [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Terminating instance
Apr 12 12:31:03 user nova-compute[71321]: DEBUG nova.compute.manager [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[056e1dd3-0d66-4c1c-99a5-059aefea521f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[380454b0-9421-46a1-8aeb-8568f5b82d72]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b (non-flash)
Apr 12 12:31:03 user nova-compute[71321]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:31:03 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:31:03 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:31:03 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:31:03 user nova-compute[71321]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)
Apr 12 12:31:03 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b (non-flash)
Apr 12 12:31:03 user nova-compute[71321]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:31:03 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:31:03 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:31:03 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:31:03 user nova-compute[71321]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)
Apr 12 12:31:03 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef8a1dbc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1'): ({'sdf'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Removing single pathed devices sdf {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a28537-f476-4f9f-9db1-fa0bc22e22ed]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab3733f-20fc-44af-857e-49e440c38ce8]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Flushing IO for device /dev/sdf {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed37feb6-92a9-4a88-8c46-253d468fd998]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "refresh_cache-79bee3fe-3300-4a28-b079-1bafaa1033c4" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquired lock "refresh_cache-79bee3fe-3300-4a28-b079-1bafaa1033c4" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG nova.network.neutron [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdcff24-0acb-4681-9a6b-90e5ad5e3ac7]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] SCSI volumes sdf have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6191b1-c0c0-4239-8451-adca3fc7ea8b]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4ae85b-b7f0-4564-a685-3f3f6a1a0d2c]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1, portal: 172.16.0.220,3260]
Apr 12 12:31:03 user nova-compute[71321]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1, portal: 172.16.0.220,3260] successful.
Apr 12 12:31:03 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG nova.compute.manager [req-62c92f08-33fc-4b9e-b64c-1dc0f573caee req-725986c9-a129-43e7-a8de-1ea4fd2e4c18 service nova] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Received event network-vif-unplugged-a3d4da82-f4ab-410c-8692-f14de0e43ef5 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-62c92f08-33fc-4b9e-b64c-1dc0f573caee req-725986c9-a129-43e7-a8de-1ea4fd2e4c18 service nova] Acquiring lock "64589bd5-2688-4224-ba3e-8a26f9ffafaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-62c92f08-33fc-4b9e-b64c-1dc0f573caee req-725986c9-a129-43e7-a8de-1ea4fd2e4c18 service nova] Lock "64589bd5-2688-4224-ba3e-8a26f9ffafaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-62c92f08-33fc-4b9e-b64c-1dc0f573caee req-725986c9-a129-43e7-a8de-1ea4fd2e4c18 service nova] Lock "64589bd5-2688-4224-ba3e-8a26f9ffafaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG nova.compute.manager [req-62c92f08-33fc-4b9e-b64c-1dc0f573caee req-725986c9-a129-43e7-a8de-1ea4fd2e4c18 service nova] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] No waiting events found dispatching network-vif-unplugged-a3d4da82-f4ab-410c-8692-f14de0e43ef5 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG nova.compute.manager [req-62c92f08-33fc-4b9e-b64c-1dc0f573caee req-725986c9-a129-43e7-a8de-1ea4fd2e4c18 service nova] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Received event network-vif-unplugged-a3d4da82-f4ab-410c-8692-f14de0e43ef5 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bc8189-bc8f-410a-abe9-fff5f2a253ef]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] <== disconnect_volume: return (366ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG nova.compute.manager [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EIrGTaQl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '540a69c0-488f-40cb-bdde-3e410029d4c8', 'attached_at': '', 'detached_at': '', 'volume_id': '173c47c1-0f4e-43d9-b90f-c6c458b25d5b', 'serial'} {{(pid=71321) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG nova.compute.manager [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] swap_volume: removing Cinder connection for volume e311de8d-6a47-423c-a299-4ce16f4d10f1 {{(pid=71321) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 12 12:31:03 user nova-compute[71321]: INFO nova.network.neutron [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Port 8438a9df-803e-44da-a2b6-b394bd23fbb1 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Apr 12 12:31:03 user nova-compute[71321]: DEBUG nova.network.neutron [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Updating instance_info_cache with network_info: [{"id": "201eadd8-c760-4862-bcce-bcff996371f9", "address": "fa:16:3e:4a:27:fd", "network": {"id": "a751f1e2-998e-4446-b94e-4bab0dc80db7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-990400052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dd2a4a665514d0eb31653775b67356a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201eadd8-c7", "ovs_interfaceid": "201eadd8-c760-4862-bcce-bcff996371f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Releasing lock "refresh_cache-79bee3fe-3300-4a28-b079-1bafaa1033c4" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "interface-79bee3fe-3300-4a28-b079-1bafaa1033c4-8438a9df-803e-44da-a2b6-b394bd23fbb1" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.882s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:03 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Instance destroyed successfully.
Apr 12 12:31:03 user nova-compute[71321]: DEBUG nova.objects.instance [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lazy-loading 'resources' on Instance uuid 64589bd5-2688-4224-ba3e-8a26f9ffafaf {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1737375268',display_name='tempest-TestVolumeBootPattern-server-1737375268',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1737375268',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:29:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ada441da2124adda751365952320e81',ramdisk_id='',reservation_id='r-9xhpm4s8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-310589135',owner_user_name='tempest-TestVolumeBootPattern-310589135-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:29:33Z,user_data=None,user_id='076e65b43f664765ad1d48be6e814f40',uuid=64589bd5-2688-4224-ba3e-8a26f9ffafaf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3d4da82-f4ab-410c-8692-f14de0e43ef5", "address": "fa:16:3e:cc:ba:ed", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3d4da82-f4", "ovs_interfaceid": "a3d4da82-f4ab-410c-8692-f14de0e43ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converting VIF {"id": "a3d4da82-f4ab-410c-8692-f14de0e43ef5", "address": "fa:16:3e:cc:ba:ed", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3d4da82-f4", "ovs_interfaceid": "a3d4da82-f4ab-410c-8692-f14de0e43ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:ba:ed,bridge_name='br-int',has_traffic_filtering=True,id=a3d4da82-f4ab-410c-8692-f14de0e43ef5,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3d4da82-f4') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG os_vif [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:ba:ed,bridge_name='br-int',has_traffic_filtering=True,id=a3d4da82-f4ab-410c-8692-f14de0e43ef5,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3d4da82-f4') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3d4da82-f4, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:31:03 user nova-compute[71321]: INFO os_vif [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:ba:ed,bridge_name='br-int',has_traffic_filtering=True,id=a3d4da82-f4ab-410c-8692-f14de0e43ef5,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3d4da82-f4')
Apr 12 12:31:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aESPGokd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:31:03 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:31:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef7f3cf-bd9e-43b8-b0c8-814ccc65e38b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:31:03 user nova-compute[71321]: No targets found.
Apr 12 12:31:03 user nova-compute[71321]: iSNS:
Apr 12 12:31:03 user nova-compute[71321]: No targets found.
Apr 12 12:31:03 user nova-compute[71321]: STATIC:
Apr 12 12:31:03 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569
Apr 12 12:31:03 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:31:03 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:31:03 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b
Apr 12 12:31:03 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:31:03 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:31:03 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24
Apr 12 12:31:03 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:31:03 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:31:03 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3
Apr 12 12:31:03 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:31:03 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:31:03 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc
Apr 12 12:31:03 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:31:03 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:31:03 user nova-compute[71321]: FIRMWARE:
Apr 12 12:31:03 user nova-compute[71321]: No targets found.
Apr 12 12:31:03 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:31:03 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:31:03 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3796385-1640-498a-ae70-b2377dbd5b9f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4f6d06-84f1-442d-a248-c36d342ca215]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b (non-flash)
Apr 12 12:31:03 user nova-compute[71321]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:31:03 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:31:03 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:31:03 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:31:03 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b (non-flash)
Apr 12 12:31:03 user nova-compute[71321]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 (non-flash)
Apr 12 12:31:03 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:31:03 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:31:03 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:31:03 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef8a06e950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3'): ({'sdb'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Removing single pathed devices sdb {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0855593-3f7e-4589-b3b1-d5f387265949]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6b46f9-9c5a-4645-9045-6eb6dccc5679]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Flushing IO for device /dev/sdb {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[febc6419-6c5f-477c-af24-dde0986351ef]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:31:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:04 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8880114f-17f0-41f3-ac9e-2a98d15fbe9f]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:04 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:31:04 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] SCSI volumes sdb have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:31:04 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:31:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:04 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0f256e-03bf-4895-9f0f-ccb11c136d5b]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:04 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:04 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c675a37f-413f-487c-a8dc-973b2971ffe6]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:04 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3, portal: 172.16.0.220,3260]
Apr 12 12:31:04 user nova-compute[71321]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3, portal: 172.16.0.220,3260] successful.
Apr 12 12:31:04 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad0cabc7-491c-473d-9798-463099b67dd3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:04 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a79fc6-5dd3-4619-80df-43bdbf2aabdc]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:04 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:04 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:31:04 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] <== disconnect_volume: return (347ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:31:04 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:31:04 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Deleting instance files /opt/stack/data/nova/instances/64589bd5-2688-4224-ba3e-8a26f9ffafaf_del
Apr 12 12:31:04 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Deletion of /opt/stack/data/nova/instances/64589bd5-2688-4224-ba3e-8a26f9ffafaf_del complete
Apr 12 12:31:04 user nova-compute[71321]: DEBUG nova.compute.manager [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] swap_volume: Updating volume e311de8d-6a47-423c-a299-4ce16f4d10f1 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "EIrGTaQl", "auth_password": "EjKv4gXrJSBFGt", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "173c47c1-0f4e-43d9-b90f-c6c458b25d5b"}, "status": "reserved", "instance": "540a69c0-488f-40cb-bdde-3e410029d4c8", "attached_at": "", "detached_at": "", "volume_id": "173c47c1-0f4e-43d9-b90f-c6c458b25d5b", "serial": "173c47c1-0f4e-43d9-b90f-c6c458b25d5b"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '173c47c1-0f4e-43d9-b90f-c6c458b25d5b', 'no_device': None, 'attachment_id': '48cd31a3-5ba6-423c-aa58-32e910d3c3e5'} {{(pid=71321) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 12 12:31:04 user nova-compute[71321]: INFO nova.compute.manager [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Took 1.20 seconds to destroy the instance on the hypervisor.
Apr 12 12:31:04 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:31:04 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:31:04 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:31:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Lock "540a69c0-488f-40cb-bdde-3e410029d4c8" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.043s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:04 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:31:04 user nova-compute[71321]: DEBUG nova.compute.manager [req-34efa699-691a-45b8-ada3-dc4edf4324e1 req-a4892eb0-ac2a-465c-9ddb-b1c590db8374 service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Received event network-vif-plugged-8438a9df-803e-44da-a2b6-b394bd23fbb1 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-34efa699-691a-45b8-ada3-dc4edf4324e1 req-a4892eb0-ac2a-465c-9ddb-b1c590db8374 service nova] Acquiring lock "79bee3fe-3300-4a28-b079-1bafaa1033c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-34efa699-691a-45b8-ada3-dc4edf4324e1 req-a4892eb0-ac2a-465c-9ddb-b1c590db8374 service nova] Lock "79bee3fe-3300-4a28-b079-1bafaa1033c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-34efa699-691a-45b8-ada3-dc4edf4324e1 req-a4892eb0-ac2a-465c-9ddb-b1c590db8374 service nova] Lock "79bee3fe-3300-4a28-b079-1bafaa1033c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:04 user nova-compute[71321]: DEBUG nova.compute.manager [req-34efa699-691a-45b8-ada3-dc4edf4324e1 req-a4892eb0-ac2a-465c-9ddb-b1c590db8374 service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] No waiting events found dispatching network-vif-plugged-8438a9df-803e-44da-a2b6-b394bd23fbb1 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:31:04 user nova-compute[71321]: WARNING nova.compute.manager [req-34efa699-691a-45b8-ada3-dc4edf4324e1 req-a4892eb0-ac2a-465c-9ddb-b1c590db8374 service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Received unexpected event network-vif-plugged-8438a9df-803e-44da-a2b6-b394bd23fbb1 for instance with vm_state active and task_state None.
Apr 12 12:31:04 user nova-compute[71321]: DEBUG nova.compute.manager [req-34efa699-691a-45b8-ada3-dc4edf4324e1 req-a4892eb0-ac2a-465c-9ddb-b1c590db8374 service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Received event network-vif-deleted-8438a9df-803e-44da-a2b6-b394bd23fbb1 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:04 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Took 0.46 seconds to deallocate network for instance.
Apr 12 12:31:05 user nova-compute[71321]: DEBUG nova.compute.manager [req-cc1626e0-c3fa-4106-9901-d44cc521d8b6 req-063fa9b7-910b-499a-b369-c31445f30351 service nova] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Received event network-vif-plugged-a3d4da82-f4ab-410c-8692-f14de0e43ef5 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-cc1626e0-c3fa-4106-9901-d44cc521d8b6 req-063fa9b7-910b-499a-b369-c31445f30351 service nova] Acquiring lock "64589bd5-2688-4224-ba3e-8a26f9ffafaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-cc1626e0-c3fa-4106-9901-d44cc521d8b6 req-063fa9b7-910b-499a-b369-c31445f30351 service nova] Lock "64589bd5-2688-4224-ba3e-8a26f9ffafaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-cc1626e0-c3fa-4106-9901-d44cc521d8b6 req-063fa9b7-910b-499a-b369-c31445f30351 service nova] Lock "64589bd5-2688-4224-ba3e-8a26f9ffafaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:05 user nova-compute[71321]: DEBUG nova.compute.manager [req-cc1626e0-c3fa-4106-9901-d44cc521d8b6 req-063fa9b7-910b-499a-b369-c31445f30351 service nova] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] No waiting events found dispatching network-vif-plugged-a3d4da82-f4ab-410c-8692-f14de0e43ef5 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:31:05 user nova-compute[71321]: WARNING nova.compute.manager [req-cc1626e0-c3fa-4106-9901-d44cc521d8b6 req-063fa9b7-910b-499a-b369-c31445f30351 service nova] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Received unexpected event network-vif-plugged-a3d4da82-f4ab-410c-8692-f14de0e43ef5 for instance with vm_state active and task_state deleting.
Apr 12 12:31:05 user nova-compute[71321]: INFO nova.compute.manager [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Took 0.78 seconds to detach 1 volumes for instance.
Apr 12 12:31:05 user nova-compute[71321]: DEBUG nova.compute.manager [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Deleting volume: ad0cabc7-491c-473d-9798-463099b67dd3 {{(pid=71321) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 12:31:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Acquiring lock "540a69c0-488f-40cb-bdde-3e410029d4c8" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Lock "540a69c0-488f-40cb-bdde-3e410029d4c8" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:05 user nova-compute[71321]: DEBUG os_brick.utils [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:31:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:05 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[210f4cce-c872-4e87-a040-b69f283fcfd6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:05 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[730baf54-8962-4469-a8b2-29bf3b9e2137]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:05 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0fa747-67f0-4246-b4b3-b5bbbfd826e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:05 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85de10e-1720-4caa-a767-e39a83e78a83]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:31:05 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:31:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:31:05 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:31:05 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b59d6aa-f72b-4944-9d89-412e770005ac]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:05 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:31:05 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:31:05 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:31:05 user nova-compute[71321]: DEBUG os_brick.utils [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:31:05 user nova-compute[71321]: INFO nova.compute.manager [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Swapping volume 173c47c1-0f4e-43d9-b90f-c6c458b25d5b for e311de8d-6a47-423c-a299-4ce16f4d10f1
Apr 12 12:31:05 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:31:05 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:31:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:06 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Deleted allocations for instance 64589bd5-2688-4224-ba3e-8a26f9ffafaf
Apr 12 12:31:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "64589bd5-2688-4224-ba3e-8a26f9ffafaf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.110s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:06 user nova-compute[71321]: DEBUG nova.compute.manager [req-6304c6a2-07d6-4af6-9c7b-0fb085d29b57 req-993b5d03-4540-4ec6-871c-8b6b199575cd service nova] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Received event network-vif-deleted-a3d4da82-f4ab-410c-8692-f14de0e43ef5 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:09 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:31:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG nova.compute.manager [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DRaPIpfK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '540a69c0-488f-40cb-bdde-3e410029d4c8', 'attached_at': '', 'detached_at': '', 'volume_id': 'e311de8d-6a47-423c-a299-4ce16f4d10f1', 'serial': 'e311de8d-6a47-423c-a299-4ce16f4d10f1'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EIrGTaQl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '173c47c1-0f4e-43d9-b90f-c6c458b25d5b'}, 'status': 'reserved', 'instance': '540a69c0-488f-40cb-bdde-3e410029d4c8', 'attached_at': '', 'detached_at': '', 'volume_id': '173c47c1-0f4e-43d9-b90f-c6c458b25d5b', 'serial'} {{(pid=71321) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DRaPIpfK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:31:10 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:31:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:31:10 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:31:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:31:10 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:31:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[022915c2-b7d1-42b3-abdc-4c8e743678e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:31:10 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ab4554-48dc-4459-9689-4ba110ecd4d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1] added
Apr 12 12:31:10 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9186e6-6e46-4837-a184-05cfbc3eb4c0]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[41eb5c23-6796-4b78-8cb0-37deea05d41a]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DRaPIpfK {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DRaPIpfK" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ad9bc9-8b84-48ad-9008-df4cc4d7140b]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DRaPIpfK'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[82960f2f-24ed-4c72-a650-cbc01ad1ff1e]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b12b504-3afa-4a25-b928-04cf8f41e2d0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b (non-flash)
Apr 12 12:31:10 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:31:10 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:31:10 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:31:10 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b (non-flash)
Apr 12 12:31:10 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:31:10 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:31:10 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:31:10 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1f67be-0b29-44ce-b49f-eba8e1150061]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1, portal: 172.16.0.220,3260]
Apr 12 12:31:10 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1, portal: 172.16.0.220,3260] successful.
Apr 12 12:31:10 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2552ff50-9f49-465e-baed-3a971f49d8a3]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc588f0c-5a79-477e-8b39-6f0dded3b9d1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b (non-flash)
Apr 12 12:31:10 user nova-compute[71321]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)
Apr 12 12:31:10 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:31:10 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:31:10 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:31:10 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b (non-flash)
Apr 12 12:31:10 user nova-compute[71321]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)
Apr 12 12:31:10 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:31:10 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:31:10 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:31:10 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c090438-4c3b-4236-8fa3-b5b32d5d3de9]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:10 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: None {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:31:11 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:31:11 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:31:11 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:31:11 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DRaPIpfK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:31:11 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:31:11 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23036656332633865', 'path': '/dev/sdb'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:31:11 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036656332633865', 'path': '/dev/sdb'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:31:11 user nova-compute[71321]: DEBUG nova.objects.instance [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Lazy-loading 'flavor' on Instance uuid 540a69c0-488f-40cb-bdde-3e410029d4c8 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:31:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-546c0c08-35f1-4043-ac30-56d49bc86af1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:31:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-546c0c08-35f1-4043-ac30-56d49bc86af1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:31:11 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 12:31:11 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] COPY block job progress, current cursor: 5242880 final cursor: 1073741824 {{(pid=71321) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 12:31:12 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Updating instance_info_cache with network_info: [{"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:31:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-546c0c08-35f1-4043-ac30-56d49bc86af1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:31:12 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 12:31:12 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] COPY block job progress, current cursor: 188743680 final cursor: 1073741824 {{(pid=71321) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 12:31:12 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] COPY block job progress, current cursor: 392167424 final cursor: 1073741824 {{(pid=71321) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 12:31:13 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681302658.1488492, 2f3ff25a-522c-431b-a177-85177401c7a9 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:31:13 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] VM Stopped (Lifecycle Event)
Apr 12 12:31:13 user nova-compute[71321]: DEBUG nova.compute.manager [None req-3ed33c37-3471-448f-a960-6b0ab73cb6c2 None None] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:31:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] COPY block job progress, current cursor: 513802240 final cursor: 1073741824 {{(pid=71321) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 12:31:13 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] COPY block job progress, current cursor: 650117120 final cursor: 1073741824 {{(pid=71321) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 12:31:14 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:31:14 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:31:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:14 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:31:14 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] COPY block job progress, current cursor: 830472192 final cursor: 1073741824 {{(pid=71321) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 12:31:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:15 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] COPY block job progress, current cursor: 847249408 final cursor: 1073741824 {{(pid=71321) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 12:31:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:15 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] COPY block job progress, current cursor: 1038090240 final cursor: 1073741824 {{(pid=71321) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 12:31:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71321) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EIrGTaQl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '173c47c1-0f4e-43d9-b90f-c6c458b25d5b': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:31:16 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:31:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[60dca698-a8cd-457a-b26a-5129c33442f3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:31:16 user nova-compute[71321]: No targets found.
Apr 12 12:31:16 user nova-compute[71321]: iSNS:
Apr 12 12:31:16 user nova-compute[71321]: No targets found.
Apr 12 12:31:16 user nova-compute[71321]: STATIC:
Apr 12 12:31:16 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1
Apr 12 12:31:16 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:31:16 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:31:16 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569
Apr 12 12:31:16 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:31:16 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:31:16 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b
Apr 12 12:31:16 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:31:16 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:31:16 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24
Apr 12 12:31:16 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:31:16 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:31:16 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc
Apr 12 12:31:16 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:31:16 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:31:16 user nova-compute[71321]: FIRMWARE:
Apr 12 12:31:16 user nova-compute[71321]: No targets found.
Apr 12 12:31:16 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:31:16 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:31:16 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d31396-b4a3-4e62-a72b-7483f9bb32b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f6dce8-9814-4261-a35c-ae95411a7c25]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b (non-flash)
Apr 12 12:31:16 user nova-compute[71321]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)
Apr 12 12:31:16 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:31:16 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:31:16 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:31:16 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b (non-flash)
Apr 12 12:31:16 user nova-compute[71321]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)
Apr 12 12:31:16 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:31:16 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:31:16 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:31:16 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef7c1eec20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b'): ({'sdh'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Removing single pathed devices sdh {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[01641483-0485-4bff-904c-9221721b3999]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[05074a6e-afcc-4425-8cb7-31183cbb780a]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Flushing IO for device /dev/sdh {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6eec7a0-27f4-49ea-aa2f-21495d7c718e]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG nova.compute.manager [req-3a202011-9ad7-4d64-a8a2-3b58a6041dda req-f6a295f3-96ee-4ad7-9a51-d01de70f6711 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-changed-93bb6ab6-63a2-421a-b331-92c957f29f5a {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG nova.compute.manager [req-3a202011-9ad7-4d64-a8a2-3b58a6041dda req-f6a295f3-96ee-4ad7-9a51-d01de70f6711 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Refreshing instance network info cache due to event network-changed-93bb6ab6-63a2-421a-b331-92c957f29f5a. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3a202011-9ad7-4d64-a8a2-3b58a6041dda req-f6a295f3-96ee-4ad7-9a51-d01de70f6711 service nova] Acquiring lock "refresh_cache-d8867363-6e36-4b34-9cc1-f30fbc572720" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3a202011-9ad7-4d64-a8a2-3b58a6041dda req-f6a295f3-96ee-4ad7-9a51-d01de70f6711 service nova] Acquired lock "refresh_cache-d8867363-6e36-4b34-9cc1-f30fbc572720" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG nova.network.neutron [req-3a202011-9ad7-4d64-a8a2-3b58a6041dda req-f6a295f3-96ee-4ad7-9a51-d01de70f6711 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Refreshing network info cache for port 93bb6ab6-63a2-421a-b331-92c957f29f5a {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.053s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1e6991-352d-44da-b881-88c833123448]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] SCSI volumes sdh have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[df74301a-3ee7-4222-b5a6-c3d4c295ea78]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[644eda73-22c6-40f2-bbc4-05c1e2337e1a]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b, portal: 172.16.0.220,3260]
Apr 12 12:31:16 user nova-compute[71321]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b, portal: 172.16.0.220,3260] successful.
Apr 12 12:31:16 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173c47c1-0f4e-43d9-b90f-c6c458b25d5b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6494e1d-dd39-425b-9f0a-08fc318c649f]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] <== disconnect_volume: return (407ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/651d5c05-2d02-450f-a33c-fbd9b3109016/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG nova.compute.manager [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DRaPIpfK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '540a69c0-488f-40cb-bdde-3e410029d4c8', 'attached_at': '', 'detached_at': '', 'volume_id': 'e311de8d-6a47-423c-a299-4ce16f4d10f1', 'serial'} {{(pid=71321) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG nova.compute.manager [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] swap_volume: removing Cinder connection for volume 173c47c1-0f4e-43d9-b90f-c6c458b25d5b {{(pid=71321) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/651d5c05-2d02-450f-a33c-fbd9b3109016/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/651d5c05-2d02-450f-a33c-fbd9b3109016/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/651d5c05-2d02-450f-a33c-fbd9b3109016/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a69c0-488f-40cb-bdde-3e410029d4c8/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a69c0-488f-40cb-bdde-3e410029d4c8/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a69c0-488f-40cb-bdde-3e410029d4c8/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:17 user nova-compute[71321]: DEBUG nova.network.neutron [req-3a202011-9ad7-4d64-a8a2-3b58a6041dda req-f6a295f3-96ee-4ad7-9a51-d01de70f6711 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Updated VIF entry in instance network info cache for port 93bb6ab6-63a2-421a-b331-92c957f29f5a. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:31:17 user nova-compute[71321]: DEBUG nova.network.neutron [req-3a202011-9ad7-4d64-a8a2-3b58a6041dda req-f6a295f3-96ee-4ad7-9a51-d01de70f6711 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Updating instance_info_cache with network_info: [{"id": "93bb6ab6-63a2-421a-b331-92c957f29f5a", "address": "fa:16:3e:79:39:dc", "network": {"id": "200ada24-4b99-42e5-9085-07900a59a716", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1440676334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bb6ab6-63", "ovs_interfaceid": "93bb6ab6-63a2-421a-b331-92c957f29f5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c698ebb6-016a-4988-8c8a-7a75252a7944", "address": "fa:16:3e:c8:f3:a6", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc698ebb6-01", "ovs_interfaceid": "c698ebb6-016a-4988-8c8a-7a75252a7944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bb10902a-003e-4c1a-85a8-194f040a1ffb", "address": "fa:16:3e:36:6f:30", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb10902a-00", "ovs_interfaceid": "bb10902a-003e-4c1a-85a8-194f040a1ffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "389d5d9e-e5fc-48f1-b443-b04d08ec6181", "address": "fa:16:3e:9e:00:f4", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap389d5d9e-e5", "ovs_interfaceid": "389d5d9e-e5fc-48f1-b443-b04d08ec6181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf6a7707-9d55-46b2-8738-06505013048b", "address": "fa:16:3e:be:d3:4b", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6a7707-9d", "ovs_interfaceid": "bf6a7707-9d55-46b2-8738-06505013048b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9757213-2bc0-46a5-bffa-3b503c65ecc2", "address": "fa:16:3e:03:d8:98", "network": {"id": "f67d6710-fe9f-4d97-935e-535e0202f0ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048697198", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9757213-2b", "ovs_interfaceid": "e9757213-2bc0-46a5-bffa-3b503c65ecc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f2ec393-bb3c-4986-bd50-44ae9a7147b0", "address": "fa:16:3e:4c:1b:5c", "network": {"id": "f67d6710-fe9f-4d97-935e-535e0202f0ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048697198", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f2ec393-bb", "ovs_interfaceid": "6f2ec393-bb3c-4986-bd50-44ae9a7147b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:31:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3a202011-9ad7-4d64-a8a2-3b58a6041dda req-f6a295f3-96ee-4ad7-9a51-d01de70f6711 service nova] Releasing lock "refresh_cache-d8867363-6e36-4b34-9cc1-f30fbc572720" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:31:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a69c0-488f-40cb-bdde-3e410029d4c8/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:17 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:31:17 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:31:17 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:31:17 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:31:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG nova.compute.manager [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] swap_volume: Updating volume 173c47c1-0f4e-43d9-b90f-c6c458b25d5b BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "DRaPIpfK", "auth_password": "YviAN4HjEzT7w0", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "e311de8d-6a47-423c-a299-4ce16f4d10f1"}, "status": "reserved", "instance": "540a69c0-488f-40cb-bdde-3e410029d4c8", "attached_at": "", "detached_at": "", "volume_id": "e311de8d-6a47-423c-a299-4ce16f4d10f1", "serial": "e311de8d-6a47-423c-a299-4ce16f4d10f1"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'e311de8d-6a47-423c-a299-4ce16f4d10f1', 'no_device': None, 'attachment_id': 'e4b98ef0-6597-43db-b63b-864692bdbb70'} {{(pid=71321) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 12 12:31:18 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:31:18 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:31:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=7618MB free_disk=26.547523498535156GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Lock "540a69c0-488f-40cb-bdde-3e410029d4c8" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.978s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "d8867363-6e36-4b34-9cc1-f30fbc572720" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:18 user nova-compute[71321]: INFO nova.compute.manager [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Terminating instance
Apr 12 12:31:18 user nova-compute[71321]: DEBUG nova.compute.manager [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 10116da0-785c-41cf-96bb-95721af863db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance a4107f2d-88e4-4846-9ece-cb16ad7ecd02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 839e85a2-f7af-482d-a5e6-09195888300e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 540a69c0-488f-40cb-bdde-3e410029d4c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance d8867363-6e36-4b34-9cc1-f30fbc572720 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 651d5c05-2d02-450f-a33c-fbd9b3109016 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681302663.7585251, 64589bd5-2688-4224-ba3e-8a26f9ffafaf => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:31:18 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] VM Stopped (Lifecycle Event)
Apr 12 12:31:18 user nova-compute[71321]: DEBUG nova.compute.manager [None req-20b5bdf5-38ee-4d8e-bead-44eecb78212a None None] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG nova.compute.manager [req-5f869ca3-fa16-487e-af19-c72b3aba15d9 req-1fb3a3c6-6444-4081-856e-832c3123b230 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-unplugged-93bb6ab6-63a2-421a-b331-92c957f29f5a {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-5f869ca3-fa16-487e-af19-c72b3aba15d9 req-1fb3a3c6-6444-4081-856e-832c3123b230 service nova] Acquiring lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-5f869ca3-fa16-487e-af19-c72b3aba15d9 req-1fb3a3c6-6444-4081-856e-832c3123b230 service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-5f869ca3-fa16-487e-af19-c72b3aba15d9 req-1fb3a3c6-6444-4081-856e-832c3123b230 service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG nova.compute.manager [req-5f869ca3-fa16-487e-af19-c72b3aba15d9 req-1fb3a3c6-6444-4081-856e-832c3123b230 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] No waiting events found dispatching network-vif-unplugged-93bb6ab6-63a2-421a-b331-92c957f29f5a {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG nova.compute.manager [req-5f869ca3-fa16-487e-af19-c72b3aba15d9 req-1fb3a3c6-6444-4081-856e-832c3123b230 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-unplugged-93bb6ab6-63a2-421a-b331-92c957f29f5a for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "540a69c0-488f-40cb-bdde-3e410029d4c8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "540a69c0-488f-40cb-bdde-3e410029d4c8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:18 user nova-compute[71321]: INFO nova.compute.manager [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Detaching volume e311de8d-6a47-423c-a299-4ce16f4d10f1
Apr 12 12:31:19 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG nova.compute.manager [req-66bfabcf-72e0-46b6-ac3d-2f8cd3bf5d72 req-51fc447c-897a-4458-bab5-97b1e7282004 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-unplugged-c698ebb6-016a-4988-8c8a-7a75252a7944 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-66bfabcf-72e0-46b6-ac3d-2f8cd3bf5d72 req-51fc447c-897a-4458-bab5-97b1e7282004 service nova] Acquiring lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-66bfabcf-72e0-46b6-ac3d-2f8cd3bf5d72 req-51fc447c-897a-4458-bab5-97b1e7282004 service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-66bfabcf-72e0-46b6-ac3d-2f8cd3bf5d72 req-51fc447c-897a-4458-bab5-97b1e7282004 service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG nova.compute.manager [req-66bfabcf-72e0-46b6-ac3d-2f8cd3bf5d72 req-51fc447c-897a-4458-bab5-97b1e7282004 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] No waiting events found dispatching network-vif-unplugged-c698ebb6-016a-4988-8c8a-7a75252a7944 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG nova.compute.manager [req-66bfabcf-72e0-46b6-ac3d-2f8cd3bf5d72 req-51fc447c-897a-4458-bab5-97b1e7282004 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-unplugged-c698ebb6-016a-4988-8c8a-7a75252a7944 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:31:19 user nova-compute[71321]: INFO nova.virt.block_device [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Attempting to driver detach volume e311de8d-6a47-423c-a299-4ce16f4d10f1 from mountpoint /dev/vdb
Apr 12 12:31:19 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.585s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Attempting to detach device vdb from instance 540a69c0-488f-40cb-bdde-3e410029d4c8 from the persistent domain config. {{(pid=71321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:31:19 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:31:19 user nova-compute[71321]:   <source dev="/dev/sdb"/>
Apr 12 12:31:19 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:31:19 user nova-compute[71321]:   <serial>e311de8d-6a47-423c-a299-4ce16f4d10f1</serial>
Apr 12 12:31:19 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 12:31:19 user nova-compute[71321]: </disk>
Apr 12 12:31:19 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:31:19 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Successfully detached device vdb from instance 540a69c0-488f-40cb-bdde-3e410029d4c8 from the persistent domain config.
Apr 12 12:31:19 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 540a69c0-488f-40cb-bdde-3e410029d4c8 from the live domain config. {{(pid=71321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:31:19 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:31:19 user nova-compute[71321]:   <source dev="/dev/sdb"/>
Apr 12 12:31:19 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:31:19 user nova-compute[71321]:   <serial>e311de8d-6a47-423c-a299-4ce16f4d10f1</serial>
Apr 12 12:31:19 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 12:31:19 user nova-compute[71321]: </disk>
Apr 12 12:31:19 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG nova.compute.manager [req-66faac36-1207-41a1-87a0-002b2c49f229 req-52d336ce-36f1-461a-b8ab-5c20c4b3c0bc service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-unplugged-bf6a7707-9d55-46b2-8738-06505013048b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-66faac36-1207-41a1-87a0-002b2c49f229 req-52d336ce-36f1-461a-b8ab-5c20c4b3c0bc service nova] Acquiring lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-66faac36-1207-41a1-87a0-002b2c49f229 req-52d336ce-36f1-461a-b8ab-5c20c4b3c0bc service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-66faac36-1207-41a1-87a0-002b2c49f229 req-52d336ce-36f1-461a-b8ab-5c20c4b3c0bc service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG nova.compute.manager [req-66faac36-1207-41a1-87a0-002b2c49f229 req-52d336ce-36f1-461a-b8ab-5c20c4b3c0bc service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] No waiting events found dispatching network-vif-unplugged-bf6a7707-9d55-46b2-8738-06505013048b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG nova.compute.manager [req-66faac36-1207-41a1-87a0-002b2c49f229 req-52d336ce-36f1-461a-b8ab-5c20c4b3c0bc service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-unplugged-bf6a7707-9d55-46b2-8738-06505013048b for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Received event <DeviceRemovedEvent: 1681302679.610305, 540a69c0-488f-40cb-bdde-3e410029d4c8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 540a69c0-488f-40cb-bdde-3e410029d4c8 {{(pid=71321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 12:31:19 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Successfully detached device vdb from instance 540a69c0-488f-40cb-bdde-3e410029d4c8 from the live domain config.
Apr 12 12:31:19 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DRaPIpfK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'e311de8d-6a47-423c-a299-4ce16f4d10f1': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:31:19 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:31:19 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34e6b3d-2bbc-418b-9e71-6de23ee488ab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:31:19 user nova-compute[71321]: No targets found.
Apr 12 12:31:19 user nova-compute[71321]: iSNS:
Apr 12 12:31:19 user nova-compute[71321]: No targets found.
Apr 12 12:31:19 user nova-compute[71321]: STATIC:
Apr 12 12:31:19 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1
Apr 12 12:31:19 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:31:19 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:31:19 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569
Apr 12 12:31:19 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:31:19 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:31:19 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24
Apr 12 12:31:19 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:31:19 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:31:19 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc
Apr 12 12:31:19 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:31:19 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:31:19 user nova-compute[71321]: FIRMWARE:
Apr 12 12:31:19 user nova-compute[71321]: No targets found.
Apr 12 12:31:19 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:31:19 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:31:19 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b8cc43-e4af-4970-be64-2e2772ca7529]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a23f96-a1da-498a-943c-c11d6f079043]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)
Apr 12 12:31:19 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:31:19 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:31:19 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:31:19 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 (non-flash)
Apr 12 12:31:19 user nova-compute[71321]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:31:19 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:31:19 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:31:19 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef8a0b5c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1'): ({'sdb'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Removing single pathed devices sdb {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7004504a-27bf-4e56-8034-39f4c71c52c1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f88f83d-0dd5-4894-a589-e3fa90287b20]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Flushing IO for device /dev/sdb {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5f47c9-e06c-458d-841d-d5bf6b3321a0]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cc251c-117a-4a01-96b1-33a0f5db22bf]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] SCSI volumes sdb have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd43f02-929a-49ca-ac65-ce521e91cd0d]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa607cad-2e00-4cbc-9049-555580e04282]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1, portal: 172.16.0.220,3260]
Apr 12 12:31:19 user nova-compute[71321]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1, portal: 172.16.0.220,3260] successful.
Apr 12 12:31:19 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e311de8d-6a47-423c-a299-4ce16f4d10f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[585419fd-6b98-49fb-85ca-e1c15e73745e]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] <== disconnect_volume: return (368ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:31:20 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Instance destroyed successfully.
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.objects.instance [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lazy-loading 'resources' on Instance uuid d8867363-6e36-4b34-9cc1-f30fbc572720 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:29:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1511709584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1511709584',id=10,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzJQXzt1AYOf4lFnoJZvCjH3+G3z3Xlj83+ey7m3OEW9t8n5k8TLfR+L2ikcKnDMFMmln4QvSg9XLtbDzFTnjllywjp5FJCi4mQrVJZGB6DYL5ifjmZNLoATW9/WbDgrg==',key_name='tempest-keypair-1404432695',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:29:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed98064a134b4603bbf641f45988564a',ramdisk_id='',reservation_id='r-ezox3prz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-350828706',owner_user_name='tempest-TaggedBootDevicesTest-350828706-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:29:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1cf68007f18458b9824e056151f5c57',uuid=d8867363-6e36-4b34-9cc1-f30fbc572720,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93bb6ab6-63a2-421a-b331-92c957f29f5a", "address": "fa:16:3e:79:39:dc", "network": {"id": "200ada24-4b99-42e5-9085-07900a59a716", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1440676334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bb6ab6-63", "ovs_interfaceid": "93bb6ab6-63a2-421a-b331-92c957f29f5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converting VIF {"id": "93bb6ab6-63a2-421a-b331-92c957f29f5a", "address": "fa:16:3e:79:39:dc", "network": {"id": "200ada24-4b99-42e5-9085-07900a59a716", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1440676334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bb6ab6-63", "ovs_interfaceid": "93bb6ab6-63a2-421a-b331-92c957f29f5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:39:dc,bridge_name='br-int',has_traffic_filtering=True,id=93bb6ab6-63a2-421a-b331-92c957f29f5a,network=Network(200ada24-4b99-42e5-9085-07900a59a716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93bb6ab6-63') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG os_vif [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:39:dc,bridge_name='br-int',has_traffic_filtering=True,id=93bb6ab6-63a2-421a-b331-92c957f29f5a,network=Network(200ada24-4b99-42e5-9085-07900a59a716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93bb6ab6-63') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93bb6ab6-63, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:20 user nova-compute[71321]: INFO os_vif [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:39:dc,bridge_name='br-int',has_traffic_filtering=True,id=93bb6ab6-63a2-421a-b331-92c957f29f5a,network=Network(200ada24-4b99-42e5-9085-07900a59a716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93bb6ab6-63')
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:29:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1511709584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1511709584',id=10,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzJQXzt1AYOf4lFnoJZvCjH3+G3z3Xlj83+ey7m3OEW9t8n5k8TLfR+L2ikcKnDMFMmln4QvSg9XLtbDzFTnjllywjp5FJCi4mQrVJZGB6DYL5ifjmZNLoATW9/WbDgrg==',key_name='tempest-keypair-1404432695',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:29:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed98064a134b4603bbf641f45988564a',ramdisk_id='',reservation_id='r-ezox3prz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-350828706',owner_user_name='tempest-TaggedBootDevicesTest-350828706-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:29:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1cf68007f18458b9824e056151f5c57',uuid=d8867363-6e36-4b34-9cc1-f30fbc572720,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c698ebb6-016a-4988-8c8a-7a75252a7944", "address": "fa:16:3e:c8:f3:a6", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc698ebb6-01", "ovs_interfaceid": "c698ebb6-016a-4988-8c8a-7a75252a7944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converting VIF {"id": "c698ebb6-016a-4988-8c8a-7a75252a7944", "address": "fa:16:3e:c8:f3:a6", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc698ebb6-01", "ovs_interfaceid": "c698ebb6-016a-4988-8c8a-7a75252a7944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:f3:a6,bridge_name='br-int',has_traffic_filtering=True,id=c698ebb6-016a-4988-8c8a-7a75252a7944,network=Network(623863b1-0de3-49d4-b240-59885c22eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc698ebb6-01') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG os_vif [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:f3:a6,bridge_name='br-int',has_traffic_filtering=True,id=c698ebb6-016a-4988-8c8a-7a75252a7944,network=Network(623863b1-0de3-49d4-b240-59885c22eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc698ebb6-01') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc698ebb6-01, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:20 user nova-compute[71321]: INFO os_vif [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:f3:a6,bridge_name='br-int',has_traffic_filtering=True,id=c698ebb6-016a-4988-8c8a-7a75252a7944,network=Network(623863b1-0de3-49d4-b240-59885c22eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc698ebb6-01')
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:29:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1511709584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1511709584',id=10,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzJQXzt1AYOf4lFnoJZvCjH3+G3z3Xlj83+ey7m3OEW9t8n5k8TLfR+L2ikcKnDMFMmln4QvSg9XLtbDzFTnjllywjp5FJCi4mQrVJZGB6DYL5ifjmZNLoATW9/WbDgrg==',key_name='tempest-keypair-1404432695',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:29:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed98064a134b4603bbf641f45988564a',ramdisk_id='',reservation_id='r-ezox3prz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-350828706',owner_user_name='tempest-TaggedBootDevicesTest-350828706-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:29:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1cf68007f18458b9824e056151f5c57',uuid=d8867363-6e36-4b34-9cc1-f30fbc572720,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb10902a-003e-4c1a-85a8-194f040a1ffb", "address": "fa:16:3e:36:6f:30", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb10902a-00", "ovs_interfaceid": "bb10902a-003e-4c1a-85a8-194f040a1ffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converting VIF {"id": "bb10902a-003e-4c1a-85a8-194f040a1ffb", "address": "fa:16:3e:36:6f:30", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb10902a-00", "ovs_interfaceid": "bb10902a-003e-4c1a-85a8-194f040a1ffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:6f:30,bridge_name='br-int',has_traffic_filtering=True,id=bb10902a-003e-4c1a-85a8-194f040a1ffb,network=Network(623863b1-0de3-49d4-b240-59885c22eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbb10902a-00') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG os_vif [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:6f:30,bridge_name='br-int',has_traffic_filtering=True,id=bb10902a-003e-4c1a-85a8-194f040a1ffb,network=Network(623863b1-0de3-49d4-b240-59885c22eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbb10902a-00') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb10902a-00, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:20 user nova-compute[71321]: INFO os_vif [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:6f:30,bridge_name='br-int',has_traffic_filtering=True,id=bb10902a-003e-4c1a-85a8-194f040a1ffb,network=Network(623863b1-0de3-49d4-b240-59885c22eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbb10902a-00')
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:29:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1511709584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1511709584',id=10,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzJQXzt1AYOf4lFnoJZvCjH3+G3z3Xlj83+ey7m3OEW9t8n5k8TLfR+L2ikcKnDMFMmln4QvSg9XLtbDzFTnjllywjp5FJCi4mQrVJZGB6DYL5ifjmZNLoATW9/WbDgrg==',key_name='tempest-keypair-1404432695',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:29:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed98064a134b4603bbf641f45988564a',ramdisk_id='',reservation_id='r-ezox3prz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-350828706',owner_user_name='tempest-TaggedBootDevicesTest-350828706-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:29:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1cf68007f18458b9824e056151f5c57',uuid=d8867363-6e36-4b34-9cc1-f30fbc572720,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "389d5d9e-e5fc-48f1-b443-b04d08ec6181", "address": "fa:16:3e:9e:00:f4", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap389d5d9e-e5", "ovs_interfaceid": "389d5d9e-e5fc-48f1-b443-b04d08ec6181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converting VIF {"id": "389d5d9e-e5fc-48f1-b443-b04d08ec6181", "address": "fa:16:3e:9e:00:f4", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap389d5d9e-e5", "ovs_interfaceid": "389d5d9e-e5fc-48f1-b443-b04d08ec6181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:00:f4,bridge_name='br-int',has_traffic_filtering=True,id=389d5d9e-e5fc-48f1-b443-b04d08ec6181,network=Network(623863b1-0de3-49d4-b240-59885c22eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap389d5d9e-e5') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG os_vif [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:00:f4,bridge_name='br-int',has_traffic_filtering=True,id=389d5d9e-e5fc-48f1-b443-b04d08ec6181,network=Network(623863b1-0de3-49d4-b240-59885c22eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap389d5d9e-e5') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap389d5d9e-e5, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:20 user nova-compute[71321]: INFO os_vif [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:00:f4,bridge_name='br-int',has_traffic_filtering=True,id=389d5d9e-e5fc-48f1-b443-b04d08ec6181,network=Network(623863b1-0de3-49d4-b240-59885c22eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap389d5d9e-e5')
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:29:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1511709584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1511709584',id=10,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzJQXzt1AYOf4lFnoJZvCjH3+G3z3Xlj83+ey7m3OEW9t8n5k8TLfR+L2ikcKnDMFMmln4QvSg9XLtbDzFTnjllywjp5FJCi4mQrVJZGB6DYL5ifjmZNLoATW9/WbDgrg==',key_name='tempest-keypair-1404432695',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:29:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed98064a134b4603bbf641f45988564a',ramdisk_id='',reservation_id='r-ezox3prz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-350828706',owner_user_name='tempest-TaggedBootDevicesTest-350828706-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:29:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1cf68007f18458b9824e056151f5c57',uuid=d8867363-6e36-4b34-9cc1-f30fbc572720,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf6a7707-9d55-46b2-8738-06505013048b", "address": "fa:16:3e:be:d3:4b", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6a7707-9d", "ovs_interfaceid": "bf6a7707-9d55-46b2-8738-06505013048b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converting VIF {"id": "bf6a7707-9d55-46b2-8738-06505013048b", "address": "fa:16:3e:be:d3:4b", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6a7707-9d", "ovs_interfaceid": "bf6a7707-9d55-46b2-8738-06505013048b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:d3:4b,bridge_name='br-int',has_traffic_filtering=True,id=bf6a7707-9d55-46b2-8738-06505013048b,network=Network(623863b1-0de3-49d4-b240-59885c22eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6a7707-9d') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG os_vif [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:d3:4b,bridge_name='br-int',has_traffic_filtering=True,id=bf6a7707-9d55-46b2-8738-06505013048b,network=Network(623863b1-0de3-49d4-b240-59885c22eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6a7707-9d') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf6a7707-9d, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:20 user nova-compute[71321]: INFO os_vif [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:d3:4b,bridge_name='br-int',has_traffic_filtering=True,id=bf6a7707-9d55-46b2-8738-06505013048b,network=Network(623863b1-0de3-49d4-b240-59885c22eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6a7707-9d')
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:29:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1511709584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1511709584',id=10,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzJQXzt1AYOf4lFnoJZvCjH3+G3z3Xlj83+ey7m3OEW9t8n5k8TLfR+L2ikcKnDMFMmln4QvSg9XLtbDzFTnjllywjp5FJCi4mQrVJZGB6DYL5ifjmZNLoATW9/WbDgrg==',key_name='tempest-keypair-1404432695',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:29:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed98064a134b4603bbf641f45988564a',ramdisk_id='',reservation_id='r-ezox3prz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-350828706',owner_user_name='tempest-TaggedBootDevicesTest-350828706-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:29:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1cf68007f18458b9824e056151f5c57',uuid=d8867363-6e36-4b34-9cc1-f30fbc572720,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9757213-2bc0-46a5-bffa-3b503c65ecc2", "address": "fa:16:3e:03:d8:98", "network": {"id": "f67d6710-fe9f-4d97-935e-535e0202f0ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048697198", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9757213-2b", "ovs_interfaceid": "e9757213-2bc0-46a5-bffa-3b503c65ecc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converting VIF {"id": "e9757213-2bc0-46a5-bffa-3b503c65ecc2", "address": "fa:16:3e:03:d8:98", "network": {"id": "f67d6710-fe9f-4d97-935e-535e0202f0ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048697198", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9757213-2b", "ovs_interfaceid": "e9757213-2bc0-46a5-bffa-3b503c65ecc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:d8:98,bridge_name='br-int',has_traffic_filtering=True,id=e9757213-2bc0-46a5-bffa-3b503c65ecc2,network=Network(f67d6710-fe9f-4d97-935e-535e0202f0ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9757213-2b') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG os_vif [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:d8:98,bridge_name='br-int',has_traffic_filtering=True,id=e9757213-2bc0-46a5-bffa-3b503c65ecc2,network=Network(f67d6710-fe9f-4d97-935e-535e0202f0ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9757213-2b') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9757213-2b, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:20 user nova-compute[71321]: INFO os_vif [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:d8:98,bridge_name='br-int',has_traffic_filtering=True,id=e9757213-2bc0-46a5-bffa-3b503c65ecc2,network=Network(f67d6710-fe9f-4d97-935e-535e0202f0ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9757213-2b')
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:29:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1511709584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1511709584',id=10,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzJQXzt1AYOf4lFnoJZvCjH3+G3z3Xlj83+ey7m3OEW9t8n5k8TLfR+L2ikcKnDMFMmln4QvSg9XLtbDzFTnjllywjp5FJCi4mQrVJZGB6DYL5ifjmZNLoATW9/WbDgrg==',key_name='tempest-keypair-1404432695',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:29:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed98064a134b4603bbf641f45988564a',ramdisk_id='',reservation_id='r-ezox3prz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-350828706',owner_user_name='tempest-TaggedBootDevicesTest-350828706-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:29:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1cf68007f18458b9824e056151f5c57',uuid=d8867363-6e36-4b34-9cc1-f30fbc572720,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f2ec393-bb3c-4986-bd50-44ae9a7147b0", "address": "fa:16:3e:4c:1b:5c", "network": {"id": "f67d6710-fe9f-4d97-935e-535e0202f0ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048697198", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f2ec393-bb", "ovs_interfaceid": "6f2ec393-bb3c-4986-bd50-44ae9a7147b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converting VIF {"id": "6f2ec393-bb3c-4986-bd50-44ae9a7147b0", "address": "fa:16:3e:4c:1b:5c", "network": {"id": "f67d6710-fe9f-4d97-935e-535e0202f0ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048697198", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f2ec393-bb", "ovs_interfaceid": "6f2ec393-bb3c-4986-bd50-44ae9a7147b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:1b:5c,bridge_name='br-int',has_traffic_filtering=True,id=6f2ec393-bb3c-4986-bd50-44ae9a7147b0,network=Network(f67d6710-fe9f-4d97-935e-535e0202f0ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f2ec393-bb') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG os_vif [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:1b:5c,bridge_name='br-int',has_traffic_filtering=True,id=6f2ec393-bb3c-4986-bd50-44ae9a7147b0,network=Network(f67d6710-fe9f-4d97-935e-535e0202f0ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f2ec393-bb') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f2ec393-bb, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:31:20 user nova-compute[71321]: INFO os_vif [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:1b:5c,bridge_name='br-int',has_traffic_filtering=True,id=6f2ec393-bb3c-4986-bd50-44ae9a7147b0,network=Network(f67d6710-fe9f-4d97-935e-535e0202f0ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f2ec393-bb')
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dSwPCAuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:31:20 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:31:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f49649-faa9-4276-8a36-8c3234fd98b1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:31:20 user nova-compute[71321]: No targets found.
Apr 12 12:31:20 user nova-compute[71321]: iSNS:
Apr 12 12:31:20 user nova-compute[71321]: No targets found.
Apr 12 12:31:20 user nova-compute[71321]: STATIC:
Apr 12 12:31:20 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569
Apr 12 12:31:20 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:31:20 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:31:20 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24
Apr 12 12:31:20 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:31:20 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:31:20 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc
Apr 12 12:31:20 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:31:20 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:31:20 user nova-compute[71321]: FIRMWARE:
Apr 12 12:31:20 user nova-compute[71321]: No targets found.
Apr 12 12:31:20 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:31:20 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:31:20 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f186c90c-69b9-40d7-ba8a-47d939957e66]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8106b8a8-f7db-4a05-b1a7-1649887b8f9e]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:31:20 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:31:20 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:31:20 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc (non-flash)
Apr 12 12:31:20 user nova-compute[71321]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:31:20 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:31:20 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef7c330550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc'): ({'sdc'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Removing single pathed devices sdc {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc74a752-aa66-47a8-9fec-05ac4b834180]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[77867d26-21b3-4971-9ea8-7164c18242ae]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Flushing IO for device /dev/sdc {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0ab12b-1655-4b85-9e56-b5d3bb2a704c]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[129f3289-6f60-464f-9523-cb00a2e29c74]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] SCSI volumes sdc have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ee8c5b-8249-425c-b5a5-38bcdcc1258c]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.compute.manager [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-plugged-93bb6ab6-63a2-421a-b331-92c957f29f5a {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] Acquiring lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.compute.manager [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] No waiting events found dispatching network-vif-plugged-93bb6ab6-63a2-421a-b331-92c957f29f5a {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:31:20 user nova-compute[71321]: WARNING nova.compute.manager [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received unexpected event network-vif-plugged-93bb6ab6-63a2-421a-b331-92c957f29f5a for instance with vm_state active and task_state deleting.
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.compute.manager [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-unplugged-389d5d9e-e5fc-48f1-b443-b04d08ec6181 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] Acquiring lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.compute.manager [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] No waiting events found dispatching network-vif-unplugged-389d5d9e-e5fc-48f1-b443-b04d08ec6181 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.compute.manager [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-unplugged-389d5d9e-e5fc-48f1-b443-b04d08ec6181 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.compute.manager [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-plugged-389d5d9e-e5fc-48f1-b443-b04d08ec6181 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] Acquiring lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.compute.manager [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] No waiting events found dispatching network-vif-plugged-389d5d9e-e5fc-48f1-b443-b04d08ec6181 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:31:20 user nova-compute[71321]: WARNING nova.compute.manager [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received unexpected event network-vif-plugged-389d5d9e-e5fc-48f1-b443-b04d08ec6181 for instance with vm_state active and task_state deleting.
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.compute.manager [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-unplugged-e9757213-2bc0-46a5-bffa-3b503c65ecc2 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] Acquiring lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.compute.manager [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] No waiting events found dispatching network-vif-unplugged-e9757213-2bc0-46a5-bffa-3b503c65ecc2 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.compute.manager [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-unplugged-e9757213-2bc0-46a5-bffa-3b503c65ecc2 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.compute.manager [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-plugged-e9757213-2bc0-46a5-bffa-3b503c65ecc2 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] Acquiring lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.compute.manager [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] No waiting events found dispatching network-vif-plugged-e9757213-2bc0-46a5-bffa-3b503c65ecc2 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:31:20 user nova-compute[71321]: WARNING nova.compute.manager [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received unexpected event network-vif-plugged-e9757213-2bc0-46a5-bffa-3b503c65ecc2 for instance with vm_state active and task_state deleting.
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1658eff5-4eaa-476a-bad6-56999e563ffb]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc, portal: 172.16.0.220,3260]
Apr 12 12:31:20 user nova-compute[71321]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc, portal: 172.16.0.220,3260] successful.
Apr 12 12:31:20 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:20 user nova-compute[71321]: DEBUG nova.objects.instance [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lazy-loading 'flavor' on Instance uuid 540a69c0-488f-40cb-bdde-3e410029d4c8 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdc2a45-4990-4625-810e-c2200b107d98]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] <== disconnect_volume: return (342ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgiGFVof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:31:21 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10b316b-0c67-4442-9eea-78bae5316b60]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:31:21 user nova-compute[71321]: No targets found.
Apr 12 12:31:21 user nova-compute[71321]: iSNS:
Apr 12 12:31:21 user nova-compute[71321]: No targets found.
Apr 12 12:31:21 user nova-compute[71321]: STATIC:
Apr 12 12:31:21 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569
Apr 12 12:31:21 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:31:21 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:31:21 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24
Apr 12 12:31:21 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:31:21 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:31:21 user nova-compute[71321]: FIRMWARE:
Apr 12 12:31:21 user nova-compute[71321]: No targets found.
Apr 12 12:31:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:31:21 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:31:21 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "540a69c0-488f-40cb-bdde-3e410029d4c8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.071s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db27286-712b-4dff-b821-658b715826d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a536dcdb-0965-45e2-9cf1-e757cfb3d3b7]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:31:21 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:31:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 (non-flash)
Apr 12 12:31:21 user nova-compute[71321]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:31:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef8a06f250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569'): ({'sdd'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Removing single pathed devices sdd {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG nova.compute.manager [req-9ff01ed6-4278-4f59-b47a-e06c9c19400f req-2d29326e-3307-4b81-af87-61441d4f60e2 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-plugged-c698ebb6-016a-4988-8c8a-7a75252a7944 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9ff01ed6-4278-4f59-b47a-e06c9c19400f req-2d29326e-3307-4b81-af87-61441d4f60e2 service nova] Acquiring lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9ff01ed6-4278-4f59-b47a-e06c9c19400f req-2d29326e-3307-4b81-af87-61441d4f60e2 service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9ff01ed6-4278-4f59-b47a-e06c9c19400f req-2d29326e-3307-4b81-af87-61441d4f60e2 service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG nova.compute.manager [req-9ff01ed6-4278-4f59-b47a-e06c9c19400f req-2d29326e-3307-4b81-af87-61441d4f60e2 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] No waiting events found dispatching network-vif-plugged-c698ebb6-016a-4988-8c8a-7a75252a7944 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:31:21 user nova-compute[71321]: WARNING nova.compute.manager [req-9ff01ed6-4278-4f59-b47a-e06c9c19400f req-2d29326e-3307-4b81-af87-61441d4f60e2 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received unexpected event network-vif-plugged-c698ebb6-016a-4988-8c8a-7a75252a7944 for instance with vm_state active and task_state deleting.
Apr 12 12:31:21 user nova-compute[71321]: DEBUG nova.compute.manager [req-9ff01ed6-4278-4f59-b47a-e06c9c19400f req-2d29326e-3307-4b81-af87-61441d4f60e2 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-unplugged-bb10902a-003e-4c1a-85a8-194f040a1ffb {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9ff01ed6-4278-4f59-b47a-e06c9c19400f req-2d29326e-3307-4b81-af87-61441d4f60e2 service nova] Acquiring lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9ff01ed6-4278-4f59-b47a-e06c9c19400f req-2d29326e-3307-4b81-af87-61441d4f60e2 service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9ff01ed6-4278-4f59-b47a-e06c9c19400f req-2d29326e-3307-4b81-af87-61441d4f60e2 service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG nova.compute.manager [req-9ff01ed6-4278-4f59-b47a-e06c9c19400f req-2d29326e-3307-4b81-af87-61441d4f60e2 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] No waiting events found dispatching network-vif-unplugged-bb10902a-003e-4c1a-85a8-194f040a1ffb {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG nova.compute.manager [req-9ff01ed6-4278-4f59-b47a-e06c9c19400f req-2d29326e-3307-4b81-af87-61441d4f60e2 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-unplugged-bb10902a-003e-4c1a-85a8-194f040a1ffb for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG nova.compute.manager [req-9ff01ed6-4278-4f59-b47a-e06c9c19400f req-2d29326e-3307-4b81-af87-61441d4f60e2 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-plugged-bb10902a-003e-4c1a-85a8-194f040a1ffb {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9ff01ed6-4278-4f59-b47a-e06c9c19400f req-2d29326e-3307-4b81-af87-61441d4f60e2 service nova] Acquiring lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9ff01ed6-4278-4f59-b47a-e06c9c19400f req-2d29326e-3307-4b81-af87-61441d4f60e2 service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9ff01ed6-4278-4f59-b47a-e06c9c19400f req-2d29326e-3307-4b81-af87-61441d4f60e2 service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG nova.compute.manager [req-9ff01ed6-4278-4f59-b47a-e06c9c19400f req-2d29326e-3307-4b81-af87-61441d4f60e2 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] No waiting events found dispatching network-vif-plugged-bb10902a-003e-4c1a-85a8-194f040a1ffb {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:31:21 user nova-compute[71321]: WARNING nova.compute.manager [req-9ff01ed6-4278-4f59-b47a-e06c9c19400f req-2d29326e-3307-4b81-af87-61441d4f60e2 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received unexpected event network-vif-plugged-bb10902a-003e-4c1a-85a8-194f040a1ffb for instance with vm_state active and task_state deleting.
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55b9645-5060-47e8-8e50-dda1ecd73066]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9598804-5929-456f-b4f4-f5b5521831ee]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Flushing IO for device /dev/sdd {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[515ed16f-793b-4d08-a24b-a151fc01fc12]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced08d64-39f3-405c-af63-bbdb517c5471]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] SCSI volumes sdd have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[27896668-538b-4595-9499-f6ffd27b9858]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a648fd18-6073-4b8d-acc4-0257ccf5771f]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569, portal: 172.16.0.220,3260]
Apr 12 12:31:21 user nova-compute[71321]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569, portal: 172.16.0.220,3260] successful.
Apr 12 12:31:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0cc7840-90f7-4311-8c15-78c644bad569 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f51dcff-53f8-4786-a7a8-d2001ad92335]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] <== disconnect_volume: return (292ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YzRkoMvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:31:21 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4c2d0f-2137-48d5-9382-a1399ceb5516]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:31:21 user nova-compute[71321]: No targets found.
Apr 12 12:31:21 user nova-compute[71321]: iSNS:
Apr 12 12:31:21 user nova-compute[71321]: No targets found.
Apr 12 12:31:21 user nova-compute[71321]: STATIC:
Apr 12 12:31:21 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24
Apr 12 12:31:21 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:31:21 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:31:21 user nova-compute[71321]: FIRMWARE:
Apr 12 12:31:21 user nova-compute[71321]: No targets found.
Apr 12 12:31:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:31:21 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:31:21 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1c8355-fed7-401b-8080-16e25af92f1c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e44cd7-f849-4433-a619-8c65413522bb]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:31:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 (non-flash)
Apr 12 12:31:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef8a009d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24'): ({'sde'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Removing single pathed devices sde {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[197eca84-8024-4ce2-a43e-0c906555156e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a25ff8-5b80-4f1c-a94d-53afc5c02d90]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Flushing IO for device /dev/sde {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG nova.compute.manager [req-098ac6bf-fd4e-4e4a-9891-dad33da7691d req-fb995cf2-8518-4ef6-b8ca-ef2808f96217 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-plugged-bf6a7707-9d55-46b2-8738-06505013048b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-098ac6bf-fd4e-4e4a-9891-dad33da7691d req-fb995cf2-8518-4ef6-b8ca-ef2808f96217 service nova] Acquiring lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-098ac6bf-fd4e-4e4a-9891-dad33da7691d req-fb995cf2-8518-4ef6-b8ca-ef2808f96217 service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-098ac6bf-fd4e-4e4a-9891-dad33da7691d req-fb995cf2-8518-4ef6-b8ca-ef2808f96217 service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG nova.compute.manager [req-098ac6bf-fd4e-4e4a-9891-dad33da7691d req-fb995cf2-8518-4ef6-b8ca-ef2808f96217 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] No waiting events found dispatching network-vif-plugged-bf6a7707-9d55-46b2-8738-06505013048b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:31:21 user nova-compute[71321]: WARNING nova.compute.manager [req-098ac6bf-fd4e-4e4a-9891-dad33da7691d req-fb995cf2-8518-4ef6-b8ca-ef2808f96217 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received unexpected event network-vif-plugged-bf6a7707-9d55-46b2-8738-06505013048b for instance with vm_state active and task_state deleting.
Apr 12 12:31:21 user nova-compute[71321]: DEBUG nova.compute.manager [req-098ac6bf-fd4e-4e4a-9891-dad33da7691d req-fb995cf2-8518-4ef6-b8ca-ef2808f96217 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-unplugged-6f2ec393-bb3c-4986-bd50-44ae9a7147b0 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-098ac6bf-fd4e-4e4a-9891-dad33da7691d req-fb995cf2-8518-4ef6-b8ca-ef2808f96217 service nova] Acquiring lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-098ac6bf-fd4e-4e4a-9891-dad33da7691d req-fb995cf2-8518-4ef6-b8ca-ef2808f96217 service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-098ac6bf-fd4e-4e4a-9891-dad33da7691d req-fb995cf2-8518-4ef6-b8ca-ef2808f96217 service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG nova.compute.manager [req-098ac6bf-fd4e-4e4a-9891-dad33da7691d req-fb995cf2-8518-4ef6-b8ca-ef2808f96217 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] No waiting events found dispatching network-vif-unplugged-6f2ec393-bb3c-4986-bd50-44ae9a7147b0 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG nova.compute.manager [req-098ac6bf-fd4e-4e4a-9891-dad33da7691d req-fb995cf2-8518-4ef6-b8ca-ef2808f96217 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-unplugged-6f2ec393-bb3c-4986-bd50-44ae9a7147b0 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG nova.compute.manager [req-098ac6bf-fd4e-4e4a-9891-dad33da7691d req-fb995cf2-8518-4ef6-b8ca-ef2808f96217 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-plugged-6f2ec393-bb3c-4986-bd50-44ae9a7147b0 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-098ac6bf-fd4e-4e4a-9891-dad33da7691d req-fb995cf2-8518-4ef6-b8ca-ef2808f96217 service nova] Acquiring lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-098ac6bf-fd4e-4e4a-9891-dad33da7691d req-fb995cf2-8518-4ef6-b8ca-ef2808f96217 service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-098ac6bf-fd4e-4e4a-9891-dad33da7691d req-fb995cf2-8518-4ef6-b8ca-ef2808f96217 service nova] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG nova.compute.manager [req-098ac6bf-fd4e-4e4a-9891-dad33da7691d req-fb995cf2-8518-4ef6-b8ca-ef2808f96217 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] No waiting events found dispatching network-vif-plugged-6f2ec393-bb3c-4986-bd50-44ae9a7147b0 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:31:21 user nova-compute[71321]: WARNING nova.compute.manager [req-098ac6bf-fd4e-4e4a-9891-dad33da7691d req-fb995cf2-8518-4ef6-b8ca-ef2808f96217 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received unexpected event network-vif-plugged-6f2ec393-bb3c-4986-bd50-44ae9a7147b0 for instance with vm_state active and task_state deleting.
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b964211-b0a5-42ee-a132-ecea6171b7cb]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.032s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dd9e10-3427-4353-b8e4-2f14685f7e45]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] SCSI volumes sde have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b08fd7a-2037-435a-ac62-6783405165bf]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90076be-7190-4f03-9d98-cfbe97605251]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24, portal: 172.16.0.220,3260]
Apr 12 12:31:21 user nova-compute[71321]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24, portal: 172.16.0.220,3260] successful.
Apr 12 12:31:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03750d10-be51-41e7-8ffe-78d0af572b24 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9976e894-2830-46a2-bc73-5dbc8aa5dc82]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] <== disconnect_volume: return (318ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:31:21 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Deleting instance files /opt/stack/data/nova/instances/d8867363-6e36-4b34-9cc1-f30fbc572720_del
Apr 12 12:31:21 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Deletion of /opt/stack/data/nova/instances/d8867363-6e36-4b34-9cc1-f30fbc572720_del complete
Apr 12 12:31:21 user nova-compute[71321]: INFO nova.compute.manager [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Took 3.18 seconds to destroy the instance on the hypervisor.
Apr 12 12:31:21 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:31:21 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:31:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "651d5c05-2d02-450f-a33c-fbd9b3109016" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "651d5c05-2d02-450f-a33c-fbd9b3109016" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:22 user nova-compute[71321]: DEBUG nova.objects.instance [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lazy-loading 'flavor' on Instance uuid 651d5c05-2d02-450f-a33c-fbd9b3109016 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:31:22 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Ignoring supplied device name: /dev/vdb
Apr 12 12:31:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "651d5c05-2d02-450f-a33c-fbd9b3109016" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "651d5c05-2d02-450f-a33c-fbd9b3109016" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "651d5c05-2d02-450f-a33c-fbd9b3109016" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:22 user nova-compute[71321]: INFO nova.compute.manager [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Attaching volume f2314b64-00af-4289-aef2-e4adeec9da1f to /dev/vdb
Apr 12 12:31:22 user nova-compute[71321]: DEBUG os_brick.utils [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:31:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:22 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb89e83-5e0c-4bab-9534-bbbc4b13b341]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:22 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[866dad96-ddb1-4064-9828-da0177118e10]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:22 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ffcacc-651e-4740-9797-2dfd73b03aa3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:22 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3409e0-20ee-429e-8887-8311c3c8f530]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:31:22 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:31:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:31:22 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:31:22 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[31089e4c-10fa-43fe-a0e4-81ffdb4635d0]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:22 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:31:22 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:31:22 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:31:22 user nova-compute[71321]: DEBUG os_brick.utils [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:31:22 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Updating existing volume attachment record: b0313269-4d41-4339-b94e-f068bdb9d174 {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:31:23 user nova-compute[71321]: DEBUG nova.compute.manager [req-4ce9467e-029f-4f88-beca-c91b71dde896 req-a3e38f33-b584-4c74-beab-6d8d6bb69905 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-deleted-6f2ec393-bb3c-4986-bd50-44ae9a7147b0 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:23 user nova-compute[71321]: INFO nova.compute.manager [req-4ce9467e-029f-4f88-beca-c91b71dde896 req-a3e38f33-b584-4c74-beab-6d8d6bb69905 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Neutron deleted interface 6f2ec393-bb3c-4986-bd50-44ae9a7147b0; detaching it from the instance and deleting it from the info cache
Apr 12 12:31:23 user nova-compute[71321]: DEBUG nova.network.neutron [req-4ce9467e-029f-4f88-beca-c91b71dde896 req-a3e38f33-b584-4c74-beab-6d8d6bb69905 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Updating instance_info_cache with network_info: [{"id": "93bb6ab6-63a2-421a-b331-92c957f29f5a", "address": "fa:16:3e:79:39:dc", "network": {"id": "200ada24-4b99-42e5-9085-07900a59a716", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1440676334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bb6ab6-63", "ovs_interfaceid": "93bb6ab6-63a2-421a-b331-92c957f29f5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c698ebb6-016a-4988-8c8a-7a75252a7944", "address": "fa:16:3e:c8:f3:a6", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc698ebb6-01", "ovs_interfaceid": "c698ebb6-016a-4988-8c8a-7a75252a7944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bb10902a-003e-4c1a-85a8-194f040a1ffb", "address": "fa:16:3e:36:6f:30", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb10902a-00", "ovs_interfaceid": "bb10902a-003e-4c1a-85a8-194f040a1ffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "389d5d9e-e5fc-48f1-b443-b04d08ec6181", "address": "fa:16:3e:9e:00:f4", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap389d5d9e-e5", "ovs_interfaceid": "389d5d9e-e5fc-48f1-b443-b04d08ec6181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf6a7707-9d55-46b2-8738-06505013048b", "address": "fa:16:3e:be:d3:4b", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6a7707-9d", "ovs_interfaceid": "bf6a7707-9d55-46b2-8738-06505013048b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9757213-2bc0-46a5-bffa-3b503c65ecc2", "address": "fa:16:3e:03:d8:98", "network": {"id": "f67d6710-fe9f-4d97-935e-535e0202f0ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048697198", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9757213-2b", "ovs_interfaceid": "e9757213-2bc0-46a5-bffa-3b503c65ecc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:31:23 user nova-compute[71321]: DEBUG nova.compute.manager [req-4ce9467e-029f-4f88-beca-c91b71dde896 req-a3e38f33-b584-4c74-beab-6d8d6bb69905 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Detach interface failed, port_id=6f2ec393-bb3c-4986-bd50-44ae9a7147b0, reason: Instance d8867363-6e36-4b34-9cc1-f30fbc572720 could not be found. {{(pid=71321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 12:31:24 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:25 user nova-compute[71321]: DEBUG nova.compute.manager [req-f8114151-65fb-4844-875a-9c28a0268d26 req-35778702-0a63-44e7-9dd9-566853ebd5e4 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-deleted-bf6a7707-9d55-46b2-8738-06505013048b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:25 user nova-compute[71321]: INFO nova.compute.manager [req-f8114151-65fb-4844-875a-9c28a0268d26 req-35778702-0a63-44e7-9dd9-566853ebd5e4 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Neutron deleted interface bf6a7707-9d55-46b2-8738-06505013048b; detaching it from the instance and deleting it from the info cache
Apr 12 12:31:25 user nova-compute[71321]: DEBUG nova.network.neutron [req-f8114151-65fb-4844-875a-9c28a0268d26 req-35778702-0a63-44e7-9dd9-566853ebd5e4 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Updating instance_info_cache with network_info: [{"id": "93bb6ab6-63a2-421a-b331-92c957f29f5a", "address": "fa:16:3e:79:39:dc", "network": {"id": "200ada24-4b99-42e5-9085-07900a59a716", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1440676334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bb6ab6-63", "ovs_interfaceid": "93bb6ab6-63a2-421a-b331-92c957f29f5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c698ebb6-016a-4988-8c8a-7a75252a7944", "address": "fa:16:3e:c8:f3:a6", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc698ebb6-01", "ovs_interfaceid": "c698ebb6-016a-4988-8c8a-7a75252a7944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bb10902a-003e-4c1a-85a8-194f040a1ffb", "address": "fa:16:3e:36:6f:30", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb10902a-00", "ovs_interfaceid": "bb10902a-003e-4c1a-85a8-194f040a1ffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "389d5d9e-e5fc-48f1-b443-b04d08ec6181", "address": "fa:16:3e:9e:00:f4", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap389d5d9e-e5", "ovs_interfaceid": "389d5d9e-e5fc-48f1-b443-b04d08ec6181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9757213-2bc0-46a5-bffa-3b503c65ecc2", "address": "fa:16:3e:03:d8:98", "network": {"id": "f67d6710-fe9f-4d97-935e-535e0202f0ae", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048697198", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9757213-2b", "ovs_interfaceid": "e9757213-2bc0-46a5-bffa-3b503c65ecc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:31:25 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:31:25 user nova-compute[71321]: DEBUG nova.compute.manager [req-f8114151-65fb-4844-875a-9c28a0268d26 req-35778702-0a63-44e7-9dd9-566853ebd5e4 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Detach interface failed, port_id=bf6a7707-9d55-46b2-8738-06505013048b, reason: Instance d8867363-6e36-4b34-9cc1-f30fbc572720 could not be found. {{(pid=71321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 12:31:25 user nova-compute[71321]: DEBUG nova.compute.manager [req-f8114151-65fb-4844-875a-9c28a0268d26 req-35778702-0a63-44e7-9dd9-566853ebd5e4 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-deleted-e9757213-2bc0-46a5-bffa-3b503c65ecc2 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:25 user nova-compute[71321]: INFO nova.compute.manager [req-f8114151-65fb-4844-875a-9c28a0268d26 req-35778702-0a63-44e7-9dd9-566853ebd5e4 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Neutron deleted interface e9757213-2bc0-46a5-bffa-3b503c65ecc2; detaching it from the instance and deleting it from the info cache
Apr 12 12:31:25 user nova-compute[71321]: DEBUG nova.network.neutron [req-f8114151-65fb-4844-875a-9c28a0268d26 req-35778702-0a63-44e7-9dd9-566853ebd5e4 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Updating instance_info_cache with network_info: [{"id": "93bb6ab6-63a2-421a-b331-92c957f29f5a", "address": "fa:16:3e:79:39:dc", "network": {"id": "200ada24-4b99-42e5-9085-07900a59a716", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1440676334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bb6ab6-63", "ovs_interfaceid": "93bb6ab6-63a2-421a-b331-92c957f29f5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c698ebb6-016a-4988-8c8a-7a75252a7944", "address": "fa:16:3e:c8:f3:a6", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc698ebb6-01", "ovs_interfaceid": "c698ebb6-016a-4988-8c8a-7a75252a7944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bb10902a-003e-4c1a-85a8-194f040a1ffb", "address": "fa:16:3e:36:6f:30", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb10902a-00", "ovs_interfaceid": "bb10902a-003e-4c1a-85a8-194f040a1ffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "389d5d9e-e5fc-48f1-b443-b04d08ec6181", "address": "fa:16:3e:9e:00:f4", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap389d5d9e-e5", "ovs_interfaceid": "389d5d9e-e5fc-48f1-b443-b04d08ec6181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:31:25 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Took 4.06 seconds to deallocate network for instance.
Apr 12 12:31:25 user nova-compute[71321]: DEBUG nova.compute.manager [req-f8114151-65fb-4844-875a-9c28a0268d26 req-35778702-0a63-44e7-9dd9-566853ebd5e4 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Detach interface failed, port_id=e9757213-2bc0-46a5-bffa-3b503c65ecc2, reason: Instance d8867363-6e36-4b34-9cc1-f30fbc572720 could not be found. {{(pid=71321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 12:31:25 user nova-compute[71321]: DEBUG nova.compute.manager [req-f8114151-65fb-4844-875a-9c28a0268d26 req-35778702-0a63-44e7-9dd9-566853ebd5e4 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-deleted-389d5d9e-e5fc-48f1-b443-b04d08ec6181 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:25 user nova-compute[71321]: INFO nova.compute.manager [req-f8114151-65fb-4844-875a-9c28a0268d26 req-35778702-0a63-44e7-9dd9-566853ebd5e4 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Neutron deleted interface 389d5d9e-e5fc-48f1-b443-b04d08ec6181; detaching it from the instance and deleting it from the info cache
Apr 12 12:31:25 user nova-compute[71321]: DEBUG nova.network.neutron [req-f8114151-65fb-4844-875a-9c28a0268d26 req-35778702-0a63-44e7-9dd9-566853ebd5e4 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Updating instance_info_cache with network_info: [{"id": "93bb6ab6-63a2-421a-b331-92c957f29f5a", "address": "fa:16:3e:79:39:dc", "network": {"id": "200ada24-4b99-42e5-9085-07900a59a716", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1440676334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bb6ab6-63", "ovs_interfaceid": "93bb6ab6-63a2-421a-b331-92c957f29f5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c698ebb6-016a-4988-8c8a-7a75252a7944", "address": "fa:16:3e:c8:f3:a6", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc698ebb6-01", "ovs_interfaceid": "c698ebb6-016a-4988-8c8a-7a75252a7944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bb10902a-003e-4c1a-85a8-194f040a1ffb", "address": "fa:16:3e:36:6f:30", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb10902a-00", "ovs_interfaceid": "bb10902a-003e-4c1a-85a8-194f040a1ffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:31:25 user nova-compute[71321]: DEBUG nova.compute.manager [req-f8114151-65fb-4844-875a-9c28a0268d26 req-35778702-0a63-44e7-9dd9-566853ebd5e4 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Detach interface failed, port_id=389d5d9e-e5fc-48f1-b443-b04d08ec6181, reason: Instance d8867363-6e36-4b34-9cc1-f30fbc572720 could not be found. {{(pid=71321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jFgDoGbH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:31:27 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:31:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:31:27 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:31:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:31:27 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:31:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG nova.compute.manager [req-50945227-a530-475e-b8d6-37f4c28dd86f req-c0708569-c610-408b-abea-4173d26f1e07 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Received event network-vif-deleted-93bb6ab6-63a2-421a-b331-92c957f29f5a {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:27 user nova-compute[71321]: INFO nova.compute.manager [req-50945227-a530-475e-b8d6-37f4c28dd86f req-c0708569-c610-408b-abea-4173d26f1e07 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Neutron deleted interface 93bb6ab6-63a2-421a-b331-92c957f29f5a; detaching it from the instance and deleting it from the info cache
Apr 12 12:31:27 user nova-compute[71321]: DEBUG nova.network.neutron [req-50945227-a530-475e-b8d6-37f4c28dd86f req-c0708569-c610-408b-abea-4173d26f1e07 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Updating instance_info_cache with network_info: [{"id": "c698ebb6-016a-4988-8c8a-7a75252a7944", "address": "fa:16:3e:c8:f3:a6", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc698ebb6-01", "ovs_interfaceid": "c698ebb6-016a-4988-8c8a-7a75252a7944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bb10902a-003e-4c1a-85a8-194f040a1ffb", "address": "fa:16:3e:36:6f:30", "network": {"id": "623863b1-0de3-49d4-b240-59885c22eb51", "bridge": "br-int", "label": "tempest-device-tagging-net1-651061711", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed98064a134b4603bbf641f45988564a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb10902a-00", "ovs_interfaceid": "bb10902a-003e-4c1a-85a8-194f040a1ffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fa9c63-2026-42c2-84f4-753c963a09d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:31:27 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06a31f8-d13f-4f2f-8b09-53983c829788]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f] added
Apr 12 12:31:27 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG nova.compute.manager [req-50945227-a530-475e-b8d6-37f4c28dd86f req-c0708569-c610-408b-abea-4173d26f1e07 service nova] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Detach interface failed, port_id=93bb6ab6-63a2-421a-b331-92c957f29f5a, reason: Instance d8867363-6e36-4b34-9cc1-f30fbc572720 could not be found. {{(pid=71321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8738470c-d53a-40ff-8f32-eac19e426f17]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7691c42-ba1a-4b0c-af40-953a0268bcd3]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jFgDoGbH {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jFgDoGbH" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fb2717-8816-4d04-9fe4-e822915a092b]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jFgDoGbH'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1afe5d-085b-4dca-ae77-f6051889dfbb]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d310657-a8d7-499f-98e0-d9e6309b7e49]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 12:31:27 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 12:31:27 user nova-compute[71321]:  {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:31:27 user nova-compute[71321]: WARNING os_brick.initiator.connectors.iscsi [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 12:31:27 user nova-compute[71321]: 
Apr 12 12:31:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b5e34b-c437-45a5-aa24-674c7ea4d6b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f, portal: 172.16.0.220,3260]
Apr 12 12:31:27 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f, portal: 172.16.0.220,3260] successful.
Apr 12 12:31:27 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefb3d57-0bd9-40a1-bfa2-b7a08fcb79ae]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca7b041-7dff-4818-9840-c79300488158]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f (non-flash)
Apr 12 12:31:27 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f (non-flash)
Apr 12 12:31:27 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:28 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee49791-56fb-4d5c-88fa-d580d3f8135d]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:28 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:31:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jFgDoGbH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:31:28 user nova-compute[71321]: INFO nova.compute.manager [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Took 2.62 seconds to detach 3 volumes for instance.
Apr 12 12:31:28 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:28 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:28 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:31:28 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:31:28 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:28 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Deleted allocations for instance d8867363-6e36-4b34-9cc1-f30fbc572720
Apr 12 12:31:28 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "d8867363-6e36-4b34-9cc1-f30fbc572720" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.390s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:29 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:31:29 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23361373564386438', 'path': '/dev/sdb'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:31:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361373564386438', 'path': '/dev/sdb'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:31:29 user nova-compute[71321]: DEBUG nova.objects.instance [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lazy-loading 'flavor' on Instance uuid 651d5c05-2d02-450f-a33c-fbd9b3109016 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:31:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 12:31:29 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:31:29 user nova-compute[71321]:   <source dev="/dev/sdb"/>
Apr 12 12:31:29 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:31:29 user nova-compute[71321]:   <serial>f2314b64-00af-4289-aef2-e4adeec9da1f</serial>
Apr 12 12:31:29 user nova-compute[71321]: </disk>
Apr 12 12:31:29 user nova-compute[71321]:  {{(pid=71321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 12:31:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:31:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:31:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] No VIF found with MAC fa:16:3e:a8:ae:95, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:31:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "651d5c05-2d02-450f-a33c-fbd9b3109016" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.979s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:35 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681302680.2450268, d8867363-6e36-4b34-9cc1-f30fbc572720 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:31:35 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] VM Stopped (Lifecycle Event)
Apr 12 12:31:35 user nova-compute[71321]: DEBUG nova.compute.manager [None req-5e45b137-ceef-48de-8c52-2300d8600f05 None None] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:31:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "651d5c05-2d02-450f-a33c-fbd9b3109016" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "651d5c05-2d02-450f-a33c-fbd9b3109016" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:44 user nova-compute[71321]: INFO nova.compute.manager [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Detaching volume f2314b64-00af-4289-aef2-e4adeec9da1f
Apr 12 12:31:44 user nova-compute[71321]: INFO nova.virt.block_device [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Attempting to driver detach volume f2314b64-00af-4289-aef2-e4adeec9da1f from mountpoint /dev/vdb
Apr 12 12:31:44 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Attempting to detach device vdb from instance 651d5c05-2d02-450f-a33c-fbd9b3109016 from the persistent domain config. {{(pid=71321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:31:44 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:31:44 user nova-compute[71321]:   <source dev="/dev/sdb"/>
Apr 12 12:31:44 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:31:44 user nova-compute[71321]:   <serial>f2314b64-00af-4289-aef2-e4adeec9da1f</serial>
Apr 12 12:31:44 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 12:31:44 user nova-compute[71321]: </disk>
Apr 12 12:31:44 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "651d5c05-2d02-450f-a33c-fbd9b3109016" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:44 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Successfully detached device vdb from instance 651d5c05-2d02-450f-a33c-fbd9b3109016 from the persistent domain config.
Apr 12 12:31:44 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 651d5c05-2d02-450f-a33c-fbd9b3109016 from the live domain config. {{(pid=71321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:31:44 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:31:44 user nova-compute[71321]:   <source dev="/dev/sdb"/>
Apr 12 12:31:44 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:31:44 user nova-compute[71321]:   <serial>f2314b64-00af-4289-aef2-e4adeec9da1f</serial>
Apr 12 12:31:44 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 12:31:44 user nova-compute[71321]: </disk>
Apr 12 12:31:44 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Received event <DeviceRemovedEvent: 1681302704.6538308, 651d5c05-2d02-450f-a33c-fbd9b3109016 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 651d5c05-2d02-450f-a33c-fbd9b3109016 {{(pid=71321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 12:31:44 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Successfully detached device vdb from instance 651d5c05-2d02-450f-a33c-fbd9b3109016 from the live domain config.
Apr 12 12:31:44 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jFgDoGbH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:31:44 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:31:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbc85af-72ee-4b9f-8649-bcc73b8351a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:31:44 user nova-compute[71321]: No targets found.
Apr 12 12:31:44 user nova-compute[71321]: iSNS:
Apr 12 12:31:44 user nova-compute[71321]: No targets found.
Apr 12 12:31:44 user nova-compute[71321]: STATIC:
Apr 12 12:31:44 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f
Apr 12 12:31:44 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:31:44 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:31:44 user nova-compute[71321]: FIRMWARE:
Apr 12 12:31:44 user nova-compute[71321]: No targets found.
Apr 12 12:31:44 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:31:44 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:31:44 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[46173fc6-2959-4ffe-9785-41c5dc92da15]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a16de1a-7707-4e3d-95ba-94c922884088]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f (non-flash)
Apr 12 12:31:44 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f (non-flash)
Apr 12 12:31:44 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef8a06f490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f'): ({'sdb'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Removing single pathed devices sdb {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f61c60d-14d9-4a6a-b164-4368115c06b1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eca1a22-84c7-4455-af3c-ea7e711af120]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Flushing IO for device /dev/sdb {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbc57f3-b595-4052-8d89-dfd90425dd6a]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f3f982-c950-4da8-87ee-da889b23481b]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] SCSI volumes sdb have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc23b9d-d78e-4aed-a1ba-8019c618628d]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ff200e-5f37-49e9-8e2a-ccf5523fd89b]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f, portal: 172.16.0.220,3260]
Apr 12 12:31:44 user nova-compute[71321]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f, portal: 172.16.0.220,3260] successful.
Apr 12 12:31:44 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9694d1-90b5-47dd-acfd-e469d760fe91]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] <== disconnect_volume: return (309ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:31:44 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:31:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:45 user nova-compute[71321]: DEBUG nova.objects.instance [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lazy-loading 'flavor' on Instance uuid 651d5c05-2d02-450f-a33c-fbd9b3109016 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:31:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "651d5c05-2d02-450f-a33c-fbd9b3109016" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.744s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "651d5c05-2d02-450f-a33c-fbd9b3109016" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.604s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "651d5c05-2d02-450f-a33c-fbd9b3109016-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "651d5c05-2d02-450f-a33c-fbd9b3109016-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "651d5c05-2d02-450f-a33c-fbd9b3109016-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:45 user nova-compute[71321]: INFO nova.compute.manager [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Terminating instance
Apr 12 12:31:45 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:31:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:46 user nova-compute[71321]: DEBUG nova.compute.manager [req-17fea41d-ffc2-455d-a0e6-c6a814ffe9ac req-ec57337d-aabd-4a36-9fd4-e2e83281b311 service nova] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Received event network-vif-unplugged-b8a991df-6886-4036-a382-49898be6fd25 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-17fea41d-ffc2-455d-a0e6-c6a814ffe9ac req-ec57337d-aabd-4a36-9fd4-e2e83281b311 service nova] Acquiring lock "651d5c05-2d02-450f-a33c-fbd9b3109016-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-17fea41d-ffc2-455d-a0e6-c6a814ffe9ac req-ec57337d-aabd-4a36-9fd4-e2e83281b311 service nova] Lock "651d5c05-2d02-450f-a33c-fbd9b3109016-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-17fea41d-ffc2-455d-a0e6-c6a814ffe9ac req-ec57337d-aabd-4a36-9fd4-e2e83281b311 service nova] Lock "651d5c05-2d02-450f-a33c-fbd9b3109016-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:46 user nova-compute[71321]: DEBUG nova.compute.manager [req-17fea41d-ffc2-455d-a0e6-c6a814ffe9ac req-ec57337d-aabd-4a36-9fd4-e2e83281b311 service nova] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] No waiting events found dispatching network-vif-unplugged-b8a991df-6886-4036-a382-49898be6fd25 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:31:46 user nova-compute[71321]: DEBUG nova.compute.manager [req-17fea41d-ffc2-455d-a0e6-c6a814ffe9ac req-ec57337d-aabd-4a36-9fd4-e2e83281b311 service nova] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Received event network-vif-unplugged-b8a991df-6886-4036-a382-49898be6fd25 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:31:46 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Instance destroyed successfully.
Apr 12 12:31:46 user nova-compute[71321]: DEBUG nova.objects.instance [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lazy-loading 'resources' on Instance uuid 651d5c05-2d02-450f-a33c-fbd9b3109016 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:31:46 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:29:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1300903891',display_name='tempest-VolumesSnapshotTestJSON-instance-1300903891',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1300903891',id=11,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:29:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='466d2a494cf64002a98588909bdcd197',ramdisk_id='',reservation_id='r-ujhsdp9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-760244133',owner_user_name='tempest-VolumesSnapshotTestJSON-760244133-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:29:42Z,user_data=None,user_id='35727e3b48da4494808015e2b630a3f9',uuid=651d5c05-2d02-450f-a33c-fbd9b3109016,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8a991df-6886-4036-a382-49898be6fd25", "address": "fa:16:3e:a8:ae:95", "network": {"id": "0fcb9046-707e-462c-937c-3ba5aebe64e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-529948515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "466d2a494cf64002a98588909bdcd197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a991df-68", "ovs_interfaceid": "b8a991df-6886-4036-a382-49898be6fd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:31:46 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Converting VIF {"id": "b8a991df-6886-4036-a382-49898be6fd25", "address": "fa:16:3e:a8:ae:95", "network": {"id": "0fcb9046-707e-462c-937c-3ba5aebe64e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-529948515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "466d2a494cf64002a98588909bdcd197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a991df-68", "ovs_interfaceid": "b8a991df-6886-4036-a382-49898be6fd25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:31:46 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:ae:95,bridge_name='br-int',has_traffic_filtering=True,id=b8a991df-6886-4036-a382-49898be6fd25,network=Network(0fcb9046-707e-462c-937c-3ba5aebe64e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8a991df-68') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:31:46 user nova-compute[71321]: DEBUG os_vif [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:ae:95,bridge_name='br-int',has_traffic_filtering=True,id=b8a991df-6886-4036-a382-49898be6fd25,network=Network(0fcb9046-707e-462c-937c-3ba5aebe64e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8a991df-68') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:31:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8a991df-68, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:31:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:31:46 user nova-compute[71321]: INFO os_vif [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:ae:95,bridge_name='br-int',has_traffic_filtering=True,id=b8a991df-6886-4036-a382-49898be6fd25,network=Network(0fcb9046-707e-462c-937c-3ba5aebe64e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8a991df-68')
Apr 12 12:31:46 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:31:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:f2314b64-00af-4289-aef2-e4adeec9da1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jFgDoGbH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:31:46 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:31:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:31:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:31:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:31:46 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[651197f2-3d0c-403b-9802-8cf968350da0]: Unexpected error while running command.
Apr 12 12:31:46 user nova-compute[71321]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 12 12:31:46 user nova-compute[71321]: Exit code: 21
Apr 12 12:31:46 user nova-compute[71321]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 12 12:31:46 user nova-compute[71321]: Stderr: '' {{(pid=81736) _process_cmd /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:479}}
Apr 12 12:31:46 user nova-compute[71321]: Traceback (most recent call last):
Apr 12 12:31:46 user nova-compute[71321]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Apr 12 12:31:46 user nova-compute[71321]:     ret = func(*f_args, **f_kwargs)
Apr 12 12:31:46 user nova-compute[71321]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Apr 12 12:31:46 user nova-compute[71321]:     return func(*args, **kwargs)
Apr 12 12:31:46 user nova-compute[71321]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Apr 12 12:31:46 user nova-compute[71321]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Apr 12 12:31:46 user nova-compute[71321]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Apr 12 12:31:46 user nova-compute[71321]:     return putils.execute(on_execute=on_execute,
Apr 12 12:31:46 user nova-compute[71321]:   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py", line 438, in execute
Apr 12 12:31:46 user nova-compute[71321]:     raise ProcessExecutionError(exit_code=_returncode,
Apr 12 12:31:46 user nova-compute[71321]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 12 12:31:46 user nova-compute[71321]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 12 12:31:46 user nova-compute[71321]: Exit code: 21
Apr 12 12:31:46 user nova-compute[71321]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 12 12:31:46 user nova-compute[71321]: Stderr: ''
Apr 12 12:31:46 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[651197f2-3d0c-403b-9802-8cf968350da0]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:31:46 user nova-compute[71321]: ERROR os_brick.initiator.connectors.iscsi [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 12 12:31:46 user nova-compute[71321]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 12 12:31:46 user nova-compute[71321]: Exit code: 21
Apr 12 12:31:46 user nova-compute[71321]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 12 12:31:46 user nova-compute[71321]: Stderr: ''
Apr 12 12:31:46 user nova-compute[71321]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Apr 12 12:31:46 user nova-compute[71321]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 206, in _get_ips_iqns_luns
Apr 12 12:31:46 user nova-compute[71321]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Apr 12 12:31:46 user nova-compute[71321]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 365, in _get_discoverydb_portals
Apr 12 12:31:46 user nova-compute[71321]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Apr 12 12:31:46 user nova-compute[71321]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 1177, in _run_iscsiadm_bare
Apr 12 12:31:46 user nova-compute[71321]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Apr 12 12:31:46 user nova-compute[71321]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/executor.py", line 55, in _execute
Apr 12 12:31:46 user nova-compute[71321]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Apr 12 12:31:46 user nova-compute[71321]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Apr 12 12:31:46 user nova-compute[71321]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Apr 12 12:31:46 user nova-compute[71321]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Apr 12 12:31:46 user nova-compute[71321]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Apr 12 12:31:46 user nova-compute[71321]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call
Apr 12 12:31:46 user nova-compute[71321]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Apr 12 12:31:46 user nova-compute[71321]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 12 12:31:46 user nova-compute[71321]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Apr 12 12:31:46 user nova-compute[71321]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Apr 12 12:31:46 user nova-compute[71321]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 12 12:31:46 user nova-compute[71321]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Apr 12 12:31:46 user nova-compute[71321]: ERROR os_brick.initiator.connectors.iscsi 
Apr 12 12:31:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=71321) _cleanup_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:923}}
Apr 12 12:31:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.037s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:31:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] <== disconnect_volume: return (38ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:31:46 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:31:46 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Deleting instance files /opt/stack/data/nova/instances/651d5c05-2d02-450f-a33c-fbd9b3109016_del
Apr 12 12:31:46 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Deletion of /opt/stack/data/nova/instances/651d5c05-2d02-450f-a33c-fbd9b3109016_del complete
Apr 12 12:31:46 user nova-compute[71321]: INFO nova.compute.manager [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 12 12:31:46 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:31:46 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:31:46 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:31:47 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:31:47 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Took 0.46 seconds to deallocate network for instance.
Apr 12 12:31:47 user nova-compute[71321]: DEBUG nova.compute.manager [req-73ac1c48-86f4-49d8-b356-f88f71577f0d req-72166120-ce38-4f36-b98e-0bf952bea4bc service nova] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Received event network-vif-deleted-b8a991df-6886-4036-a382-49898be6fd25 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:47 user nova-compute[71321]: WARNING nova.volume.cinder [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Attachment b0313269-4d41-4339-b94e-f068bdb9d174 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = b0313269-4d41-4339-b94e-f068bdb9d174. (HTTP 404) (Request-ID: req-8418000e-09e9-4967-bf46-9332f49258db)
Apr 12 12:31:47 user nova-compute[71321]: INFO nova.compute.manager [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Took 0.02 seconds to detach 1 volumes for instance.
Apr 12 12:31:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:47 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:31:47 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:31:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.261s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:47 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Deleted allocations for instance 651d5c05-2d02-450f-a33c-fbd9b3109016
Apr 12 12:31:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "651d5c05-2d02-450f-a33c-fbd9b3109016" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.862s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:48 user nova-compute[71321]: DEBUG nova.compute.manager [req-75b93b91-bd7f-4378-94e4-ffdafe59f78c req-2e942903-229c-4c08-9a30-81958348ca91 service nova] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Received event network-vif-plugged-b8a991df-6886-4036-a382-49898be6fd25 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-75b93b91-bd7f-4378-94e4-ffdafe59f78c req-2e942903-229c-4c08-9a30-81958348ca91 service nova] Acquiring lock "651d5c05-2d02-450f-a33c-fbd9b3109016-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-75b93b91-bd7f-4378-94e4-ffdafe59f78c req-2e942903-229c-4c08-9a30-81958348ca91 service nova] Lock "651d5c05-2d02-450f-a33c-fbd9b3109016-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-75b93b91-bd7f-4378-94e4-ffdafe59f78c req-2e942903-229c-4c08-9a30-81958348ca91 service nova] Lock "651d5c05-2d02-450f-a33c-fbd9b3109016-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:48 user nova-compute[71321]: DEBUG nova.compute.manager [req-75b93b91-bd7f-4378-94e4-ffdafe59f78c req-2e942903-229c-4c08-9a30-81958348ca91 service nova] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] No waiting events found dispatching network-vif-plugged-b8a991df-6886-4036-a382-49898be6fd25 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:31:48 user nova-compute[71321]: WARNING nova.compute.manager [req-75b93b91-bd7f-4378-94e4-ffdafe59f78c req-2e942903-229c-4c08-9a30-81958348ca91 service nova] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Received unexpected event network-vif-plugged-b8a991df-6886-4036-a382-49898be6fd25 for instance with vm_state deleted and task_state None.
Apr 12 12:31:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Acquiring lock "49339083-8dd4-454b-b7aa-73d91238bef4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "49339083-8dd4-454b-b7aa-73d91238bef4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:49 user nova-compute[71321]: DEBUG nova.compute.manager [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:31:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:49 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:31:49 user nova-compute[71321]: INFO nova.compute.claims [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Claim successful on node user
Apr 12 12:31:50 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:31:50 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:31:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:50 user nova-compute[71321]: DEBUG nova.compute.manager [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:31:50 user nova-compute[71321]: DEBUG nova.compute.manager [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:31:50 user nova-compute[71321]: DEBUG nova.network.neutron [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:31:50 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:31:50 user nova-compute[71321]: DEBUG nova.compute.manager [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:31:50 user nova-compute[71321]: DEBUG nova.compute.manager [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:31:50 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:31:50 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Creating image(s)
Apr 12 12:31:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Acquiring lock "/opt/stack/data/nova/instances/49339083-8dd4-454b-b7aa-73d91238bef4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "/opt/stack/data/nova/instances/49339083-8dd4-454b-b7aa-73d91238bef4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "/opt/stack/data/nova/instances/49339083-8dd4-454b-b7aa-73d91238bef4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:50 user nova-compute[71321]: DEBUG nova.policy [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ddeb0b1b08ba4cbcb08705c49517f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cc629696bdf4ed2bc9da7e20e8102fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:31:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.140s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.154s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/49339083-8dd4-454b-b7aa-73d91238bef4/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/49339083-8dd4-454b-b7aa-73d91238bef4/disk 1073741824" returned: 0 in 0.058s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.146s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:50 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Checking if we can resize image /opt/stack/data/nova/instances/49339083-8dd4-454b-b7aa-73d91238bef4/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:31:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49339083-8dd4-454b-b7aa-73d91238bef4/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:31:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49339083-8dd4-454b-b7aa-73d91238bef4/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:31:50 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Cannot resize image /opt/stack/data/nova/instances/49339083-8dd4-454b-b7aa-73d91238bef4/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:31:50 user nova-compute[71321]: DEBUG nova.objects.instance [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lazy-loading 'migration_context' on Instance uuid 49339083-8dd4-454b-b7aa-73d91238bef4 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:31:51 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:31:51 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Ensure instance console log exists: /opt/stack/data/nova/instances/49339083-8dd4-454b-b7aa-73d91238bef4/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:31:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:51 user nova-compute[71321]: DEBUG nova.network.neutron [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Successfully created port: c1091e67-edef-41a6-bb9e-e1928024f799 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:31:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:52 user nova-compute[71321]: DEBUG nova.network.neutron [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Successfully updated port: c1091e67-edef-41a6-bb9e-e1928024f799 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:31:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Acquiring lock "refresh_cache-49339083-8dd4-454b-b7aa-73d91238bef4" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:31:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Acquired lock "refresh_cache-49339083-8dd4-454b-b7aa-73d91238bef4" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:31:52 user nova-compute[71321]: DEBUG nova.network.neutron [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:31:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-506df91c-a6c6-4069-af1c-8cf85c32853f tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "79bee3fe-3300-4a28-b079-1bafaa1033c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-506df91c-a6c6-4069-af1c-8cf85c32853f tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "79bee3fe-3300-4a28-b079-1bafaa1033c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-506df91c-a6c6-4069-af1c-8cf85c32853f tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "79bee3fe-3300-4a28-b079-1bafaa1033c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-506df91c-a6c6-4069-af1c-8cf85c32853f tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "79bee3fe-3300-4a28-b079-1bafaa1033c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-506df91c-a6c6-4069-af1c-8cf85c32853f tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "79bee3fe-3300-4a28-b079-1bafaa1033c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:52 user nova-compute[71321]: INFO nova.compute.manager [None req-506df91c-a6c6-4069-af1c-8cf85c32853f tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Terminating instance
Apr 12 12:31:52 user nova-compute[71321]: DEBUG nova.compute.manager [req-36741fd5-798e-47ec-a12f-26991d883f63 req-dd8f32ca-465a-4b99-bb15-1e6d93c3b0a0 service nova] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Received event network-changed-c1091e67-edef-41a6-bb9e-e1928024f799 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:52 user nova-compute[71321]: DEBUG nova.compute.manager [req-36741fd5-798e-47ec-a12f-26991d883f63 req-dd8f32ca-465a-4b99-bb15-1e6d93c3b0a0 service nova] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Refreshing instance network info cache due to event network-changed-c1091e67-edef-41a6-bb9e-e1928024f799. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:31:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-36741fd5-798e-47ec-a12f-26991d883f63 req-dd8f32ca-465a-4b99-bb15-1e6d93c3b0a0 service nova] Acquiring lock "refresh_cache-49339083-8dd4-454b-b7aa-73d91238bef4" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:31:52 user nova-compute[71321]: DEBUG nova.compute.manager [None req-506df91c-a6c6-4069-af1c-8cf85c32853f tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:31:52 user nova-compute[71321]: DEBUG nova.network.neutron [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:31:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.compute.manager [req-68416cae-8e09-4291-a120-a6655da0d6a3 req-f0e981a5-97f5-4f1a-a898-054fbbe5c0ef service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Received event network-vif-unplugged-201eadd8-c760-4862-bcce-bcff996371f9 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-68416cae-8e09-4291-a120-a6655da0d6a3 req-f0e981a5-97f5-4f1a-a898-054fbbe5c0ef service nova] Acquiring lock "79bee3fe-3300-4a28-b079-1bafaa1033c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-68416cae-8e09-4291-a120-a6655da0d6a3 req-f0e981a5-97f5-4f1a-a898-054fbbe5c0ef service nova] Lock "79bee3fe-3300-4a28-b079-1bafaa1033c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-68416cae-8e09-4291-a120-a6655da0d6a3 req-f0e981a5-97f5-4f1a-a898-054fbbe5c0ef service nova] Lock "79bee3fe-3300-4a28-b079-1bafaa1033c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.compute.manager [req-68416cae-8e09-4291-a120-a6655da0d6a3 req-f0e981a5-97f5-4f1a-a898-054fbbe5c0ef service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] No waiting events found dispatching network-vif-unplugged-201eadd8-c760-4862-bcce-bcff996371f9 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.compute.manager [req-68416cae-8e09-4291-a120-a6655da0d6a3 req-f0e981a5-97f5-4f1a-a898-054fbbe5c0ef service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Received event network-vif-unplugged-201eadd8-c760-4862-bcce-bcff996371f9 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.network.neutron [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Updating instance_info_cache with network_info: [{"id": "c1091e67-edef-41a6-bb9e-e1928024f799", "address": "fa:16:3e:2a:04:13", "network": {"id": "d1dedd7c-8d21-42ac-b2f0-d1edea608e69", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "df919367bacb43bb89689f1b01773445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1091e67-ed", "ovs_interfaceid": "c1091e67-edef-41a6-bb9e-e1928024f799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Releasing lock "refresh_cache-49339083-8dd4-454b-b7aa-73d91238bef4" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.compute.manager [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Instance network_info: |[{"id": "c1091e67-edef-41a6-bb9e-e1928024f799", "address": "fa:16:3e:2a:04:13", "network": {"id": "d1dedd7c-8d21-42ac-b2f0-d1edea608e69", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "df919367bacb43bb89689f1b01773445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1091e67-ed", "ovs_interfaceid": "c1091e67-edef-41a6-bb9e-e1928024f799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-36741fd5-798e-47ec-a12f-26991d883f63 req-dd8f32ca-465a-4b99-bb15-1e6d93c3b0a0 service nova] Acquired lock "refresh_cache-49339083-8dd4-454b-b7aa-73d91238bef4" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.network.neutron [req-36741fd5-798e-47ec-a12f-26991d883f63 req-dd8f32ca-465a-4b99-bb15-1e6d93c3b0a0 service nova] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Refreshing network info cache for port c1091e67-edef-41a6-bb9e-e1928024f799 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Start _get_guest_xml network_info=[{"id": "c1091e67-edef-41a6-bb9e-e1928024f799", "address": "fa:16:3e:2a:04:13", "network": {"id": "d1dedd7c-8d21-42ac-b2f0-d1edea608e69", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "df919367bacb43bb89689f1b01773445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1091e67-ed", "ovs_interfaceid": "c1091e67-edef-41a6-bb9e-e1928024f799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:31:53 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:31:53 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:31:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-487067793',display_name='tempest-VolumesNegativeTest-instance-487067793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-487067793',id=13,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cc629696bdf4ed2bc9da7e20e8102fb',ramdisk_id='',reservation_id='r-62mt0aym',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-809350896',owner_user_name='tempest-VolumesNegativeTest-809350896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:31:50Z,user_data=None,user_id='ddeb0b1b08ba4cbcb08705c49517f43f',uuid=49339083-8dd4-454b-b7aa-73d91238bef4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1091e67-edef-41a6-bb9e-e1928024f799", "address": "fa:16:3e:2a:04:13", "network": {"id": "d1dedd7c-8d21-42ac-b2f0-d1edea608e69", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "df919367bacb43bb89689f1b01773445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1091e67-ed", "ovs_interfaceid": "c1091e67-edef-41a6-bb9e-e1928024f799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Converting VIF {"id": "c1091e67-edef-41a6-bb9e-e1928024f799", "address": "fa:16:3e:2a:04:13", "network": {"id": "d1dedd7c-8d21-42ac-b2f0-d1edea608e69", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "df919367bacb43bb89689f1b01773445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1091e67-ed", "ovs_interfaceid": "c1091e67-edef-41a6-bb9e-e1928024f799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:04:13,bridge_name='br-int',has_traffic_filtering=True,id=c1091e67-edef-41a6-bb9e-e1928024f799,network=Network(d1dedd7c-8d21-42ac-b2f0-d1edea608e69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1091e67-ed') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.objects.instance [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lazy-loading 'pci_devices' on Instance uuid 49339083-8dd4-454b-b7aa-73d91238bef4 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:31:53 user nova-compute[71321]:   <uuid>49339083-8dd4-454b-b7aa-73d91238bef4</uuid>
Apr 12 12:31:53 user nova-compute[71321]:   <name>instance-0000000d</name>
Apr 12 12:31:53 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:31:53 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:31:53 user nova-compute[71321]:   <metadata>
Apr 12 12:31:53 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:31:53 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:31:53 user nova-compute[71321]:       <nova:name>tempest-VolumesNegativeTest-instance-487067793</nova:name>
Apr 12 12:31:53 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:31:53</nova:creationTime>
Apr 12 12:31:53 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:31:53 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:31:53 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:31:53 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:31:53 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:31:53 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:31:53 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:31:53 user nova-compute[71321]:       <nova:owner>
Apr 12 12:31:53 user nova-compute[71321]:         <nova:user uuid="ddeb0b1b08ba4cbcb08705c49517f43f">tempest-VolumesNegativeTest-809350896-project-member</nova:user>
Apr 12 12:31:53 user nova-compute[71321]:         <nova:project uuid="9cc629696bdf4ed2bc9da7e20e8102fb">tempest-VolumesNegativeTest-809350896</nova:project>
Apr 12 12:31:53 user nova-compute[71321]:       </nova:owner>
Apr 12 12:31:53 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:31:53 user nova-compute[71321]:       <nova:ports>
Apr 12 12:31:53 user nova-compute[71321]:         <nova:port uuid="c1091e67-edef-41a6-bb9e-e1928024f799">
Apr 12 12:31:53 user nova-compute[71321]:           <nova:ip type="fixed" address="192.168.233.9" ipVersion="4"/>
Apr 12 12:31:53 user nova-compute[71321]:         </nova:port>
Apr 12 12:31:53 user nova-compute[71321]:       </nova:ports>
Apr 12 12:31:53 user nova-compute[71321]:     </nova:instance>
Apr 12 12:31:53 user nova-compute[71321]:   </metadata>
Apr 12 12:31:53 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:31:53 user nova-compute[71321]:     <system>
Apr 12 12:31:53 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:31:53 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:31:53 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:31:53 user nova-compute[71321]:       <entry name="serial">49339083-8dd4-454b-b7aa-73d91238bef4</entry>
Apr 12 12:31:53 user nova-compute[71321]:       <entry name="uuid">49339083-8dd4-454b-b7aa-73d91238bef4</entry>
Apr 12 12:31:53 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:31:53 user nova-compute[71321]:     </system>
Apr 12 12:31:53 user nova-compute[71321]:   </sysinfo>
Apr 12 12:31:53 user nova-compute[71321]:   <os>
Apr 12 12:31:53 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:31:53 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:31:53 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:31:53 user nova-compute[71321]:   </os>
Apr 12 12:31:53 user nova-compute[71321]:   <features>
Apr 12 12:31:53 user nova-compute[71321]:     <acpi/>
Apr 12 12:31:53 user nova-compute[71321]:     <apic/>
Apr 12 12:31:53 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:31:53 user nova-compute[71321]:   </features>
Apr 12 12:31:53 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:31:53 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:31:53 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:31:53 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:31:53 user nova-compute[71321]:   </clock>
Apr 12 12:31:53 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:31:53 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:31:53 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:31:53 user nova-compute[71321]:   </cpu>
Apr 12 12:31:53 user nova-compute[71321]:   <devices>
Apr 12 12:31:53 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:31:53 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:31:53 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/49339083-8dd4-454b-b7aa-73d91238bef4/disk"/>
Apr 12 12:31:53 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:31:53 user nova-compute[71321]:     </disk>
Apr 12 12:31:53 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:31:53 user nova-compute[71321]:       <mac address="fa:16:3e:2a:04:13"/>
Apr 12 12:31:53 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:31:53 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:31:53 user nova-compute[71321]:       <target dev="tapc1091e67-ed"/>
Apr 12 12:31:53 user nova-compute[71321]:     </interface>
Apr 12 12:31:53 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:31:53 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/49339083-8dd4-454b-b7aa-73d91238bef4/console.log" append="off"/>
Apr 12 12:31:53 user nova-compute[71321]:     </serial>
Apr 12 12:31:53 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:31:53 user nova-compute[71321]:     <video>
Apr 12 12:31:53 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:31:53 user nova-compute[71321]:     </video>
Apr 12 12:31:53 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:31:53 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:31:53 user nova-compute[71321]:     </rng>
Apr 12 12:31:53 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:31:53 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:31:53 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:31:53 user nova-compute[71321]:     </memballoon>
Apr 12 12:31:53 user nova-compute[71321]:   </devices>
Apr 12 12:31:53 user nova-compute[71321]: </domain>
Apr 12 12:31:53 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:31:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-487067793',display_name='tempest-VolumesNegativeTest-instance-487067793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-487067793',id=13,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cc629696bdf4ed2bc9da7e20e8102fb',ramdisk_id='',reservation_id='r-62mt0aym',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-809350896',owner_user_name='tempest-VolumesNegativeTest-809350896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:31:50Z,user_data=None,user_id='ddeb0b1b08ba4cbcb08705c49517f43f',uuid=49339083-8dd4-454b-b7aa-73d91238bef4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1091e67-edef-41a6-bb9e-e1928024f799", "address": "fa:16:3e:2a:04:13", "network": {"id": "d1dedd7c-8d21-42ac-b2f0-d1edea608e69", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "df919367bacb43bb89689f1b01773445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1091e67-ed", "ovs_interfaceid": "c1091e67-edef-41a6-bb9e-e1928024f799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Converting VIF {"id": "c1091e67-edef-41a6-bb9e-e1928024f799", "address": "fa:16:3e:2a:04:13", "network": {"id": "d1dedd7c-8d21-42ac-b2f0-d1edea608e69", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "df919367bacb43bb89689f1b01773445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1091e67-ed", "ovs_interfaceid": "c1091e67-edef-41a6-bb9e-e1928024f799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:04:13,bridge_name='br-int',has_traffic_filtering=True,id=c1091e67-edef-41a6-bb9e-e1928024f799,network=Network(d1dedd7c-8d21-42ac-b2f0-d1edea608e69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1091e67-ed') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG os_vif [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:04:13,bridge_name='br-int',has_traffic_filtering=True,id=c1091e67-edef-41a6-bb9e-e1928024f799,network=Network(d1dedd7c-8d21-42ac-b2f0-d1edea608e69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1091e67-ed') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1091e67-ed, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc1091e67-ed, col_values=(('external_ids', {'iface-id': 'c1091e67-edef-41a6-bb9e-e1928024f799', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:04:13', 'vm-uuid': '49339083-8dd4-454b-b7aa-73d91238bef4'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:53 user nova-compute[71321]: INFO os_vif [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:04:13,bridge_name='br-int',has_traffic_filtering=True,id=c1091e67-edef-41a6-bb9e-e1928024f799,network=Network(d1dedd7c-8d21-42ac-b2f0-d1edea608e69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1091e67-ed')
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] No VIF found with MAC fa:16:3e:2a:04:13, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.network.neutron [req-36741fd5-798e-47ec-a12f-26991d883f63 req-dd8f32ca-465a-4b99-bb15-1e6d93c3b0a0 service nova] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Updated VIF entry in instance network info cache for port c1091e67-edef-41a6-bb9e-e1928024f799. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.network.neutron [req-36741fd5-798e-47ec-a12f-26991d883f63 req-dd8f32ca-465a-4b99-bb15-1e6d93c3b0a0 service nova] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Updating instance_info_cache with network_info: [{"id": "c1091e67-edef-41a6-bb9e-e1928024f799", "address": "fa:16:3e:2a:04:13", "network": {"id": "d1dedd7c-8d21-42ac-b2f0-d1edea608e69", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "df919367bacb43bb89689f1b01773445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1091e67-ed", "ovs_interfaceid": "c1091e67-edef-41a6-bb9e-e1928024f799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-36741fd5-798e-47ec-a12f-26991d883f63 req-dd8f32ca-465a-4b99-bb15-1e6d93c3b0a0 service nova] Releasing lock "refresh_cache-49339083-8dd4-454b-b7aa-73d91238bef4" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:31:53 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Instance destroyed successfully.
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.objects.instance [None req-506df91c-a6c6-4069-af1c-8cf85c32853f tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lazy-loading 'resources' on Instance uuid 79bee3fe-3300-4a28-b079-1bafaa1033c4 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-506df91c-a6c6-4069-af1c-8cf85c32853f tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:28:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-656063872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-656063872',id=8,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxGfNEhwxyml0RYHshQIBVlikZPUICMVOtWr1cX5kE9lM3qDUztZplY9zWTLExsTj4Jyt4GyZTZtlPvLt0Z2/a5v2pzKXPmtIr/OlOJ6S/2MsrCvF+uqljaJkNsq+Gqvw==',key_name='tempest-keypair-134546144',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:29:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0dd2a4a665514d0eb31653775b67356a',ramdisk_id='',reservation_id='r-u0qzq363',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1949865572',owner_user_name='tempest-TaggedAttachmentsTest-1949865572-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:29:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ff191ffb9604795bab6ada1eafd41ff',uuid=79bee3fe-3300-4a28-b079-1bafaa1033c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "201eadd8-c760-4862-bcce-bcff996371f9", "address": "fa:16:3e:4a:27:fd", "network": {"id": "a751f1e2-998e-4446-b94e-4bab0dc80db7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-990400052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dd2a4a665514d0eb31653775b67356a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201eadd8-c7", "ovs_interfaceid": "201eadd8-c760-4862-bcce-bcff996371f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-506df91c-a6c6-4069-af1c-8cf85c32853f tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Converting VIF {"id": "201eadd8-c760-4862-bcce-bcff996371f9", "address": "fa:16:3e:4a:27:fd", "network": {"id": "a751f1e2-998e-4446-b94e-4bab0dc80db7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-990400052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dd2a4a665514d0eb31653775b67356a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201eadd8-c7", "ovs_interfaceid": "201eadd8-c760-4862-bcce-bcff996371f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-506df91c-a6c6-4069-af1c-8cf85c32853f tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:27:fd,bridge_name='br-int',has_traffic_filtering=True,id=201eadd8-c760-4862-bcce-bcff996371f9,network=Network(a751f1e2-998e-4446-b94e-4bab0dc80db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201eadd8-c7') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG os_vif [None req-506df91c-a6c6-4069-af1c-8cf85c32853f tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:27:fd,bridge_name='br-int',has_traffic_filtering=True,id=201eadd8-c760-4862-bcce-bcff996371f9,network=Network(a751f1e2-998e-4446-b94e-4bab0dc80db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201eadd8-c7') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap201eadd8-c7, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:53 user nova-compute[71321]: INFO os_vif [None req-506df91c-a6c6-4069-af1c-8cf85c32853f tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:27:fd,bridge_name='br-int',has_traffic_filtering=True,id=201eadd8-c760-4862-bcce-bcff996371f9,network=Network(a751f1e2-998e-4446-b94e-4bab0dc80db7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201eadd8-c7')
Apr 12 12:31:53 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-506df91c-a6c6-4069-af1c-8cf85c32853f tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Deleting instance files /opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4_del
Apr 12 12:31:53 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-506df91c-a6c6-4069-af1c-8cf85c32853f tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Deletion of /opt/stack/data/nova/instances/79bee3fe-3300-4a28-b079-1bafaa1033c4_del complete
Apr 12 12:31:53 user nova-compute[71321]: INFO nova.compute.manager [None req-506df91c-a6c6-4069-af1c-8cf85c32853f tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Took 1.31 seconds to destroy the instance on the hypervisor.
Apr 12 12:31:53 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-506df91c-a6c6-4069-af1c-8cf85c32853f tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:31:53 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:31:54 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:31:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:54 user nova-compute[71321]: DEBUG nova.compute.manager [req-93cbe325-ec67-4382-8cd9-26fd45aea32b req-0ef4d427-c193-4601-b9da-33936df7bfdc service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Received event network-vif-deleted-201eadd8-c760-4862-bcce-bcff996371f9 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:54 user nova-compute[71321]: INFO nova.compute.manager [req-93cbe325-ec67-4382-8cd9-26fd45aea32b req-0ef4d427-c193-4601-b9da-33936df7bfdc service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Neutron deleted interface 201eadd8-c760-4862-bcce-bcff996371f9; detaching it from the instance and deleting it from the info cache
Apr 12 12:31:54 user nova-compute[71321]: DEBUG nova.network.neutron [req-93cbe325-ec67-4382-8cd9-26fd45aea32b req-0ef4d427-c193-4601-b9da-33936df7bfdc service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:31:54 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Took 0.87 seconds to deallocate network for instance.
Apr 12 12:31:54 user nova-compute[71321]: DEBUG nova.compute.manager [req-93cbe325-ec67-4382-8cd9-26fd45aea32b req-0ef4d427-c193-4601-b9da-33936df7bfdc service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Detach interface failed, port_id=201eadd8-c760-4862-bcce-bcff996371f9, reason: Instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 could not be found. {{(pid=71321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 12:31:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-506df91c-a6c6-4069-af1c-8cf85c32853f tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-506df91c-a6c6-4069-af1c-8cf85c32853f tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:55 user nova-compute[71321]: DEBUG nova.compute.manager [req-c11a10c1-d5f4-4f9a-8adb-82e963aa6f10 req-0dc621a6-f47e-47c6-82b8-2b51a5a41c14 service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Received event network-vif-plugged-201eadd8-c760-4862-bcce-bcff996371f9 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c11a10c1-d5f4-4f9a-8adb-82e963aa6f10 req-0dc621a6-f47e-47c6-82b8-2b51a5a41c14 service nova] Acquiring lock "79bee3fe-3300-4a28-b079-1bafaa1033c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c11a10c1-d5f4-4f9a-8adb-82e963aa6f10 req-0dc621a6-f47e-47c6-82b8-2b51a5a41c14 service nova] Lock "79bee3fe-3300-4a28-b079-1bafaa1033c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c11a10c1-d5f4-4f9a-8adb-82e963aa6f10 req-0dc621a6-f47e-47c6-82b8-2b51a5a41c14 service nova] Lock "79bee3fe-3300-4a28-b079-1bafaa1033c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:55 user nova-compute[71321]: DEBUG nova.compute.manager [req-c11a10c1-d5f4-4f9a-8adb-82e963aa6f10 req-0dc621a6-f47e-47c6-82b8-2b51a5a41c14 service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] No waiting events found dispatching network-vif-plugged-201eadd8-c760-4862-bcce-bcff996371f9 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:31:55 user nova-compute[71321]: WARNING nova.compute.manager [req-c11a10c1-d5f4-4f9a-8adb-82e963aa6f10 req-0dc621a6-f47e-47c6-82b8-2b51a5a41c14 service nova] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Received unexpected event network-vif-plugged-201eadd8-c760-4862-bcce-bcff996371f9 for instance with vm_state deleted and task_state None.
Apr 12 12:31:55 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-506df91c-a6c6-4069-af1c-8cf85c32853f tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:31:55 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-506df91c-a6c6-4069-af1c-8cf85c32853f tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:31:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-506df91c-a6c6-4069-af1c-8cf85c32853f tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:55 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-506df91c-a6c6-4069-af1c-8cf85c32853f tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Deleted allocations for instance 79bee3fe-3300-4a28-b079-1bafaa1033c4
Apr 12 12:31:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-506df91c-a6c6-4069-af1c-8cf85c32853f tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "79bee3fe-3300-4a28-b079-1bafaa1033c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.753s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:56 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:57 user nova-compute[71321]: DEBUG nova.compute.manager [req-4d3932b2-06fc-49b7-8ae0-166b369f17ec req-fe97aed3-de2e-4eb3-bad6-bb881d7a3e84 service nova] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Received event network-vif-plugged-c1091e67-edef-41a6-bb9e-e1928024f799 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4d3932b2-06fc-49b7-8ae0-166b369f17ec req-fe97aed3-de2e-4eb3-bad6-bb881d7a3e84 service nova] Acquiring lock "49339083-8dd4-454b-b7aa-73d91238bef4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4d3932b2-06fc-49b7-8ae0-166b369f17ec req-fe97aed3-de2e-4eb3-bad6-bb881d7a3e84 service nova] Lock "49339083-8dd4-454b-b7aa-73d91238bef4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4d3932b2-06fc-49b7-8ae0-166b369f17ec req-fe97aed3-de2e-4eb3-bad6-bb881d7a3e84 service nova] Lock "49339083-8dd4-454b-b7aa-73d91238bef4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:57 user nova-compute[71321]: DEBUG nova.compute.manager [req-4d3932b2-06fc-49b7-8ae0-166b369f17ec req-fe97aed3-de2e-4eb3-bad6-bb881d7a3e84 service nova] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] No waiting events found dispatching network-vif-plugged-c1091e67-edef-41a6-bb9e-e1928024f799 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:31:57 user nova-compute[71321]: WARNING nova.compute.manager [req-4d3932b2-06fc-49b7-8ae0-166b369f17ec req-fe97aed3-de2e-4eb3-bad6-bb881d7a3e84 service nova] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Received unexpected event network-vif-plugged-c1091e67-edef-41a6-bb9e-e1928024f799 for instance with vm_state building and task_state spawning.
Apr 12 12:31:57 user nova-compute[71321]: DEBUG nova.compute.manager [req-4d3932b2-06fc-49b7-8ae0-166b369f17ec req-fe97aed3-de2e-4eb3-bad6-bb881d7a3e84 service nova] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Received event network-vif-plugged-c1091e67-edef-41a6-bb9e-e1928024f799 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:31:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4d3932b2-06fc-49b7-8ae0-166b369f17ec req-fe97aed3-de2e-4eb3-bad6-bb881d7a3e84 service nova] Acquiring lock "49339083-8dd4-454b-b7aa-73d91238bef4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:31:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4d3932b2-06fc-49b7-8ae0-166b369f17ec req-fe97aed3-de2e-4eb3-bad6-bb881d7a3e84 service nova] Lock "49339083-8dd4-454b-b7aa-73d91238bef4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:31:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4d3932b2-06fc-49b7-8ae0-166b369f17ec req-fe97aed3-de2e-4eb3-bad6-bb881d7a3e84 service nova] Lock "49339083-8dd4-454b-b7aa-73d91238bef4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:57 user nova-compute[71321]: DEBUG nova.compute.manager [req-4d3932b2-06fc-49b7-8ae0-166b369f17ec req-fe97aed3-de2e-4eb3-bad6-bb881d7a3e84 service nova] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] No waiting events found dispatching network-vif-plugged-c1091e67-edef-41a6-bb9e-e1928024f799 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:31:57 user nova-compute[71321]: WARNING nova.compute.manager [req-4d3932b2-06fc-49b7-8ae0-166b369f17ec req-fe97aed3-de2e-4eb3-bad6-bb881d7a3e84 service nova] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Received unexpected event network-vif-plugged-c1091e67-edef-41a6-bb9e-e1928024f799 for instance with vm_state building and task_state spawning.
Apr 12 12:31:57 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302717.298982, 49339083-8dd4-454b-b7aa-73d91238bef4 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:31:57 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] VM Resumed (Lifecycle Event)
Apr 12 12:31:57 user nova-compute[71321]: DEBUG nova.compute.manager [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:31:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:31:57 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Instance spawned successfully.
Apr 12 12:31:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:31:57 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:31:57 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:31:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:31:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:31:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:31:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:31:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:31:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:31:57 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:31:57 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302717.3022108, 49339083-8dd4-454b-b7aa-73d91238bef4 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:31:57 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] VM Started (Lifecycle Event)
Apr 12 12:31:57 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:31:57 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:31:57 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:31:57 user nova-compute[71321]: INFO nova.compute.manager [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Took 7.11 seconds to spawn the instance on the hypervisor.
Apr 12 12:31:57 user nova-compute[71321]: DEBUG nova.compute.manager [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:31:57 user nova-compute[71321]: INFO nova.compute.manager [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Took 7.83 seconds to build instance.
Apr 12 12:31:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "49339083-8dd4-454b-b7aa-73d91238bef4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.926s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:31:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:31:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:01 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681302706.5728188, 651d5c05-2d02-450f-a33c-fbd9b3109016 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:32:01 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] VM Stopped (Lifecycle Event)
Apr 12 12:32:01 user nova-compute[71321]: DEBUG nova.compute.manager [None req-4e709f80-6b48-424a-bb43-968ff989fedf None None] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:32:02 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "cda12475-d730-4c07-af54-a3a64482fc94" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:02 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "cda12475-d730-4c07-af54-a3a64482fc94" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:02 user nova-compute[71321]: DEBUG nova.compute.manager [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:32:02 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:02 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:02 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:32:02 user nova-compute[71321]: INFO nova.compute.claims [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Claim successful on node user
Apr 12 12:32:02 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:32:02 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:32:02 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.368s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:02 user nova-compute[71321]: DEBUG nova.compute.manager [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:32:02 user nova-compute[71321]: DEBUG nova.compute.manager [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:32:02 user nova-compute[71321]: DEBUG nova.network.neutron [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:32:02 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:32:02 user nova-compute[71321]: DEBUG nova.compute.manager [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:32:02 user nova-compute[71321]: INFO nova.virt.block_device [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Booting with volume f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 at /dev/vda
Apr 12 12:32:03 user nova-compute[71321]: DEBUG nova.policy [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '076e65b43f664765ad1d48be6e814f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ada441da2124adda751365952320e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:32:03 user nova-compute[71321]: DEBUG os_brick.utils [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:32:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[80db53f4-f06b-4aa1-942e-004a1c32c3d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8cd800-1d60-4f22-8c4c-c5ad77740cca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcb99ea-cdc0-4c3e-8942-4aa9e5e75520]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1715f6b7-993f-408d-912f-ff6c9f68ce15]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:32:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:32:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:32:03 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:32:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6b09fc-e9b2-4289-b80b-60c1150e7317]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:32:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:32:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:32:03 user nova-compute[71321]: DEBUG os_brick.utils [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:32:03 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Updating existing volume attachment record: 14ef983f-1449-47d7-90ed-1720d5ea4bf3 {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:32:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:04 user nova-compute[71321]: DEBUG nova.network.neutron [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Successfully created port: 00018f63-5e54-484b-beb9-e2aa082e0e5c {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:32:05 user nova-compute[71321]: DEBUG nova.compute.manager [req-4f622401-bdf8-4c8c-b4d1-d54ebc643c8f req-93da530d-f235-4cd5-ab64-de5c2f8bf06a service nova] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Received event network-changed-5fbb21e1-ece8-4e20-baa6-55fe59a41325 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:32:05 user nova-compute[71321]: DEBUG nova.compute.manager [req-4f622401-bdf8-4c8c-b4d1-d54ebc643c8f req-93da530d-f235-4cd5-ab64-de5c2f8bf06a service nova] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Refreshing instance network info cache due to event network-changed-5fbb21e1-ece8-4e20-baa6-55fe59a41325. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:32:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4f622401-bdf8-4c8c-b4d1-d54ebc643c8f req-93da530d-f235-4cd5-ab64-de5c2f8bf06a service nova] Acquiring lock "refresh_cache-d584edf2-12e3-48d1-947f-fdfb0c9c7377" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:32:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4f622401-bdf8-4c8c-b4d1-d54ebc643c8f req-93da530d-f235-4cd5-ab64-de5c2f8bf06a service nova] Acquired lock "refresh_cache-d584edf2-12e3-48d1-947f-fdfb0c9c7377" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:32:05 user nova-compute[71321]: DEBUG nova.network.neutron [req-4f622401-bdf8-4c8c-b4d1-d54ebc643c8f req-93da530d-f235-4cd5-ab64-de5c2f8bf06a service nova] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Refreshing network info cache for port 5fbb21e1-ece8-4e20-baa6-55fe59a41325 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:32:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:05 user nova-compute[71321]: DEBUG nova.objects.instance [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lazy-loading 'flavor' on Instance uuid d584edf2-12e3-48d1-947f-fdfb0c9c7377 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:32:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:05 user nova-compute[71321]: INFO nova.compute.manager [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Attaching volume 449d635d-4ec1-4536-8979-33cea2764dad to /dev/vdb
Apr 12 12:32:05 user nova-compute[71321]: DEBUG os_brick.utils [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:32:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:05 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[501d8083-43e0-49c5-9eb4-c967d865a71b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:05 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4370e7-9921-4eb1-816c-de88106ddfed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:05 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b740efbe-f6c1-42c0-ae67-8f87b9ffcf0a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:05 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f726330-01e4-47bf-ba91-54e24b688f43]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:32:05 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:32:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:32:06 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:32:06 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adcfcc3-4f4b-420e-8e9d-3107b9bc038d]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:06 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:32:06 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:32:06 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:32:06 user nova-compute[71321]: DEBUG os_brick.utils [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:32:06 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Updating existing volume attachment record: 0610bd53-d94e-46bb-ba56-03ff666087c5 {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:32:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:06 user nova-compute[71321]: DEBUG nova.network.neutron [req-4f622401-bdf8-4c8c-b4d1-d54ebc643c8f req-93da530d-f235-4cd5-ab64-de5c2f8bf06a service nova] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Updated VIF entry in instance network info cache for port 5fbb21e1-ece8-4e20-baa6-55fe59a41325. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG nova.network.neutron [req-4f622401-bdf8-4c8c-b4d1-d54ebc643c8f req-93da530d-f235-4cd5-ab64-de5c2f8bf06a service nova] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Updating instance_info_cache with network_info: [{"id": "5fbb21e1-ece8-4e20-baa6-55fe59a41325", "address": "fa:16:3e:eb:10:b5", "network": {"id": "cba3e8fe-24d8-4128-b9b8-4087ab3a4407", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-916061215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8ad4c8abb3447bd8ad5f5f2e95e2d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fbb21e1-ec", "ovs_interfaceid": "5fbb21e1-ece8-4e20-baa6-55fe59a41325", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4f622401-bdf8-4c8c-b4d1-d54ebc643c8f req-93da530d-f235-4cd5-ab64-de5c2f8bf06a service nova] Releasing lock "refresh_cache-d584edf2-12e3-48d1-947f-fdfb0c9c7377" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG nova.network.neutron [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Successfully updated port: 00018f63-5e54-484b-beb9-e2aa082e0e5c {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "refresh_cache-cda12475-d730-4c07-af54-a3a64482fc94" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquired lock "refresh_cache-cda12475-d730-4c07-af54-a3a64482fc94" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG nova.network.neutron [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG nova.network.neutron [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG nova.compute.manager [req-844f8999-ccb7-4353-8614-71e6b2bcb873 req-96abab73-1fd9-4ce7-9f49-e3ffff2f82ff service nova] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Received event network-changed-00018f63-5e54-484b-beb9-e2aa082e0e5c {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG nova.compute.manager [req-844f8999-ccb7-4353-8614-71e6b2bcb873 req-96abab73-1fd9-4ce7-9f49-e3ffff2f82ff service nova] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Refreshing instance network info cache due to event network-changed-00018f63-5e54-484b-beb9-e2aa082e0e5c. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-844f8999-ccb7-4353-8614-71e6b2bcb873 req-96abab73-1fd9-4ce7-9f49-e3ffff2f82ff service nova] Acquiring lock "refresh_cache-cda12475-d730-4c07-af54-a3a64482fc94" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG nova.compute.manager [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:32:07 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Creating image(s)
Apr 12 12:32:07 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Did not create local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Ensure instance console log exists: /opt/stack/data/nova/instances/cda12475-d730-4c07-af54-a3a64482fc94/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG nova.network.neutron [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Updating instance_info_cache with network_info: [{"id": "00018f63-5e54-484b-beb9-e2aa082e0e5c", "address": "fa:16:3e:6e:1c:df", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00018f63-5e", "ovs_interfaceid": "00018f63-5e54-484b-beb9-e2aa082e0e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Releasing lock "refresh_cache-cda12475-d730-4c07-af54-a3a64482fc94" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG nova.compute.manager [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Instance network_info: |[{"id": "00018f63-5e54-484b-beb9-e2aa082e0e5c", "address": "fa:16:3e:6e:1c:df", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00018f63-5e", "ovs_interfaceid": "00018f63-5e54-484b-beb9-e2aa082e0e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-844f8999-ccb7-4353-8614-71e6b2bcb873 req-96abab73-1fd9-4ce7-9f49-e3ffff2f82ff service nova] Acquired lock "refresh_cache-cda12475-d730-4c07-af54-a3a64482fc94" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG nova.network.neutron [req-844f8999-ccb7-4353-8614-71e6b2bcb873 req-96abab73-1fd9-4ce7-9f49-e3ffff2f82ff service nova] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Refreshing network info cache for port 00018f63-5e54-484b-beb9-e2aa082e0e5c {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Start _get_guest_xml network_info=[{"id": "00018f63-5e54-484b-beb9-e2aa082e0e5c", "address": "fa:16:3e:6e:1c:df", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00018f63-5e", "ovs_interfaceid": "00018f63-5e54-484b-beb9-e2aa082e0e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '14ef983f-1449-47d7-90ed-1720d5ea4bf3', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yWXIcdRN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cda12475-d730-4c07-af54-a3a64482fc94', 'attached_at': '', 'detached_at': '', 'volume_id': 'f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54', 'serial': 'f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:32:07 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:32:07 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:32:07 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yWXIcdRN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:32:07 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:32:07 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:32:07 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:32:07 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:32:07 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:32:07 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[33eb484e-0922-44c7-b12c-2a87d4dcff8f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:32:07 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:07 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8651c2-39ff-4f77-b21c-e3eb2b74c9cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54] added
Apr 12 12:32:08 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6191d9-5ccc-4114-9102-a8d4d375d959]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[516402c0-8142-43ed-8fb7-4a13a5dce1e6]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yWXIcdRN {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yWXIcdRN" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a1c7bc-d6f3-4f79-943a-d75149ae8213]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yWXIcdRN'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5e4df7-51f9-409c-9315-7e5db43593a2]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe18dc8-9b7e-4400-90c4-839d0985a684]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 12:32:08 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 12:32:08 user nova-compute[71321]:  {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:32:08 user nova-compute[71321]: WARNING os_brick.initiator.connectors.iscsi [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 12:32:08 user nova-compute[71321]: 
Apr 12 12:32:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9cf8f6-bc97-4efd-aa09-4cabcc1871a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54, portal: 172.16.0.220,3260]
Apr 12 12:32:08 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54, portal: 172.16.0.220,3260] successful.
Apr 12 12:32:08 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f913a6-b952-47c6-9637-170381ad0c8d]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7894a47f-ad38-4c27-9810-4e10f42f6acf]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:32:08 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:32:08 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e96461-2162-4322-b62e-ad3e58892e53]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: None {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG nova.network.neutron [req-844f8999-ccb7-4353-8614-71e6b2bcb873 req-96abab73-1fd9-4ce7-9f49-e3ffff2f82ff service nova] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Updated VIF entry in instance network info cache for port 00018f63-5e54-484b-beb9-e2aa082e0e5c. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG nova.network.neutron [req-844f8999-ccb7-4353-8614-71e6b2bcb873 req-96abab73-1fd9-4ce7-9f49-e3ffff2f82ff service nova] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Updating instance_info_cache with network_info: [{"id": "00018f63-5e54-484b-beb9-e2aa082e0e5c", "address": "fa:16:3e:6e:1c:df", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00018f63-5e", "ovs_interfaceid": "00018f63-5e54-484b-beb9-e2aa082e0e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-844f8999-ccb7-4353-8614-71e6b2bcb873 req-96abab73-1fd9-4ce7-9f49-e3ffff2f82ff service nova] Releasing lock "refresh_cache-cda12475-d730-4c07-af54-a3a64482fc94" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681302713.8708892, 79bee3fe-3300-4a28-b079-1bafaa1033c4 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:32:08 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] VM Stopped (Lifecycle Event)
Apr 12 12:32:08 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b5abf65d-8047-43c1-9630-c466fc8c766b None None] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:32:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yWXIcdRN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23231643234636633', 'path': '/dev/sdb'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231643234636633', 'path': '/dev/sdb'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-51459992',display_name='tempest-TestVolumeBootPattern-volume-backed-server-51459992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-51459992',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ada441da2124adda751365952320e81',ramdisk_id='',reservation_id='r-21mh704a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-310589135',owner_user_name='tempest-TestVolumeBootPattern-310589135-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:32:03Z,user_data=None,user_id='076e65b43f664765ad1d48be6e814f40',uuid=cda12475-d730-4c07-af54-a3a64482fc94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00018f63-5e54-484b-beb9-e2aa082e0e5c", "address": "fa:16:3e:6e:1c:df", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00018f63-5e", "ovs_interfaceid": "00018f63-5e54-484b-beb9-e2aa082e0e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converting VIF {"id": "00018f63-5e54-484b-beb9-e2aa082e0e5c", "address": "fa:16:3e:6e:1c:df", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00018f63-5e", "ovs_interfaceid": "00018f63-5e54-484b-beb9-e2aa082e0e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:1c:df,bridge_name='br-int',has_traffic_filtering=True,id=00018f63-5e54-484b-beb9-e2aa082e0e5c,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00018f63-5e') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG nova.objects.instance [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lazy-loading 'pci_devices' on Instance uuid cda12475-d730-4c07-af54-a3a64482fc94 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-cad88d40-b4d6-4fc6-9099-60affb54b4e3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "540a69c0-488f-40cb-bdde-3e410029d4c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-cad88d40-b4d6-4fc6-9099-60affb54b4e3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "540a69c0-488f-40cb-bdde-3e410029d4c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-cad88d40-b4d6-4fc6-9099-60affb54b4e3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "540a69c0-488f-40cb-bdde-3e410029d4c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-cad88d40-b4d6-4fc6-9099-60affb54b4e3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "540a69c0-488f-40cb-bdde-3e410029d4c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-cad88d40-b4d6-4fc6-9099-60affb54b4e3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "540a69c0-488f-40cb-bdde-3e410029d4c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:09 user nova-compute[71321]: INFO nova.compute.manager [None req-cad88d40-b4d6-4fc6-9099-60affb54b4e3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Terminating instance
Apr 12 12:32:09 user nova-compute[71321]: DEBUG nova.compute.manager [None req-cad88d40-b4d6-4fc6-9099-60affb54b4e3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:32:09 user nova-compute[71321]:   <uuid>cda12475-d730-4c07-af54-a3a64482fc94</uuid>
Apr 12 12:32:09 user nova-compute[71321]:   <name>instance-0000000e</name>
Apr 12 12:32:09 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:32:09 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:32:09 user nova-compute[71321]:   <metadata>
Apr 12 12:32:09 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:32:09 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:32:09 user nova-compute[71321]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-51459992</nova:name>
Apr 12 12:32:09 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:32:07</nova:creationTime>
Apr 12 12:32:09 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:32:09 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:32:09 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:32:09 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:32:09 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:32:09 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:32:09 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:32:09 user nova-compute[71321]:       <nova:owner>
Apr 12 12:32:09 user nova-compute[71321]:         <nova:user uuid="076e65b43f664765ad1d48be6e814f40">tempest-TestVolumeBootPattern-310589135-project-member</nova:user>
Apr 12 12:32:09 user nova-compute[71321]:         <nova:project uuid="5ada441da2124adda751365952320e81">tempest-TestVolumeBootPattern-310589135</nova:project>
Apr 12 12:32:09 user nova-compute[71321]:       </nova:owner>
Apr 12 12:32:09 user nova-compute[71321]:       <nova:ports>
Apr 12 12:32:09 user nova-compute[71321]:         <nova:port uuid="00018f63-5e54-484b-beb9-e2aa082e0e5c">
Apr 12 12:32:09 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 12:32:09 user nova-compute[71321]:         </nova:port>
Apr 12 12:32:09 user nova-compute[71321]:       </nova:ports>
Apr 12 12:32:09 user nova-compute[71321]:     </nova:instance>
Apr 12 12:32:09 user nova-compute[71321]:   </metadata>
Apr 12 12:32:09 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:32:09 user nova-compute[71321]:     <system>
Apr 12 12:32:09 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:32:09 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:32:09 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:32:09 user nova-compute[71321]:       <entry name="serial">cda12475-d730-4c07-af54-a3a64482fc94</entry>
Apr 12 12:32:09 user nova-compute[71321]:       <entry name="uuid">cda12475-d730-4c07-af54-a3a64482fc94</entry>
Apr 12 12:32:09 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:32:09 user nova-compute[71321]:     </system>
Apr 12 12:32:09 user nova-compute[71321]:   </sysinfo>
Apr 12 12:32:09 user nova-compute[71321]:   <os>
Apr 12 12:32:09 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:32:09 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:32:09 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:32:09 user nova-compute[71321]:   </os>
Apr 12 12:32:09 user nova-compute[71321]:   <features>
Apr 12 12:32:09 user nova-compute[71321]:     <acpi/>
Apr 12 12:32:09 user nova-compute[71321]:     <apic/>
Apr 12 12:32:09 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:32:09 user nova-compute[71321]:   </features>
Apr 12 12:32:09 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:32:09 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:32:09 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:32:09 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:32:09 user nova-compute[71321]:   </clock>
Apr 12 12:32:09 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:32:09 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:32:09 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:32:09 user nova-compute[71321]:   </cpu>
Apr 12 12:32:09 user nova-compute[71321]:   <devices>
Apr 12 12:32:09 user nova-compute[71321]:     <disk type="block" device="disk">
Apr 12 12:32:09 user nova-compute[71321]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:32:09 user nova-compute[71321]:       <source dev="/dev/sdb"/>
Apr 12 12:32:09 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:32:09 user nova-compute[71321]:       <serial>f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54</serial>
Apr 12 12:32:09 user nova-compute[71321]:     </disk>
Apr 12 12:32:09 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:32:09 user nova-compute[71321]:       <mac address="fa:16:3e:6e:1c:df"/>
Apr 12 12:32:09 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:32:09 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:32:09 user nova-compute[71321]:       <target dev="tap00018f63-5e"/>
Apr 12 12:32:09 user nova-compute[71321]:     </interface>
Apr 12 12:32:09 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:32:09 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/cda12475-d730-4c07-af54-a3a64482fc94/console.log" append="off"/>
Apr 12 12:32:09 user nova-compute[71321]:     </serial>
Apr 12 12:32:09 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:32:09 user nova-compute[71321]:     <video>
Apr 12 12:32:09 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:32:09 user nova-compute[71321]:     </video>
Apr 12 12:32:09 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:32:09 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:32:09 user nova-compute[71321]:     </rng>
Apr 12 12:32:09 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:32:09 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:32:09 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:32:09 user nova-compute[71321]:     </memballoon>
Apr 12 12:32:09 user nova-compute[71321]:   </devices>
Apr 12 12:32:09 user nova-compute[71321]: </domain>
Apr 12 12:32:09 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-51459992',display_name='tempest-TestVolumeBootPattern-volume-backed-server-51459992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-51459992',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ada441da2124adda751365952320e81',ramdisk_id='',reservation_id='r-21mh704a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-310589135',owner_user_name='tempest-TestVolumeBootPattern-310589135-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:32:03Z,user_data=None,user_id='076e65b43f664765ad1d48be6e814f40',uuid=cda12475-d730-4c07-af54-a3a64482fc94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00018f63-5e54-484b-beb9-e2aa082e0e5c", "address": "fa:16:3e:6e:1c:df", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00018f63-5e", "ovs_interfaceid": "00018f63-5e54-484b-beb9-e2aa082e0e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converting VIF {"id": "00018f63-5e54-484b-beb9-e2aa082e0e5c", "address": "fa:16:3e:6e:1c:df", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00018f63-5e", "ovs_interfaceid": "00018f63-5e54-484b-beb9-e2aa082e0e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:1c:df,bridge_name='br-int',has_traffic_filtering=True,id=00018f63-5e54-484b-beb9-e2aa082e0e5c,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00018f63-5e') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG os_vif [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:1c:df,bridge_name='br-int',has_traffic_filtering=True,id=00018f63-5e54-484b-beb9-e2aa082e0e5c,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00018f63-5e') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00018f63-5e, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap00018f63-5e, col_values=(('external_ids', {'iface-id': '00018f63-5e54-484b-beb9-e2aa082e0e5c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:1c:df', 'vm-uuid': 'cda12475-d730-4c07-af54-a3a64482fc94'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:09 user nova-compute[71321]: INFO os_vif [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:1c:df,bridge_name='br-int',has_traffic_filtering=True,id=00018f63-5e54-484b-beb9-e2aa082e0e5c,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00018f63-5e')
Apr 12 12:32:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] No VIF found with MAC fa:16:3e:6e:1c:df, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG nova.compute.manager [req-293b3d33-a9c1-464c-beb2-c158fcb0d527 req-6cc82c2e-3d4d-4078-b93a-87af9893688d service nova] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Received event network-vif-unplugged-69203d15-c034-4d74-915d-1fc13c89ee40 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-293b3d33-a9c1-464c-beb2-c158fcb0d527 req-6cc82c2e-3d4d-4078-b93a-87af9893688d service nova] Acquiring lock "540a69c0-488f-40cb-bdde-3e410029d4c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-293b3d33-a9c1-464c-beb2-c158fcb0d527 req-6cc82c2e-3d4d-4078-b93a-87af9893688d service nova] Lock "540a69c0-488f-40cb-bdde-3e410029d4c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-293b3d33-a9c1-464c-beb2-c158fcb0d527 req-6cc82c2e-3d4d-4078-b93a-87af9893688d service nova] Lock "540a69c0-488f-40cb-bdde-3e410029d4c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG nova.compute.manager [req-293b3d33-a9c1-464c-beb2-c158fcb0d527 req-6cc82c2e-3d4d-4078-b93a-87af9893688d service nova] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] No waiting events found dispatching network-vif-unplugged-69203d15-c034-4d74-915d-1fc13c89ee40 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:32:09 user nova-compute[71321]: DEBUG nova.compute.manager [req-293b3d33-a9c1-464c-beb2-c158fcb0d527 req-6cc82c2e-3d4d-4078-b93a-87af9893688d service nova] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Received event network-vif-unplugged-69203d15-c034-4d74-915d-1fc13c89ee40 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:32:10 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Instance destroyed successfully.
Apr 12 12:32:10 user nova-compute[71321]: DEBUG nova.objects.instance [None req-cad88d40-b4d6-4fc6-9099-60affb54b4e3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lazy-loading 'resources' on Instance uuid 540a69c0-488f-40cb-bdde-3e410029d4c8 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-cad88d40-b4d6-4fc6-9099-60affb54b4e3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:28:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1796205714',display_name='tempest-TestVolumeSwap-server-1796205714',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1796205714',id=6,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYnP1AePrADpa6JilldYtpPDptoIe9CTMXo+FcAEyhImA2xpG2q/0PpsCiqXJ220TNxIISIHyWrM0NQBvRGn3XwfGqZw4o8/KRoBf74FQaJ9aKltnL+xfRvmZLxzK5W4Q==',key_name='tempest-keypair-1155106394',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:29:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5c4688a3b0b429fb12d12ab7bd14e43',ramdisk_id='',reservation_id='r-orqq3dql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1492117268',owner_user_name='tempest-TestVolumeSwap-1492117268-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:29:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2991a85234e046698761e54b1f203861',uuid=540a69c0-488f-40cb-bdde-3e410029d4c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69203d15-c034-4d74-915d-1fc13c89ee40", "address": "fa:16:3e:1b:12:96", "network": {"id": "7e291b14-2505-4769-a423-3025cafb6fbc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-752511885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c4688a3b0b429fb12d12ab7bd14e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69203d15-c0", "ovs_interfaceid": "69203d15-c034-4d74-915d-1fc13c89ee40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-cad88d40-b4d6-4fc6-9099-60affb54b4e3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Converting VIF {"id": "69203d15-c034-4d74-915d-1fc13c89ee40", "address": "fa:16:3e:1b:12:96", "network": {"id": "7e291b14-2505-4769-a423-3025cafb6fbc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-752511885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c4688a3b0b429fb12d12ab7bd14e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69203d15-c0", "ovs_interfaceid": "69203d15-c034-4d74-915d-1fc13c89ee40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-cad88d40-b4d6-4fc6-9099-60affb54b4e3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:12:96,bridge_name='br-int',has_traffic_filtering=True,id=69203d15-c034-4d74-915d-1fc13c89ee40,network=Network(7e291b14-2505-4769-a423-3025cafb6fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69203d15-c0') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG os_vif [None req-cad88d40-b4d6-4fc6-9099-60affb54b4e3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:12:96,bridge_name='br-int',has_traffic_filtering=True,id=69203d15-c034-4d74-915d-1fc13c89ee40,network=Network(7e291b14-2505-4769-a423-3025cafb6fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69203d15-c0') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69203d15-c0, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:10 user nova-compute[71321]: INFO os_vif [None req-cad88d40-b4d6-4fc6-9099-60affb54b4e3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:12:96,bridge_name='br-int',has_traffic_filtering=True,id=69203d15-c034-4d74-915d-1fc13c89ee40,network=Network(7e291b14-2505-4769-a423-3025cafb6fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69203d15-c0')
Apr 12 12:32:10 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-cad88d40-b4d6-4fc6-9099-60affb54b4e3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Deleting instance files /opt/stack/data/nova/instances/540a69c0-488f-40cb-bdde-3e410029d4c8_del
Apr 12 12:32:10 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-cad88d40-b4d6-4fc6-9099-60affb54b4e3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Deletion of /opt/stack/data/nova/instances/540a69c0-488f-40cb-bdde-3e410029d4c8_del complete
Apr 12 12:32:10 user nova-compute[71321]: INFO nova.compute.manager [None req-cad88d40-b4d6-4fc6-9099-60affb54b4e3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Took 1.30 seconds to destroy the instance on the hypervisor.
Apr 12 12:32:10 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-cad88d40-b4d6-4fc6-9099-60affb54b4e3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZfiNbQJv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:32:10 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:32:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:32:10 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:32:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:32:10 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:32:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af69a01-56be-4665-bd06-0ac2d8459b66]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:32:10 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.045s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d722e20-0dbb-4974-ab5d-73f485c8ca12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad] added
Apr 12 12:32:10 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a23bf14-943a-4c3b-bba7-be8392e506ce]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6a327a-b179-49a5-ab6b-0a724e986296]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZfiNbQJv {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZfiNbQJv" returned: 0 in 0.029s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6f69b9-4833-4482-bc58-2b3ceb815cb4]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZfiNbQJv'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[957cc7d8-bc19-4702-b7de-8e1512d24bf8]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e8d118-0ffb-4697-88c8-f4755fdca86f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:32:10 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:32:10 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:32:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:11 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e12d54-7a09-41f9-880a-9f70dea6101a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:11 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad, portal: 172.16.0.220,3260]
Apr 12 12:32:11 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad, portal: 172.16.0.220,3260] successful.
Apr 12 12:32:11 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:11 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a4b375-6489-4de3-b214-07d2470bce0d]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:11 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:11 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4db4549-5752-41b7-bbce-0178deb10b41]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:11 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:32:11 user nova-compute[71321]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad (non-flash)
Apr 12 12:32:11 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:32:11 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:32:11 user nova-compute[71321]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad (non-flash)
Apr 12 12:32:11 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:32:11 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:32:11 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:32:11 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:32:11 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:32:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:11 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b80c71-b8c1-4819-99d5-c10c7fff7627]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:11 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:32:11 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZfiNbQJv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:32:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:11 user nova-compute[71321]: DEBUG nova.compute.manager [req-caef5a42-5dcb-4832-9bdb-478fcf35f34c req-18380b80-9291-4e79-a169-094c924efecf service nova] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Received event network-vif-plugged-69203d15-c034-4d74-915d-1fc13c89ee40 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:32:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-caef5a42-5dcb-4832-9bdb-478fcf35f34c req-18380b80-9291-4e79-a169-094c924efecf service nova] Acquiring lock "540a69c0-488f-40cb-bdde-3e410029d4c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-caef5a42-5dcb-4832-9bdb-478fcf35f34c req-18380b80-9291-4e79-a169-094c924efecf service nova] Lock "540a69c0-488f-40cb-bdde-3e410029d4c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-caef5a42-5dcb-4832-9bdb-478fcf35f34c req-18380b80-9291-4e79-a169-094c924efecf service nova] Lock "540a69c0-488f-40cb-bdde-3e410029d4c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:11 user nova-compute[71321]: DEBUG nova.compute.manager [req-caef5a42-5dcb-4832-9bdb-478fcf35f34c req-18380b80-9291-4e79-a169-094c924efecf service nova] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] No waiting events found dispatching network-vif-plugged-69203d15-c034-4d74-915d-1fc13c89ee40 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:32:11 user nova-compute[71321]: WARNING nova.compute.manager [req-caef5a42-5dcb-4832-9bdb-478fcf35f34c req-18380b80-9291-4e79-a169-094c924efecf service nova] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Received unexpected event network-vif-plugged-69203d15-c034-4d74-915d-1fc13c89ee40 for instance with vm_state active and task_state deleting.
Apr 12 12:32:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:12 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:32:12 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '23065636330303865', 'path': '/dev/sdc'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:32:12 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065636330303865', 'path': '/dev/sdc'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:32:12 user nova-compute[71321]: DEBUG nova.objects.instance [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lazy-loading 'flavor' on Instance uuid d584edf2-12e3-48d1-947f-fdfb0c9c7377 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:32:12 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 12:32:12 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:32:12 user nova-compute[71321]:   <source dev="/dev/sdc"/>
Apr 12 12:32:12 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:32:12 user nova-compute[71321]:   <serial>449d635d-4ec1-4536-8979-33cea2764dad</serial>
Apr 12 12:32:12 user nova-compute[71321]: </disk>
Apr 12 12:32:12 user nova-compute[71321]:  {{(pid=71321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 12:32:12 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:32:12 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:32:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-839e85a2-f7af-482d-a5e6-09195888300e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:32:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-839e85a2-f7af-482d-a5e6-09195888300e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:32:12 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 12:32:12 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:32:12 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:32:12 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] No VIF found with MAC fa:16:3e:eb:10:b5, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:32:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.433s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:13 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:32:13 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Took 2.84 seconds to deallocate network for instance.
Apr 12 12:32:13 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302733.532547, cda12475-d730-4c07-af54-a3a64482fc94 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:32:13 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: cda12475-d730-4c07-af54-a3a64482fc94] VM Resumed (Lifecycle Event)
Apr 12 12:32:13 user nova-compute[71321]: DEBUG nova.compute.manager [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:32:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:32:13 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Instance spawned successfully.
Apr 12 12:32:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:32:13 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:32:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-cad88d40-b4d6-4fc6-9099-60affb54b4e3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-cad88d40-b4d6-4fc6-9099-60affb54b4e3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:13 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:32:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:32:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:32:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:32:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:32:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:32:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:32:13 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: cda12475-d730-4c07-af54-a3a64482fc94] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:32:13 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302733.5395248, cda12475-d730-4c07-af54-a3a64482fc94 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:32:13 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: cda12475-d730-4c07-af54-a3a64482fc94] VM Started (Lifecycle Event)
Apr 12 12:32:13 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:32:13 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:32:13 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: cda12475-d730-4c07-af54-a3a64482fc94] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:32:13 user nova-compute[71321]: INFO nova.compute.manager [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Took 5.92 seconds to spawn the instance on the hypervisor.
Apr 12 12:32:13 user nova-compute[71321]: DEBUG nova.compute.manager [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:32:13 user nova-compute[71321]: INFO nova.compute.manager [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Took 11.51 seconds to build instance.
Apr 12 12:32:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "cda12475-d730-4c07-af54-a3a64482fc94" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.611s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:13 user nova-compute[71321]: DEBUG nova.compute.manager [req-c52418a3-9a96-4cac-8ae3-ca7878ddd3a1 req-9265560a-080c-4aec-8816-37778b90ae03 service nova] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Received event network-vif-plugged-00018f63-5e54-484b-beb9-e2aa082e0e5c {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:32:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c52418a3-9a96-4cac-8ae3-ca7878ddd3a1 req-9265560a-080c-4aec-8816-37778b90ae03 service nova] Acquiring lock "cda12475-d730-4c07-af54-a3a64482fc94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c52418a3-9a96-4cac-8ae3-ca7878ddd3a1 req-9265560a-080c-4aec-8816-37778b90ae03 service nova] Lock "cda12475-d730-4c07-af54-a3a64482fc94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c52418a3-9a96-4cac-8ae3-ca7878ddd3a1 req-9265560a-080c-4aec-8816-37778b90ae03 service nova] Lock "cda12475-d730-4c07-af54-a3a64482fc94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:13 user nova-compute[71321]: DEBUG nova.compute.manager [req-c52418a3-9a96-4cac-8ae3-ca7878ddd3a1 req-9265560a-080c-4aec-8816-37778b90ae03 service nova] [instance: cda12475-d730-4c07-af54-a3a64482fc94] No waiting events found dispatching network-vif-plugged-00018f63-5e54-484b-beb9-e2aa082e0e5c {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:32:13 user nova-compute[71321]: WARNING nova.compute.manager [req-c52418a3-9a96-4cac-8ae3-ca7878ddd3a1 req-9265560a-080c-4aec-8816-37778b90ae03 service nova] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Received unexpected event network-vif-plugged-00018f63-5e54-484b-beb9-e2aa082e0e5c for instance with vm_state active and task_state None.
Apr 12 12:32:13 user nova-compute[71321]: DEBUG nova.compute.manager [req-c52418a3-9a96-4cac-8ae3-ca7878ddd3a1 req-9265560a-080c-4aec-8816-37778b90ae03 service nova] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Received event network-vif-deleted-69203d15-c034-4d74-915d-1fc13c89ee40 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:32:13 user nova-compute[71321]: DEBUG nova.compute.manager [req-c52418a3-9a96-4cac-8ae3-ca7878ddd3a1 req-9265560a-080c-4aec-8816-37778b90ae03 service nova] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Received event network-vif-plugged-00018f63-5e54-484b-beb9-e2aa082e0e5c {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:32:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c52418a3-9a96-4cac-8ae3-ca7878ddd3a1 req-9265560a-080c-4aec-8816-37778b90ae03 service nova] Acquiring lock "cda12475-d730-4c07-af54-a3a64482fc94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c52418a3-9a96-4cac-8ae3-ca7878ddd3a1 req-9265560a-080c-4aec-8816-37778b90ae03 service nova] Lock "cda12475-d730-4c07-af54-a3a64482fc94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c52418a3-9a96-4cac-8ae3-ca7878ddd3a1 req-9265560a-080c-4aec-8816-37778b90ae03 service nova] Lock "cda12475-d730-4c07-af54-a3a64482fc94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:13 user nova-compute[71321]: DEBUG nova.compute.manager [req-c52418a3-9a96-4cac-8ae3-ca7878ddd3a1 req-9265560a-080c-4aec-8816-37778b90ae03 service nova] [instance: cda12475-d730-4c07-af54-a3a64482fc94] No waiting events found dispatching network-vif-plugged-00018f63-5e54-484b-beb9-e2aa082e0e5c {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:32:13 user nova-compute[71321]: WARNING nova.compute.manager [req-c52418a3-9a96-4cac-8ae3-ca7878ddd3a1 req-9265560a-080c-4aec-8816-37778b90ae03 service nova] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Received unexpected event network-vif-plugged-00018f63-5e54-484b-beb9-e2aa082e0e5c for instance with vm_state active and task_state None.
Apr 12 12:32:13 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-cad88d40-b4d6-4fc6-9099-60affb54b4e3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:32:14 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-cad88d40-b4d6-4fc6-9099-60affb54b4e3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:32:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-cad88d40-b4d6-4fc6-9099-60affb54b4e3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.479s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:14 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-cad88d40-b4d6-4fc6-9099-60affb54b4e3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Deleted allocations for instance 540a69c0-488f-40cb-bdde-3e410029d4c8
Apr 12 12:32:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-cad88d40-b4d6-4fc6-9099-60affb54b4e3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "540a69c0-488f-40cb-bdde-3e410029d4c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.941s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:14 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Updating instance_info_cache with network_info: [{"id": "b5f18af0-544d-4978-b20e-85da7e880834", "address": "fa:16:3e:f7:93:c8", "network": {"id": "b6e89fad-c9f7-473e-ab76-3f005281cc95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-175129642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1faa529d424800900e10a7ceaa63d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f18af0-54", "ovs_interfaceid": "b5f18af0-544d-4978-b20e-85da7e880834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:32:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-839e85a2-f7af-482d-a5e6-09195888300e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:32:14 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 12:32:14 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:32:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:14 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:32:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "546c0c08-35f1-4043-ac30-56d49bc86af1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:14 user nova-compute[71321]: DEBUG nova.objects.instance [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lazy-loading 'flavor' on Instance uuid 546c0c08-35f1-4043-ac30-56d49bc86af1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:32:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.142s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "546c0c08-35f1-4043-ac30-56d49bc86af1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:15 user nova-compute[71321]: INFO nova.compute.manager [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Attaching volume a2a363ad-a0a5-4076-9530-5488fad60936 to /dev/vdb
Apr 12 12:32:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:15 user nova-compute[71321]: DEBUG os_brick.utils [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:32:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:15 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec11939-4c42-4b3b-bff7-7438ca82e740]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:15 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[19eb4975-c764-4ead-866f-33913a4ec742]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:15 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcb5469-41cf-4147-823b-846c6b00920c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:15 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da6345c-bf9e-4b1e-b373-b795136f32cd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:32:15 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:32:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:32:15 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:32:15 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f2ba95-6055-41e8-b2d9-f65251e49b29]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:15 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:32:15 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:32:15 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:32:15 user nova-compute[71321]: DEBUG os_brick.utils [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] <== get_connector_properties: return (194ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:32:15 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Updating existing volume attachment record: dd102825-5c65-49b4-8b76-237a0e54a0de {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:32:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:32:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:32:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49339083-8dd4-454b-b7aa-73d91238bef4/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49339083-8dd4-454b-b7aa-73d91238bef4/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49339083-8dd4-454b-b7aa-73d91238bef4/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49339083-8dd4-454b-b7aa-73d91238bef4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:17 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:32:17 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:32:17 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=7865MB free_disk=26.592544555664062GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:32:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 10116da0-785c-41cf-96bb-95721af863db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:32:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance a4107f2d-88e4-4846-9ece-cb16ad7ecd02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:32:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:32:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 839e85a2-f7af-482d-a5e6-09195888300e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:32:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:32:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 49339083-8dd4-454b-b7aa-73d91238bef4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:32:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance cda12475-d730-4c07-af54-a3a64482fc94 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:32:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:32:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:32:18 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:32:18 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:32:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:32:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.789s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "c5b9b1bb-a3d9-4073-8d49-70360dae6f29" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "c5b9b1bb-a3d9-4073-8d49-70360dae6f29" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:18 user nova-compute[71321]: DEBUG nova.compute.manager [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:32:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:19 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:32:19 user nova-compute[71321]: INFO nova.compute.claims [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Claim successful on node user
Apr 12 12:32:19 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:32:19 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:32:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:19 user nova-compute[71321]: DEBUG nova.compute.manager [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:32:19 user nova-compute[71321]: DEBUG nova.compute.manager [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:32:19 user nova-compute[71321]: DEBUG nova.network.neutron [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:32:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "839e85a2-f7af-482d-a5e6-09195888300e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "839e85a2-f7af-482d-a5e6-09195888300e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:19 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:32:19 user nova-compute[71321]: DEBUG nova.objects.instance [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lazy-loading 'flavor' on Instance uuid 839e85a2-f7af-482d-a5e6-09195888300e {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:32:19 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:32:19 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:32:19 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:32:19 user nova-compute[71321]: DEBUG nova.compute.manager [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:32:19 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:32:19 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:32:19 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:32:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "839e85a2-f7af-482d-a5e6-09195888300e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:19 user nova-compute[71321]: DEBUG nova.policy [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3a887c10bf74974a648e3ec048fcdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d607e0aed1f47129540181261c6ebc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:32:19 user nova-compute[71321]: DEBUG nova.compute.manager [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:32:19 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:32:19 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Creating image(s)
Apr 12 12:32:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "/opt/stack/data/nova/instances/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "/opt/stack/data/nova/instances/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "/opt/stack/data/nova/instances/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.142s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "839e85a2-f7af-482d-a5e6-09195888300e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "839e85a2-f7af-482d-a5e6-09195888300e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:20 user nova-compute[71321]: INFO nova.compute.manager [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Attaching volume e2586924-e0c3-4908-8f2c-7375bf258d7f to /dev/vdb
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.172s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/disk 1073741824" returned: 0 in 0.062s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG os_brick.utils [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa71ace2-87fe-40a7-9274-2ce3b89dceeb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c323d3-4cdd-4532-9b50-d2aebdddffe5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c879f6-7077-4a6b-814f-cc3c6ea9b173]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea7bc98-9e8f-4bd6-98e0-3fb624bb6207]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.195s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:32:20 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7302314d-da51-423b-9860-e853f30fed8b]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG os_brick.utils [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] <== get_connector_properties: return (192ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Updating existing volume attachment record: 568500b3-3231-48ad-b164-f3c519fdf666 {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVztbEhi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:32:20 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:32:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:32:20 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:32:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:32:20 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adf5f12-f80c-4ecc-92e3-067fd4e6c570]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:32:20 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfc44fb-ac82-4311-8a76-31a9ea2b6352]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936] added
Apr 12 12:32:20 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Cannot resize image /opt/stack/data/nova/instances/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG nova.objects.instance [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lazy-loading 'migration_context' on Instance uuid c5b9b1bb-a3d9-4073-8d49-70360dae6f29 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ed71b8-8d76-4873-a410-f03ea2440be0]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Ensure instance console log exists: /opt/stack/data/nova/instances/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[29539d02-4726-431d-bf6a-d1f364e01ce5]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AVztbEhi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AVztbEhi" returned: 0 in 0.027s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8491b6-73ec-4749-82ae-2f733cab430d]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AVztbEhi'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c4f87c-254d-44e6-aa38-bcf074dd5833]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3903dad-9a08-4ad9-9905-9ef2c0d938c7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:32:20 user nova-compute[71321]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad (non-flash)
Apr 12 12:32:20 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:32:20 user nova-compute[71321]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad (non-flash)
Apr 12 12:32:20 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG nova.network.neutron [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Successfully created port: 33441356-cd95-4247-86bb-3f49f00d8e81 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c4e416-83ba-45da-a656-ebe3a6dbfb66]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936, portal: 172.16.0.220,3260]
Apr 12 12:32:20 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936, portal: 172.16.0.220,3260] successful.
Apr 12 12:32:20 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7f73ce-5978-49bb-a4c0-56ac7a70a5ae]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8394c3a0-2a81-4909-938f-4189aad34779]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:32:20 user nova-compute[71321]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad (non-flash)
Apr 12 12:32:20 user nova-compute[71321]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:32:20 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:32:20 user nova-compute[71321]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad (non-flash)
Apr 12 12:32:20 user nova-compute[71321]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:32:20 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6110a1-a87b-4a70-8f21-ae2935b63702]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:32:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVztbEhi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:32:21 user nova-compute[71321]: DEBUG nova.network.neutron [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Successfully updated port: 33441356-cd95-4247-86bb-3f49f00d8e81 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:32:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "refresh_cache-c5b9b1bb-a3d9-4073-8d49-70360dae6f29" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:32:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquired lock "refresh_cache-c5b9b1bb-a3d9-4073-8d49-70360dae6f29" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:32:21 user nova-compute[71321]: DEBUG nova.network.neutron [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:32:21 user nova-compute[71321]: DEBUG nova.compute.manager [req-f67f2482-1fc8-4c08-abe9-b4d92ff26b10 req-dc6fe6ea-9564-48ff-9ded-1ec2adfffe75 service nova] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Received event network-changed-33441356-cd95-4247-86bb-3f49f00d8e81 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:32:21 user nova-compute[71321]: DEBUG nova.compute.manager [req-f67f2482-1fc8-4c08-abe9-b4d92ff26b10 req-dc6fe6ea-9564-48ff-9ded-1ec2adfffe75 service nova] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Refreshing instance network info cache due to event network-changed-33441356-cd95-4247-86bb-3f49f00d8e81. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:32:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f67f2482-1fc8-4c08-abe9-b4d92ff26b10 req-dc6fe6ea-9564-48ff-9ded-1ec2adfffe75 service nova] Acquiring lock "refresh_cache-c5b9b1bb-a3d9-4073-8d49-70360dae6f29" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:32:21 user nova-compute[71321]: DEBUG nova.network.neutron [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:32:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:32:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '23434353437643265', 'path': '/dev/sdd'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:32:21 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434353437643265', 'path': '/dev/sdd'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:32:21 user nova-compute[71321]: DEBUG nova.objects.instance [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lazy-loading 'flavor' on Instance uuid 546c0c08-35f1-4043-ac30-56d49bc86af1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:32:21 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 12:32:21 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:32:21 user nova-compute[71321]:   <source dev="/dev/sdd"/>
Apr 12 12:32:21 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:32:21 user nova-compute[71321]:   <serial>a2a363ad-a0a5-4076-9530-5488fad60936</serial>
Apr 12 12:32:21 user nova-compute[71321]: </disk>
Apr 12 12:32:21 user nova-compute[71321]:  {{(pid=71321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.network.neutron [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Updating instance_info_cache with network_info: [{"id": "33441356-cd95-4247-86bb-3f49f00d8e81", "address": "fa:16:3e:9a:89:f9", "network": {"id": "6e43ca53-1563-43b0-84cc-d3f759c61c37", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-908305790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d607e0aed1f47129540181261c6ebc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33441356-cd", "ovs_interfaceid": "33441356-cd95-4247-86bb-3f49f00d8e81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Releasing lock "refresh_cache-c5b9b1bb-a3d9-4073-8d49-70360dae6f29" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.compute.manager [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Instance network_info: |[{"id": "33441356-cd95-4247-86bb-3f49f00d8e81", "address": "fa:16:3e:9a:89:f9", "network": {"id": "6e43ca53-1563-43b0-84cc-d3f759c61c37", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-908305790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d607e0aed1f47129540181261c6ebc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33441356-cd", "ovs_interfaceid": "33441356-cd95-4247-86bb-3f49f00d8e81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f67f2482-1fc8-4c08-abe9-b4d92ff26b10 req-dc6fe6ea-9564-48ff-9ded-1ec2adfffe75 service nova] Acquired lock "refresh_cache-c5b9b1bb-a3d9-4073-8d49-70360dae6f29" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.network.neutron [req-f67f2482-1fc8-4c08-abe9-b4d92ff26b10 req-dc6fe6ea-9564-48ff-9ded-1ec2adfffe75 service nova] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Refreshing network info cache for port 33441356-cd95-4247-86bb-3f49f00d8e81 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Start _get_guest_xml network_info=[{"id": "33441356-cd95-4247-86bb-3f49f00d8e81", "address": "fa:16:3e:9a:89:f9", "network": {"id": "6e43ca53-1563-43b0-84cc-d3f759c61c37", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-908305790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d607e0aed1f47129540181261c6ebc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33441356-cd", "ovs_interfaceid": "33441356-cd95-4247-86bb-3f49f00d8e81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:32:22 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:32:22 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1385172831',display_name='tempest-VolumesAdminNegativeTest-server-1385172831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1385172831',id=15,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwfNw+fvD7X4C2arQ/IOvs3K4y/lgQ5Pq3fO+j5VSF5Rg09hb2/k2StMjL05qEGcPBIk8YLKdGWWdEzgPlfvaKjg/N0ZO7tOTPs9daq6f05+grV+GuA4jxUJKEMKKnlXA==',key_name='tempest-keypair-323125528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d607e0aed1f47129540181261c6ebc7',ramdisk_id='',reservation_id='r-nch0ks96',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-714206228',owner_user_name='tempest-VolumesAdminNegativeTest-714206228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:32:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3a887c10bf74974a648e3ec048fcdd7',uuid=c5b9b1bb-a3d9-4073-8d49-70360dae6f29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33441356-cd95-4247-86bb-3f49f00d8e81", "address": "fa:16:3e:9a:89:f9", "network": {"id": "6e43ca53-1563-43b0-84cc-d3f759c61c37", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-908305790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d607e0aed1f47129540181261c6ebc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33441356-cd", "ovs_interfaceid": "33441356-cd95-4247-86bb-3f49f00d8e81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Converting VIF {"id": "33441356-cd95-4247-86bb-3f49f00d8e81", "address": "fa:16:3e:9a:89:f9", "network": {"id": "6e43ca53-1563-43b0-84cc-d3f759c61c37", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-908305790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d607e0aed1f47129540181261c6ebc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33441356-cd", "ovs_interfaceid": "33441356-cd95-4247-86bb-3f49f00d8e81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:89:f9,bridge_name='br-int',has_traffic_filtering=True,id=33441356-cd95-4247-86bb-3f49f00d8e81,network=Network(6e43ca53-1563-43b0-84cc-d3f759c61c37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33441356-cd') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.objects.instance [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lazy-loading 'pci_devices' on Instance uuid c5b9b1bb-a3d9-4073-8d49-70360dae6f29 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:32:22 user nova-compute[71321]:   <uuid>c5b9b1bb-a3d9-4073-8d49-70360dae6f29</uuid>
Apr 12 12:32:22 user nova-compute[71321]:   <name>instance-0000000f</name>
Apr 12 12:32:22 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:32:22 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:32:22 user nova-compute[71321]:   <metadata>
Apr 12 12:32:22 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:32:22 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:32:22 user nova-compute[71321]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1385172831</nova:name>
Apr 12 12:32:22 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:32:22</nova:creationTime>
Apr 12 12:32:22 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:32:22 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:32:22 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:32:22 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:32:22 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:32:22 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:32:22 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:32:22 user nova-compute[71321]:       <nova:owner>
Apr 12 12:32:22 user nova-compute[71321]:         <nova:user uuid="b3a887c10bf74974a648e3ec048fcdd7">tempest-VolumesAdminNegativeTest-714206228-project-member</nova:user>
Apr 12 12:32:22 user nova-compute[71321]:         <nova:project uuid="7d607e0aed1f47129540181261c6ebc7">tempest-VolumesAdminNegativeTest-714206228</nova:project>
Apr 12 12:32:22 user nova-compute[71321]:       </nova:owner>
Apr 12 12:32:22 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:32:22 user nova-compute[71321]:       <nova:ports>
Apr 12 12:32:22 user nova-compute[71321]:         <nova:port uuid="33441356-cd95-4247-86bb-3f49f00d8e81">
Apr 12 12:32:22 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 12:32:22 user nova-compute[71321]:         </nova:port>
Apr 12 12:32:22 user nova-compute[71321]:       </nova:ports>
Apr 12 12:32:22 user nova-compute[71321]:     </nova:instance>
Apr 12 12:32:22 user nova-compute[71321]:   </metadata>
Apr 12 12:32:22 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:32:22 user nova-compute[71321]:     <system>
Apr 12 12:32:22 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:32:22 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:32:22 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:32:22 user nova-compute[71321]:       <entry name="serial">c5b9b1bb-a3d9-4073-8d49-70360dae6f29</entry>
Apr 12 12:32:22 user nova-compute[71321]:       <entry name="uuid">c5b9b1bb-a3d9-4073-8d49-70360dae6f29</entry>
Apr 12 12:32:22 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:32:22 user nova-compute[71321]:     </system>
Apr 12 12:32:22 user nova-compute[71321]:   </sysinfo>
Apr 12 12:32:22 user nova-compute[71321]:   <os>
Apr 12 12:32:22 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:32:22 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:32:22 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:32:22 user nova-compute[71321]:   </os>
Apr 12 12:32:22 user nova-compute[71321]:   <features>
Apr 12 12:32:22 user nova-compute[71321]:     <acpi/>
Apr 12 12:32:22 user nova-compute[71321]:     <apic/>
Apr 12 12:32:22 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:32:22 user nova-compute[71321]:   </features>
Apr 12 12:32:22 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:32:22 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:32:22 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:32:22 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:32:22 user nova-compute[71321]:   </clock>
Apr 12 12:32:22 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:32:22 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:32:22 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:32:22 user nova-compute[71321]:   </cpu>
Apr 12 12:32:22 user nova-compute[71321]:   <devices>
Apr 12 12:32:22 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:32:22 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:32:22 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/disk"/>
Apr 12 12:32:22 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:32:22 user nova-compute[71321]:     </disk>
Apr 12 12:32:22 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:32:22 user nova-compute[71321]:       <mac address="fa:16:3e:9a:89:f9"/>
Apr 12 12:32:22 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:32:22 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:32:22 user nova-compute[71321]:       <target dev="tap33441356-cd"/>
Apr 12 12:32:22 user nova-compute[71321]:     </interface>
Apr 12 12:32:22 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:32:22 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/console.log" append="off"/>
Apr 12 12:32:22 user nova-compute[71321]:     </serial>
Apr 12 12:32:22 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:32:22 user nova-compute[71321]:     <video>
Apr 12 12:32:22 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:32:22 user nova-compute[71321]:     </video>
Apr 12 12:32:22 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:32:22 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:32:22 user nova-compute[71321]:     </rng>
Apr 12 12:32:22 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:32:22 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:32:22 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:32:22 user nova-compute[71321]:     </memballoon>
Apr 12 12:32:22 user nova-compute[71321]:   </devices>
Apr 12 12:32:22 user nova-compute[71321]: </domain>
Apr 12 12:32:22 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1385172831',display_name='tempest-VolumesAdminNegativeTest-server-1385172831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1385172831',id=15,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwfNw+fvD7X4C2arQ/IOvs3K4y/lgQ5Pq3fO+j5VSF5Rg09hb2/k2StMjL05qEGcPBIk8YLKdGWWdEzgPlfvaKjg/N0ZO7tOTPs9daq6f05+grV+GuA4jxUJKEMKKnlXA==',key_name='tempest-keypair-323125528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d607e0aed1f47129540181261c6ebc7',ramdisk_id='',reservation_id='r-nch0ks96',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-714206228',owner_user_name='tempest-VolumesAdminNegativeTest-714206228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:32:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3a887c10bf74974a648e3ec048fcdd7',uuid=c5b9b1bb-a3d9-4073-8d49-70360dae6f29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33441356-cd95-4247-86bb-3f49f00d8e81", "address": "fa:16:3e:9a:89:f9", "network": {"id": "6e43ca53-1563-43b0-84cc-d3f759c61c37", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-908305790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d607e0aed1f47129540181261c6ebc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33441356-cd", "ovs_interfaceid": "33441356-cd95-4247-86bb-3f49f00d8e81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Converting VIF {"id": "33441356-cd95-4247-86bb-3f49f00d8e81", "address": "fa:16:3e:9a:89:f9", "network": {"id": "6e43ca53-1563-43b0-84cc-d3f759c61c37", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-908305790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d607e0aed1f47129540181261c6ebc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33441356-cd", "ovs_interfaceid": "33441356-cd95-4247-86bb-3f49f00d8e81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:89:f9,bridge_name='br-int',has_traffic_filtering=True,id=33441356-cd95-4247-86bb-3f49f00d8e81,network=Network(6e43ca53-1563-43b0-84cc-d3f759c61c37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33441356-cd') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG os_vif [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:89:f9,bridge_name='br-int',has_traffic_filtering=True,id=33441356-cd95-4247-86bb-3f49f00d8e81,network=Network(6e43ca53-1563-43b0-84cc-d3f759c61c37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33441356-cd') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33441356-cd, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap33441356-cd, col_values=(('external_ids', {'iface-id': '33441356-cd95-4247-86bb-3f49f00d8e81', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:89:f9', 'vm-uuid': 'c5b9b1bb-a3d9-4073-8d49-70360dae6f29'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:22 user nova-compute[71321]: INFO os_vif [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:89:f9,bridge_name='br-int',has_traffic_filtering=True,id=33441356-cd95-4247-86bb-3f49f00d8e81,network=Network(6e43ca53-1563-43b0-84cc-d3f759c61c37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33441356-cd')
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] No VIF found with MAC fa:16:3e:9a:89:f9, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] No VIF found with MAC fa:16:3e:14:16:c4, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.361s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.network.neutron [req-f67f2482-1fc8-4c08-abe9-b4d92ff26b10 req-dc6fe6ea-9564-48ff-9ded-1ec2adfffe75 service nova] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Updated VIF entry in instance network info cache for port 33441356-cd95-4247-86bb-3f49f00d8e81. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.network.neutron [req-f67f2482-1fc8-4c08-abe9-b4d92ff26b10 req-dc6fe6ea-9564-48ff-9ded-1ec2adfffe75 service nova] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Updating instance_info_cache with network_info: [{"id": "33441356-cd95-4247-86bb-3f49f00d8e81", "address": "fa:16:3e:9a:89:f9", "network": {"id": "6e43ca53-1563-43b0-84cc-d3f759c61c37", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-908305790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d607e0aed1f47129540181261c6ebc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33441356-cd", "ovs_interfaceid": "33441356-cd95-4247-86bb-3f49f00d8e81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f67f2482-1fc8-4c08-abe9-b4d92ff26b10 req-dc6fe6ea-9564-48ff-9ded-1ec2adfffe75 service nova] Releasing lock "refresh_cache-c5b9b1bb-a3d9-4073-8d49-70360dae6f29" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:22 user nova-compute[71321]: INFO nova.compute.manager [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Detaching volume 449d635d-4ec1-4536-8979-33cea2764dad
Apr 12 12:32:22 user nova-compute[71321]: INFO nova.virt.block_device [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Attempting to driver detach volume 449d635d-4ec1-4536-8979-33cea2764dad from mountpoint /dev/vdb
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Attempting to detach device vdb from instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 from the persistent domain config. {{(pid=71321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:32:22 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:32:22 user nova-compute[71321]:   <source dev="/dev/sdc"/>
Apr 12 12:32:22 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:32:22 user nova-compute[71321]:   <serial>449d635d-4ec1-4536-8979-33cea2764dad</serial>
Apr 12 12:32:22 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 12:32:22 user nova-compute[71321]: </disk>
Apr 12 12:32:22 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:32:22 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Successfully detached device vdb from instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 from the persistent domain config.
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 from the live domain config. {{(pid=71321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 12:32:22 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:32:22 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:32:22 user nova-compute[71321]:   <source dev="/dev/sdc"/>
Apr 12 12:32:22 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:32:22 user nova-compute[71321]:   <serial>449d635d-4ec1-4536-8979-33cea2764dad</serial>
Apr 12 12:32:22 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 12:32:22 user nova-compute[71321]: </disk>
Apr 12 12:32:22 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Received event <DeviceRemovedEvent: 1681302743.571562, d584edf2-12e3-48d1-947f-fdfb0c9c7377 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 {{(pid=71321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 12:32:23 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Successfully detached device vdb from instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 from the live domain config.
Apr 12 12:32:23 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZfiNbQJv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:32:23 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:32:23 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63dff48-09e7-4368-a5be-4c53c7654adc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:32:23 user nova-compute[71321]: No targets found.
Apr 12 12:32:23 user nova-compute[71321]: iSNS:
Apr 12 12:32:23 user nova-compute[71321]: No targets found.
Apr 12 12:32:23 user nova-compute[71321]: STATIC:
Apr 12 12:32:23 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad
Apr 12 12:32:23 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:32:23 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:32:23 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54
Apr 12 12:32:23 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:32:23 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:32:23 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936
Apr 12 12:32:23 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:32:23 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:32:23 user nova-compute[71321]: FIRMWARE:
Apr 12 12:32:23 user nova-compute[71321]: No targets found.
Apr 12 12:32:23 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:32:23 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:32:23 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b99ecf5-41ef-47db-b010-5fe611035bc8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f4cbd9-83d1-4406-b0e8-bd2878865963]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:32:23 user nova-compute[71321]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad (non-flash)
Apr 12 12:32:23 user nova-compute[71321]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:32:23 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:32:23 user nova-compute[71321]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad (non-flash)
Apr 12 12:32:23 user nova-compute[71321]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:32:23 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef447370a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad'): ({'sdc'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Removing single pathed devices sdc {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2419c40-9fd9-435b-909a-5ff688832dee]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[beeac270-87bf-4987-bd5d-dafbe904eed7]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Flushing IO for device /dev/sdc {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c26cf50-4bbc-4e82-b980-90c000a86669]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd8ac43-75ed-468f-9da0-1bd41b3a6f56]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] SCSI volumes sdc have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c77bdab-3ad4-4235-867b-a5deda589646]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b004e345-a239-4f13-b797-2753c407883b]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad, portal: 172.16.0.220,3260]
Apr 12 12:32:23 user nova-compute[71321]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad, portal: 172.16.0.220,3260] successful.
Apr 12 12:32:23 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:449d635d-4ec1-4536-8979-33cea2764dad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7064f980-41d1-4e49-8548-64405f2ceb3e]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] <== disconnect_volume: return (379ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:32:23 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:24 user nova-compute[71321]: INFO nova.compute.manager [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Rebuilding instance
Apr 12 12:32:24 user nova-compute[71321]: DEBUG nova.objects.instance [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lazy-loading 'trusted_certs' on Instance uuid 546c0c08-35f1-4043-ac30-56d49bc86af1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:32:24 user nova-compute[71321]: DEBUG nova.compute.manager [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:32:24 user nova-compute[71321]: DEBUG nova.objects.instance [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lazy-loading 'pci_requests' on Instance uuid 546c0c08-35f1-4043-ac30-56d49bc86af1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:32:24 user nova-compute[71321]: DEBUG nova.objects.instance [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lazy-loading 'pci_devices' on Instance uuid 546c0c08-35f1-4043-ac30-56d49bc86af1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:32:24 user nova-compute[71321]: DEBUG nova.objects.instance [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lazy-loading 'resources' on Instance uuid 546c0c08-35f1-4043-ac30-56d49bc86af1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:32:24 user nova-compute[71321]: DEBUG nova.compute.manager [req-84c9c06d-b548-452b-95d4-120029272ce1 req-915bf633-e5c3-4feb-9601-79b2ac257b4c service nova] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Received event network-vif-plugged-33441356-cd95-4247-86bb-3f49f00d8e81 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:32:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-84c9c06d-b548-452b-95d4-120029272ce1 req-915bf633-e5c3-4feb-9601-79b2ac257b4c service nova] Acquiring lock "c5b9b1bb-a3d9-4073-8d49-70360dae6f29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-84c9c06d-b548-452b-95d4-120029272ce1 req-915bf633-e5c3-4feb-9601-79b2ac257b4c service nova] Lock "c5b9b1bb-a3d9-4073-8d49-70360dae6f29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-84c9c06d-b548-452b-95d4-120029272ce1 req-915bf633-e5c3-4feb-9601-79b2ac257b4c service nova] Lock "c5b9b1bb-a3d9-4073-8d49-70360dae6f29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:24 user nova-compute[71321]: DEBUG nova.compute.manager [req-84c9c06d-b548-452b-95d4-120029272ce1 req-915bf633-e5c3-4feb-9601-79b2ac257b4c service nova] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] No waiting events found dispatching network-vif-plugged-33441356-cd95-4247-86bb-3f49f00d8e81 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:32:24 user nova-compute[71321]: WARNING nova.compute.manager [req-84c9c06d-b548-452b-95d4-120029272ce1 req-915bf633-e5c3-4feb-9601-79b2ac257b4c service nova] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Received unexpected event network-vif-plugged-33441356-cd95-4247-86bb-3f49f00d8e81 for instance with vm_state building and task_state spawning.
Apr 12 12:32:24 user nova-compute[71321]: DEBUG nova.objects.instance [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lazy-loading 'migration_context' on Instance uuid 546c0c08-35f1-4043-ac30-56d49bc86af1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:32:24 user nova-compute[71321]: DEBUG nova.objects.instance [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71321) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 12 12:32:24 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:24 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:24 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:24 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:24 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:24 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:24 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:24 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:24 user nova-compute[71321]: DEBUG nova.objects.instance [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lazy-loading 'flavor' on Instance uuid d584edf2-12e3-48d1-947f-fdfb0c9c7377 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:32:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.279s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:25 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Instance destroyed successfully.
Apr 12 12:32:25 user nova-compute[71321]: INFO nova.compute.manager [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Detaching volume a2a363ad-a0a5-4076-9530-5488fad60936
Apr 12 12:32:25 user nova-compute[71321]: INFO nova.virt.block_device [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Attempting to driver detach volume a2a363ad-a0a5-4076-9530-5488fad60936 from mountpoint /dev/vdb
Apr 12 12:32:25 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Attempting to detach device vdb from instance 546c0c08-35f1-4043-ac30-56d49bc86af1 from the persistent domain config. {{(pid=71321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:32:25 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:32:25 user nova-compute[71321]:   <source dev="/dev/sdd"/>
Apr 12 12:32:25 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:32:25 user nova-compute[71321]:   <serial>a2a363ad-a0a5-4076-9530-5488fad60936</serial>
Apr 12 12:32:25 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 12:32:25 user nova-compute[71321]: </disk>
Apr 12 12:32:25 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:32:25 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Successfully detached device vdb from instance 546c0c08-35f1-4043-ac30-56d49bc86af1 from the persistent domain config.
Apr 12 12:32:25 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVztbEhi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:32:25 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 12 12:32:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ee344d-0cbc-4a42-a3b5-3a76d0535ef9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:32:25 user nova-compute[71321]: No targets found.
Apr 12 12:32:25 user nova-compute[71321]: iSNS:
Apr 12 12:32:25 user nova-compute[71321]: No targets found.
Apr 12 12:32:25 user nova-compute[71321]: STATIC:
Apr 12 12:32:25 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54
Apr 12 12:32:25 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:32:25 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:32:25 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936
Apr 12 12:32:25 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:32:25 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:32:25 user nova-compute[71321]: FIRMWARE:
Apr 12 12:32:25 user nova-compute[71321]: No targets found.
Apr 12 12:32:25 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:32:25 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:32:25 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681302730.5243282, 540a69c0-488f-40cb-bdde-3e410029d4c8 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:32:25 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] VM Stopped (Lifecycle Event)
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[37854f95-5e15-48b6-bb4b-7b370b024756]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG nova.compute.manager [None req-17dcb22e-19bb-4cd5-bf7a-ddee4de239d2 None None] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe653d8-0580-4655-a39c-782cda4e18f8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:32:25 user nova-compute[71321]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:32:25 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:32:25 user nova-compute[71321]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:32:25 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef7c3a8040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936'): ({'sdd'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Removing single pathed devices sdd {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7218b13c-4845-4043-909d-3e76843767fa]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.033s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fd3528-aeff-488a-9ae6-e04fd3df1369]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Flushing IO for device /dev/sdd {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQumsNbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:32:25 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:32:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[70443067-ffcc-4382-a74b-28d516c1fdfd]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d20f42-1ba7-41ac-bc3f-2735248a1766]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] SCSI volumes sdd have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d06308-0b4f-43aa-b7b3-be80f444f15b]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d020e6ca-ec02-497c-a681-53f505bcd78d]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936, portal: 172.16.0.220,3260]
Apr 12 12:32:25 user nova-compute[71321]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936, portal: 172.16.0.220,3260] successful.
Apr 12 12:32:25 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bca20bf-0f6f-4ffa-9b1b-5881fb8009b8]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] <== disconnect_volume: return (413ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.214s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:32:25 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:32:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:32:25 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10c0a80-0a4c-44d4-bdb8-e7aefd160ce6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:32:25 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.034s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[614f41f7-a1b2-456e-8d94-e60aa1bb2031]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f] added
Apr 12 12:32:25 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c9c28f-5b25-4dc2-b228-b0c3299d17f6]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c9636b-41bf-4712-bfd2-7fc076424e8f]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kQumsNbd {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kQumsNbd" returned: 0 in 0.033s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc29201d-e282-4137-ba17-1012238dea14]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kQumsNbd'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87dc171-6457-4ba0-bb42-b3f0953c7c50]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd73a2c-d58d-4796-96bf-19288e4a82b1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:32:26 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:32:26 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[85eee12f-cd1d-472e-9b26-b8584c08fb42]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f, portal: 172.16.0.220,3260]
Apr 12 12:32:26 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f, portal: 172.16.0.220,3260] successful.
Apr 12 12:32:26 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edcf004-46fd-4da2-988c-d0b364f4dbca]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[201b41a9-325d-4664-a9ef-6381d1cbf4f8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:32:26 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:32:26 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:32:26 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:32:26 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1b74cb-3749-4d2b-b3cb-83fdb80f4dd4]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQumsNbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG nova.compute.manager [req-af4dcfbe-48f2-4c30-aee4-bb3bed327153 req-537dff4d-331f-4dd4-9afb-0ef153ac2cfd service nova] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Received event network-vif-plugged-33441356-cd95-4247-86bb-3f49f00d8e81 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-af4dcfbe-48f2-4c30-aee4-bb3bed327153 req-537dff4d-331f-4dd4-9afb-0ef153ac2cfd service nova] Acquiring lock "c5b9b1bb-a3d9-4073-8d49-70360dae6f29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-af4dcfbe-48f2-4c30-aee4-bb3bed327153 req-537dff4d-331f-4dd4-9afb-0ef153ac2cfd service nova] Lock "c5b9b1bb-a3d9-4073-8d49-70360dae6f29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-af4dcfbe-48f2-4c30-aee4-bb3bed327153 req-537dff4d-331f-4dd4-9afb-0ef153ac2cfd service nova] Lock "c5b9b1bb-a3d9-4073-8d49-70360dae6f29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG nova.compute.manager [req-af4dcfbe-48f2-4c30-aee4-bb3bed327153 req-537dff4d-331f-4dd4-9afb-0ef153ac2cfd service nova] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] No waiting events found dispatching network-vif-plugged-33441356-cd95-4247-86bb-3f49f00d8e81 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:32:26 user nova-compute[71321]: WARNING nova.compute.manager [req-af4dcfbe-48f2-4c30-aee4-bb3bed327153 req-537dff4d-331f-4dd4-9afb-0ef153ac2cfd service nova] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Received unexpected event network-vif-plugged-33441356-cd95-4247-86bb-3f49f00d8e81 for instance with vm_state building and task_state spawning.
Apr 12 12:32:26 user nova-compute[71321]: DEBUG nova.compute.manager [req-af4dcfbe-48f2-4c30-aee4-bb3bed327153 req-537dff4d-331f-4dd4-9afb-0ef153ac2cfd service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received event network-vif-unplugged-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-af4dcfbe-48f2-4c30-aee4-bb3bed327153 req-537dff4d-331f-4dd4-9afb-0ef153ac2cfd service nova] Acquiring lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-af4dcfbe-48f2-4c30-aee4-bb3bed327153 req-537dff4d-331f-4dd4-9afb-0ef153ac2cfd service nova] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-af4dcfbe-48f2-4c30-aee4-bb3bed327153 req-537dff4d-331f-4dd4-9afb-0ef153ac2cfd service nova] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG nova.compute.manager [req-af4dcfbe-48f2-4c30-aee4-bb3bed327153 req-537dff4d-331f-4dd4-9afb-0ef153ac2cfd service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] No waiting events found dispatching network-vif-unplugged-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:32:26 user nova-compute[71321]: WARNING nova.compute.manager [req-af4dcfbe-48f2-4c30-aee4-bb3bed327153 req-537dff4d-331f-4dd4-9afb-0ef153ac2cfd service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received unexpected event network-vif-unplugged-6f21df63-1895-4500-b119-c4670a7f3569 for instance with vm_state active and task_state rebuilding.
Apr 12 12:32:26 user nova-compute[71321]: DEBUG nova.compute.manager [req-af4dcfbe-48f2-4c30-aee4-bb3bed327153 req-537dff4d-331f-4dd4-9afb-0ef153ac2cfd service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received event network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-af4dcfbe-48f2-4c30-aee4-bb3bed327153 req-537dff4d-331f-4dd4-9afb-0ef153ac2cfd service nova] Acquiring lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-af4dcfbe-48f2-4c30-aee4-bb3bed327153 req-537dff4d-331f-4dd4-9afb-0ef153ac2cfd service nova] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-af4dcfbe-48f2-4c30-aee4-bb3bed327153 req-537dff4d-331f-4dd4-9afb-0ef153ac2cfd service nova] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG nova.compute.manager [req-af4dcfbe-48f2-4c30-aee4-bb3bed327153 req-537dff4d-331f-4dd4-9afb-0ef153ac2cfd service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] No waiting events found dispatching network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:32:26 user nova-compute[71321]: WARNING nova.compute.manager [req-af4dcfbe-48f2-4c30-aee4-bb3bed327153 req-537dff4d-331f-4dd4-9afb-0ef153ac2cfd service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received unexpected event network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 for instance with vm_state active and task_state rebuilding.
Apr 12 12:32:26 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302746.6830168, c5b9b1bb-a3d9-4073-8d49-70360dae6f29 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:32:26 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] VM Resumed (Lifecycle Event)
Apr 12 12:32:26 user nova-compute[71321]: DEBUG nova.compute.manager [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:32:26 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Instance spawned successfully.
Apr 12 12:32:26 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:32:26 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:32:26 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302746.6885273, c5b9b1bb-a3d9-4073-8d49-70360dae6f29 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:32:26 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] VM Started (Lifecycle Event)
Apr 12 12:32:26 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:32:26 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:32:26 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:32:26 user nova-compute[71321]: INFO nova.compute.manager [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Took 7.13 seconds to spawn the instance on the hypervisor.
Apr 12 12:32:26 user nova-compute[71321]: DEBUG nova.compute.manager [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:32:27 user nova-compute[71321]: INFO nova.compute.manager [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Took 8.03 seconds to build instance.
Apr 12 12:32:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "c5b9b1bb-a3d9-4073-8d49-70360dae6f29" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.206s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.437s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] <== connect_volume: return (1651ms) {'type': 'block', 'scsi_wwn': '26365373463303661', 'path': '/dev/sdc'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365373463303661', 'path': '/dev/sdc'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG nova.objects.instance [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lazy-loading 'flavor' on Instance uuid 839e85a2-f7af-482d-a5e6-09195888300e {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 12:32:27 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:32:27 user nova-compute[71321]:   <source dev="/dev/sdc"/>
Apr 12 12:32:27 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:32:27 user nova-compute[71321]:   <serial>e2586924-e0c3-4908-8f2c-7375bf258d7f</serial>
Apr 12 12:32:27 user nova-compute[71321]: </disk>
Apr 12 12:32:27 user nova-compute[71321]:  {{(pid=71321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 12:32:27 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Instance destroyed successfully.
Apr 12 12:32:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1139912608',display_name='tempest-ServerActionsTestJSON-server-548854806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1139912608',id=4,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9e64miZ/iyVASS4OS8AZthMPT8KBHm0byN/8NFP7U1AgI9/hOw/R+BSPozX14usgKt+VEqTE1BPs7aRGcfyuCZ/K0LBkD7enTbPYgw3NHHlO3PWScCWY1ae7IFb2uJEw==',key_name='tempest-keypair-1245622558',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:28:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7ba5375005114c8594e0ae86b2f19093',ramdisk_id='',reservation_id='r-kvv9k7th',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1233797030',owner_user_name='tempest-ServerActionsTestJSON-1233797030-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:32:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29f7f46d32f4465ba3e8b504c645c22f',uuid=546c0c08-35f1-4043-ac30-56d49bc86af1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converting VIF {"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f21df63-1895-4500-b119-c4670a7f3569,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21df63-18') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG os_vif [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f21df63-1895-4500-b119-c4670a7f3569,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21df63-18') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f21df63-18, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:32:27 user nova-compute[71321]: INFO os_vif [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f21df63-1895-4500-b119-c4670a7f3569,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21df63-18')
Apr 12 12:32:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVztbEhi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:32:27 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 12 12:32:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e9ba5e-ede2-468c-9f6d-707220baa97a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:32:27 user nova-compute[71321]: No targets found.
Apr 12 12:32:27 user nova-compute[71321]: iSNS:
Apr 12 12:32:27 user nova-compute[71321]: No targets found.
Apr 12 12:32:27 user nova-compute[71321]: STATIC:
Apr 12 12:32:27 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54
Apr 12 12:32:27 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:32:27 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:32:27 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f
Apr 12 12:32:27 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:32:27 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:32:27 user nova-compute[71321]: FIRMWARE:
Apr 12 12:32:27 user nova-compute[71321]: No targets found.
Apr 12 12:32:27 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:32:27 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:32:27 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b456c28-3518-4aab-a424-5870c4940569]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[67919a49-7dd8-41a1-8d0a-89c36242e98f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:32:27 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:32:27 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:32:27 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:32:27 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef446792d0>, {}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Disconnecting from: [] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.097s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] <== disconnect_volume: return (100ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:32:27 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Deleting instance files /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1_del
Apr 12 12:32:27 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Deletion of /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1_del complete
Apr 12 12:32:27 user nova-compute[71321]: INFO nova.virt.block_device [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Booting with volume a2a363ad-a0a5-4076-9530-5488fad60936 at /dev/vdb
Apr 12 12:32:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] No VIF found with MAC fa:16:3e:f7:93:c8, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG os_brick.utils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc53478-654a-4b21-be63-4946d58222fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b229125-416a-4467-b1ea-61fe64fc61b1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:28 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4c4c80-0294-4959-8ee8-d955e2551dd6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:28 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[510c8a32-d33e-4aed-99f4-ca652bd8d7d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:32:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:32:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:32:28 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:32:28 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[780e8c34-169e-4b07-aec1-cca7c9a88a51]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:32:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:32:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:32:28 user nova-compute[71321]: DEBUG os_brick.utils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:32:28 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Updating existing volume attachment record: ce08238a-b140-4428-a37e-2a92d8ce83d7 {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:32:28 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "839e85a2-f7af-482d-a5e6-09195888300e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.049s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:29 user nova-compute[71321]: INFO nova.compute.manager [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Rescuing
Apr 12 12:32:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "refresh_cache-839e85a2-f7af-482d-a5e6-09195888300e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:32:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquired lock "refresh_cache-839e85a2-f7af-482d-a5e6-09195888300e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:32:29 user nova-compute[71321]: DEBUG nova.network.neutron [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:32:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:29 user nova-compute[71321]: DEBUG nova.network.neutron [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Updating instance_info_cache with network_info: [{"id": "b5f18af0-544d-4978-b20e-85da7e880834", "address": "fa:16:3e:f7:93:c8", "network": {"id": "b6e89fad-c9f7-473e-ab76-3f005281cc95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-175129642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1faa529d424800900e10a7ceaa63d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f18af0-54", "ovs_interfaceid": "b5f18af0-544d-4978-b20e-85da7e880834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:32:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Releasing lock "refresh_cache-839e85a2-f7af-482d-a5e6-09195888300e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:32:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:30 user nova-compute[71321]: DEBUG nova.compute.manager [req-f2b516b2-5420-4762-9776-43c192d3cae3 req-6334198f-6104-428d-8df2-68a57f51926e service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Received event network-vif-unplugged-b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:32:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f2b516b2-5420-4762-9776-43c192d3cae3 req-6334198f-6104-428d-8df2-68a57f51926e service nova] Acquiring lock "839e85a2-f7af-482d-a5e6-09195888300e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f2b516b2-5420-4762-9776-43c192d3cae3 req-6334198f-6104-428d-8df2-68a57f51926e service nova] Lock "839e85a2-f7af-482d-a5e6-09195888300e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f2b516b2-5420-4762-9776-43c192d3cae3 req-6334198f-6104-428d-8df2-68a57f51926e service nova] Lock "839e85a2-f7af-482d-a5e6-09195888300e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:30 user nova-compute[71321]: DEBUG nova.compute.manager [req-f2b516b2-5420-4762-9776-43c192d3cae3 req-6334198f-6104-428d-8df2-68a57f51926e service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] No waiting events found dispatching network-vif-unplugged-b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:32:30 user nova-compute[71321]: WARNING nova.compute.manager [req-f2b516b2-5420-4762-9776-43c192d3cae3 req-6334198f-6104-428d-8df2-68a57f51926e service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Received unexpected event network-vif-unplugged-b5f18af0-544d-4978-b20e-85da7e880834 for instance with vm_state active and task_state rescuing.
Apr 12 12:32:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:30 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Instance destroyed successfully.
Apr 12 12:32:30 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Attempting a stable device rescue
Apr 12 12:32:30 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=71321) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 12:32:30 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Instance directory exists: not creating {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 12:32:30 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Creating image(s)
Apr 12 12:32:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "/opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "/opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "/opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:30 user nova-compute[71321]: DEBUG nova.objects.instance [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lazy-loading 'trusted_certs' on Instance uuid 839e85a2-f7af-482d-a5e6-09195888300e {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:32:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "95e5a173de441253522ddec92587198c5322ffdf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "95e5a173de441253522ddec92587198c5322ffdf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:31 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95e5a173de441253522ddec92587198c5322ffdf.part --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:31 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95e5a173de441253522ddec92587198c5322ffdf.part --force-share --output=json" returned: 0 in 0.164s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:31 user nova-compute[71321]: DEBUG nova.virt.images [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] 1a7cdce6-23be-41d4-a5cc-e9053f94d2ce was qcow2, converting to raw {{(pid=71321) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 12:32:31 user nova-compute[71321]: DEBUG nova.privsep.utils [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 12:32:31 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/95e5a173de441253522ddec92587198c5322ffdf.part /opt/stack/data/nova/instances/_base/95e5a173de441253522ddec92587198c5322ffdf.converted {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/95e5a173de441253522ddec92587198c5322ffdf.part /opt/stack/data/nova/instances/_base/95e5a173de441253522ddec92587198c5322ffdf.converted" returned: 0 in 0.249s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95e5a173de441253522ddec92587198c5322ffdf.converted --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG nova.compute.manager [req-64b370dc-205c-4e78-ac85-3056f9a14909 req-3b8cbaf1-5c60-4bdf-bd05-00c6e755a382 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Received event network-vif-plugged-b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-64b370dc-205c-4e78-ac85-3056f9a14909 req-3b8cbaf1-5c60-4bdf-bd05-00c6e755a382 service nova] Acquiring lock "839e85a2-f7af-482d-a5e6-09195888300e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-64b370dc-205c-4e78-ac85-3056f9a14909 req-3b8cbaf1-5c60-4bdf-bd05-00c6e755a382 service nova] Lock "839e85a2-f7af-482d-a5e6-09195888300e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-64b370dc-205c-4e78-ac85-3056f9a14909 req-3b8cbaf1-5c60-4bdf-bd05-00c6e755a382 service nova] Lock "839e85a2-f7af-482d-a5e6-09195888300e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG nova.compute.manager [req-64b370dc-205c-4e78-ac85-3056f9a14909 req-3b8cbaf1-5c60-4bdf-bd05-00c6e755a382 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] No waiting events found dispatching network-vif-plugged-b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:32:32 user nova-compute[71321]: WARNING nova.compute.manager [req-64b370dc-205c-4e78-ac85-3056f9a14909 req-3b8cbaf1-5c60-4bdf-bd05-00c6e755a382 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Received unexpected event network-vif-plugged-b5f18af0-544d-4978-b20e-85da7e880834 for instance with vm_state active and task_state rescuing.
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95e5a173de441253522ddec92587198c5322ffdf.converted --force-share --output=json" returned: 0 in 0.162s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "95e5a173de441253522ddec92587198c5322ffdf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.516s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "95e5a173de441253522ddec92587198c5322ffdf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "95e5a173de441253522ddec92587198c5322ffdf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95e5a173de441253522ddec92587198c5322ffdf --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95e5a173de441253522ddec92587198c5322ffdf --force-share --output=json" returned: 0 in 0.147s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95e5a173de441253522ddec92587198c5322ffdf,backing_fmt=raw /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk.rescue {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95e5a173de441253522ddec92587198c5322ffdf,backing_fmt=raw /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk.rescue" returned: 0 in 0.048s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "95e5a173de441253522ddec92587198c5322ffdf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG nova.objects.instance [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lazy-loading 'migration_context' on Instance uuid 839e85a2-f7af-482d-a5e6-09195888300e {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Start _get_guest_xml network_info=[{"id": "b5f18af0-544d-4978-b20e-85da7e880834", "address": "fa:16:3e:f7:93:c8", "network": {"id": "b6e89fad-c9f7-473e-ab76-3f005281cc95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-175129642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-175129642-network", "vif_mac": "fa:16:3e:f7:93:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1faa529d424800900e10a7ceaa63d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f18af0-54", "ovs_interfaceid": "b5f18af0-544d-4978-b20e-85da7e880834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1a7cdce6-23be-41d4-a5cc-e9053f94d2ce', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '568500b3-3231-48ad-b164-f3c519fdf666', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQumsNbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '839e85a2-f7af-482d-a5e6-09195888300e', 'attached_at': '', 'detached_at': '', 'volume_id': 'e2586924-e0c3-4908-8f2c-7375bf258d7f', 'serial': 'e2586924-e0c3-4908-8f2c-7375bf258d7f'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG nova.objects.instance [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lazy-loading 'resources' on Instance uuid 839e85a2-f7af-482d-a5e6-09195888300e {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG nova.objects.instance [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lazy-loading 'numa_topology' on Instance uuid 839e85a2-f7af-482d-a5e6-09195888300e {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:32 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:32:32 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:32:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG nova.objects.instance [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lazy-loading 'vcpu_model' on Instance uuid 839e85a2-f7af-482d-a5e6-09195888300e {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQumsNbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:32:32 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:32:32 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:32:32 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:32:32 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:32:32 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23e3a31-c080-4705-9925-d856c5a3450f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = kQumsNbd\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 12 12:32:32 user nova-compute[71321]: node.name = iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f
Apr 12 12:32:32 user nova-compute[71321]: node.tpgt = -1
Apr 12 12:32:32 user nova-compute[71321]: node.startup = automatic
Apr 12 12:32:32 user nova-compute[71321]: node.leading_login = No
Apr 12 12:32:32 user nova-compute[71321]: iface.iscsi_ifacename = default
Apr 12 12:32:32 user nova-compute[71321]: iface.net_ifacename = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.ipaddress = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.prefix_len = 0
Apr 12 12:32:32 user nova-compute[71321]: iface.hwaddress = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.transport_name = tcp
Apr 12 12:32:32 user nova-compute[71321]: iface.initiatorname = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.state = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.vlan_id = 0
Apr 12 12:32:32 user nova-compute[71321]: iface.vlan_priority = 0
Apr 12 12:32:32 user nova-compute[71321]: iface.vlan_state = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.iface_num = 0
Apr 12 12:32:32 user nova-compute[71321]: iface.mtu = 0
Apr 12 12:32:32 user nova-compute[71321]: iface.port = 0
Apr 12 12:32:32 user nova-compute[71321]: iface.bootproto = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.subnet_mask = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.gateway = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.dhcp_alt_client_id_state = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.dhcp_alt_client_id = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.dhcp_dns = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.dhcp_learn_iqn = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.dhcp_req_vendor_id_state = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.dhcp_vendor_id_state = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.dhcp_vendor_id = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.dhcp_slp_da = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.fragmentation = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.gratuitous_arp = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.incoming_forwarding = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.tos_state = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.tos = 0
Apr 12 12:32:32 user nova-compute[71321]: iface.ttl = 0
Apr 12 12:32:32 user nova-compute[71321]: iface.delayed_ack = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.tcp_nagle = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.tcp_wsf_state = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.tcp_wsf = 0
Apr 12 12:32:32 user nova-compute[71321]: iface.tcp_timer_scale = 0
Apr 12 12:32:32 user nova-compute[71321]: iface.tcp_timestamp = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.redirect = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.def_task_mgmt_timeout = 0
Apr 12 12:32:32 user nova-compute[71321]: iface.header_digest = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.data_digest = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.immediate_data = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.initial_r2t = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.data_seq_inorder = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.data_pdu_inorder = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.erl = 0
Apr 12 12:32:32 user nova-compute[71321]: iface.max_receive_data_len = 0
Apr 12 12:32:32 user nova-compute[71321]: iface.first_burst_len = 0
Apr 12 12:32:32 user nova-compute[71321]: iface.max_outstanding_r2t = 0
Apr 12 12:32:32 user nova-compute[71321]: iface.max_burst_len = 0
Apr 12 12:32:32 user nova-compute[71321]: iface.chap_auth = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.bidi_chap = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.strict_login_compliance = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.discovery_auth = <empty>
Apr 12 12:32:32 user nova-compute[71321]: iface.discovery_logout = <empty>
Apr 12 12:32:32 user nova-compute[71321]: node.discovery_address = <empty>
Apr 12 12:32:32 user nova-compute[71321]: node.discovery_port = 0
Apr 12 12:32:32 user nova-compute[71321]: node.discovery_type = static
Apr 12 12:32:32 user nova-compute[71321]: node.session.initial_cmdsn = 0
Apr 12 12:32:32 user nova-compute[71321]: node.session.initial_login_retry_max = 8
Apr 12 12:32:32 user nova-compute[71321]: node.session.xmit_thread_priority = -20
Apr 12 12:32:32 user nova-compute[71321]: node.session.cmds_max = 128
Apr 12 12:32:32 user nova-compute[71321]: node.session.queue_depth = 32
Apr 12 12:32:32 user nova-compute[71321]: node.session.nr_sessions = 1
Apr 12 12:32:32 user nova-compute[71321]: node.session.auth.authmethod = CHAP
Apr 12 12:32:32 user nova-compute[71321]: node.session.auth.username = kQumsNbd
Apr 12 12:32:32 user nova-compute[71321]: node.session.auth.password = ***
Apr 12 12:32:32 user nova-compute[71321]: node.session.auth.username_in = <empty>
Apr 12 12:32:32 user nova-compute[71321]: node.session.auth.password_in = <empty>
Apr 12 12:32:32 user nova-compute[71321]: node.session.auth.chap_algs = MD5
Apr 12 12:32:32 user nova-compute[71321]: node.session.timeo.replacement_timeout = 120
Apr 12 12:32:32 user nova-compute[71321]: node.session.err_timeo.abort_timeout = 15
Apr 12 12:32:32 user nova-compute[71321]: node.session.err_timeo.lu_reset_timeout = 30
Apr 12 12:32:32 user nova-compute[71321]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 12 12:32:32 user nova-compute[71321]: node.session.err_timeo.host_reset_timeout = 60
Apr 12 12:32:32 user nova-compute[71321]: node.session.iscsi.FastAbort = Yes
Apr 12 12:32:32 user nova-compute[71321]: node.session.iscsi.InitialR2T = No
Apr 12 12:32:32 user nova-compute[71321]: node.session.iscsi.ImmediateData = Yes
Apr 12 12:32:32 user nova-compute[71321]: node.session.iscsi.FirstBurstLength = 262144
Apr 12 12:32:32 user nova-compute[71321]: node.session.iscsi.MaxBurstLength = 16776192
Apr 12 12:32:32 user nova-compute[71321]: node.session.iscsi.DefaultTime2Retain = 0
Apr 12 12:32:32 user nova-compute[71321]: node.session.iscsi.DefaultTime2Wait = 2
Apr 12 12:32:32 user nova-compute[71321]: node.session.iscsi.MaxConnections = 1
Apr 12 12:32:32 user nova-compute[71321]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 12 12:32:32 user nova-compute[71321]: node.session.iscsi.ERL = 0
Apr 12 12:32:32 user nova-compute[71321]: node.session.scan = manual
Apr 12 12:32:32 user nova-compute[71321]: node.session.reopen_max = 0
Apr 12 12:32:32 user nova-compute[71321]: node.conn[0].address = 172.16.0.220
Apr 12 12:32:32 user nova-compute[71321]: node.conn[0].port = 3260
Apr 12 12:32:32 user nova-compute[71321]: node.conn[0].startup = manual
Apr 12 12:32:32 user nova-compute[71321]: node.conn[0].tcp.window_size = 524288
Apr 12 12:32:32 user nova-compute[71321]: node.conn[0].tcp.type_of_service = 0
Apr 12 12:32:32 user nova-compute[71321]: node.conn[0].timeo.logout_timeout = 15
Apr 12 12:32:32 user nova-compute[71321]: node.conn[0].timeo.login_timeout = 15
Apr 12 12:32:32 user nova-compute[71321]: node.conn[0].timeo.auth_timeout = 45
Apr 12 12:32:32 user nova-compute[71321]: node.conn[0].timeo.noop_out_interval = 5
Apr 12 12:32:32 user nova-compute[71321]: node.conn[0].timeo.noop_out_timeout = 5
Apr 12 12:32:32 user nova-compute[71321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 12 12:32:32 user nova-compute[71321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 12 12:32:32 user nova-compute[71321]: node.conn[0].iscsi.HeaderDigest = None
Apr 12 12:32:32 user nova-compute[71321]: node.conn[0].iscsi.DataDigest = None
Apr 12 12:32:32 user nova-compute[71321]: node.conn[0].iscsi.IFMarker = No
Apr 12 12:32:32 user nova-compute[71321]: node.conn[0].iscsi.OFMarker = No
Apr 12 12:32:32 user nova-compute[71321]: # END RECORD
Apr 12 12:32:32 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[da585d1b-6363-4273-acf2-f264a7551aaa]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd958bba-48e4-494b-8e46-a959a7d0c5fa]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kQumsNbd {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kQumsNbd" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf096052-e691-4854-a611-e902561a8243]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kQumsNbd'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb89259-52f6-45bc-9a35-3b614763b373]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[851d26ab-c037-45a8-bcd8-63e7abec47d7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:32:32 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:32:32 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:32:32 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:32:32 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.165s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] HCTL ('34', '0', '0', 0) found on session 16 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[141b9f36-e369-47c6-ba67-02bfda678415]: (4, ('0 0 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Searching for a device in session 16 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQumsNbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.193s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] <== connect_volume: return (194ms) {'type': 'block', 'scsi_wwn': '26365373463303661', 'path': '/dev/sdc'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365373463303661', 'path': '/dev/sdc'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:28:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-880464121',display_name='tempest-ServerStableDeviceRescueTest-server-880464121',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-880464121',id=5,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbjsmMAk7TgSJuVPAPMbe+S9lCblPJCLl74ltjr7B+GvM2NkPL65YFl6sPwYL2BIrtM9phc+NecEtUrIGkGO+1xCyg6wipPFufRoi6dOJI6CI4+oKRDt9+nYbnf0HP/Kw==',key_name='tempest-keypair-1613417814',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:28:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b1faa529d424800900e10a7ceaa63d4',ramdisk_id='',reservation_id='r-9f4j5h8u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1967261752',owner_user_name='tempest-ServerStableDeviceRescueTest-1967261752-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:30:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d76f02dd70664dfea34586abbc213526',uuid=839e85a2-f7af-482d-a5e6-09195888300e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5f18af0-544d-4978-b20e-85da7e880834", "address": "fa:16:3e:f7:93:c8", "network": {"id": "b6e89fad-c9f7-473e-ab76-3f005281cc95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-175129642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-175129642-network", "vif_mac": "fa:16:3e:f7:93:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1faa529d424800900e10a7ceaa63d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f18af0-54", "ovs_interfaceid": "b5f18af0-544d-4978-b20e-85da7e880834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Converting VIF {"id": "b5f18af0-544d-4978-b20e-85da7e880834", "address": "fa:16:3e:f7:93:c8", "network": {"id": "b6e89fad-c9f7-473e-ab76-3f005281cc95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-175129642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-175129642-network", "vif_mac": "fa:16:3e:f7:93:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1faa529d424800900e10a7ceaa63d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f18af0-54", "ovs_interfaceid": "b5f18af0-544d-4978-b20e-85da7e880834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:93:c8,bridge_name='br-int',has_traffic_filtering=True,id=b5f18af0-544d-4978-b20e-85da7e880834,network=Network(b6e89fad-c9f7-473e-ab76-3f005281cc95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f18af0-54') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG nova.objects.instance [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lazy-loading 'pci_devices' on Instance uuid 839e85a2-f7af-482d-a5e6-09195888300e {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:32:32 user nova-compute[71321]:   <uuid>839e85a2-f7af-482d-a5e6-09195888300e</uuid>
Apr 12 12:32:32 user nova-compute[71321]:   <name>instance-00000005</name>
Apr 12 12:32:32 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:32:32 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:32:32 user nova-compute[71321]:   <metadata>
Apr 12 12:32:32 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:32:32 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:32:32 user nova-compute[71321]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-880464121</nova:name>
Apr 12 12:32:32 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:32:32</nova:creationTime>
Apr 12 12:32:32 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:32:32 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:32:32 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:32:32 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:32:32 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:32:32 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:32:32 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:32:32 user nova-compute[71321]:       <nova:owner>
Apr 12 12:32:32 user nova-compute[71321]:         <nova:user uuid="d76f02dd70664dfea34586abbc213526">tempest-ServerStableDeviceRescueTest-1967261752-project-member</nova:user>
Apr 12 12:32:32 user nova-compute[71321]:         <nova:project uuid="3b1faa529d424800900e10a7ceaa63d4">tempest-ServerStableDeviceRescueTest-1967261752</nova:project>
Apr 12 12:32:32 user nova-compute[71321]:       </nova:owner>
Apr 12 12:32:32 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:32:32 user nova-compute[71321]:       <nova:ports>
Apr 12 12:32:32 user nova-compute[71321]:         <nova:port uuid="b5f18af0-544d-4978-b20e-85da7e880834">
Apr 12 12:32:32 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 12:32:32 user nova-compute[71321]:         </nova:port>
Apr 12 12:32:32 user nova-compute[71321]:       </nova:ports>
Apr 12 12:32:32 user nova-compute[71321]:     </nova:instance>
Apr 12 12:32:32 user nova-compute[71321]:   </metadata>
Apr 12 12:32:32 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:32:32 user nova-compute[71321]:     <system>
Apr 12 12:32:32 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:32:32 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:32:32 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:32:32 user nova-compute[71321]:       <entry name="serial">839e85a2-f7af-482d-a5e6-09195888300e</entry>
Apr 12 12:32:32 user nova-compute[71321]:       <entry name="uuid">839e85a2-f7af-482d-a5e6-09195888300e</entry>
Apr 12 12:32:32 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:32:32 user nova-compute[71321]:     </system>
Apr 12 12:32:32 user nova-compute[71321]:   </sysinfo>
Apr 12 12:32:32 user nova-compute[71321]:   <os>
Apr 12 12:32:32 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:32:32 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:32:32 user nova-compute[71321]:   </os>
Apr 12 12:32:32 user nova-compute[71321]:   <features>
Apr 12 12:32:32 user nova-compute[71321]:     <acpi/>
Apr 12 12:32:32 user nova-compute[71321]:     <apic/>
Apr 12 12:32:32 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:32:32 user nova-compute[71321]:   </features>
Apr 12 12:32:32 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:32:32 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:32:32 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:32:32 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:32:32 user nova-compute[71321]:   </clock>
Apr 12 12:32:32 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:32:32 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:32:32 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:32:32 user nova-compute[71321]:   </cpu>
Apr 12 12:32:32 user nova-compute[71321]:   <devices>
Apr 12 12:32:32 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:32:32 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:32:32 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk"/>
Apr 12 12:32:32 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:32:32 user nova-compute[71321]:     </disk>
Apr 12 12:32:32 user nova-compute[71321]:     <disk type="block" device="disk">
Apr 12 12:32:32 user nova-compute[71321]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:32:32 user nova-compute[71321]:       <source dev="/dev/sdc"/>
Apr 12 12:32:32 user nova-compute[71321]:       <target dev="vdb" bus="virtio"/>
Apr 12 12:32:32 user nova-compute[71321]:       <serial>e2586924-e0c3-4908-8f2c-7375bf258d7f</serial>
Apr 12 12:32:32 user nova-compute[71321]:     </disk>
Apr 12 12:32:32 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:32:32 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:32:32 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk.rescue"/>
Apr 12 12:32:32 user nova-compute[71321]:       <target dev="vdc" bus="virtio"/>
Apr 12 12:32:32 user nova-compute[71321]:       <boot order="1"/>
Apr 12 12:32:32 user nova-compute[71321]:     </disk>
Apr 12 12:32:32 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:32:32 user nova-compute[71321]:       <mac address="fa:16:3e:f7:93:c8"/>
Apr 12 12:32:32 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:32:32 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:32:32 user nova-compute[71321]:       <target dev="tapb5f18af0-54"/>
Apr 12 12:32:32 user nova-compute[71321]:     </interface>
Apr 12 12:32:32 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:32:32 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/console.log" append="off"/>
Apr 12 12:32:32 user nova-compute[71321]:     </serial>
Apr 12 12:32:32 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:32:32 user nova-compute[71321]:     <video>
Apr 12 12:32:32 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:32:32 user nova-compute[71321]:     </video>
Apr 12 12:32:32 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:32:32 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:32:32 user nova-compute[71321]:     </rng>
Apr 12 12:32:32 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:32:32 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:32:32 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:32:32 user nova-compute[71321]:     </memballoon>
Apr 12 12:32:32 user nova-compute[71321]:   </devices>
Apr 12 12:32:32 user nova-compute[71321]: </domain>
Apr 12 12:32:32 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:32:32 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Instance destroyed successfully.
Apr 12 12:32:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:32:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] No VIF found with MAC fa:16:3e:f7:93:c8, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:32:33 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Creating image(s)
Apr 12 12:32:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "/opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "/opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "/opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.141s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.151s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk 1073741824" returned: 0 in 0.047s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.136s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Checking if we can resize image /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Cannot resize image /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Ensure instance console log exists: /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Start _get_guest_xml network_info=[{"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ce08238a-b140-4428-a37e-2a92d8ce83d7', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVztbEhi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '546c0c08-35f1-4043-ac30-56d49bc86af1', 'attached_at': '', 'detached_at': '', 'volume_id': 'a2a363ad-a0a5-4076-9530-5488fad60936', 'serial': 'a2a363ad-a0a5-4076-9530-5488fad60936'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:32:33 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 12 12:32:33 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 12 12:32:33 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG nova.objects.instance [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lazy-loading 'vcpu_model' on Instance uuid 546c0c08-35f1-4043-ac30-56d49bc86af1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVztbEhi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:32:33 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 12 12:32:33 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:32:33 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 12 12:32:33 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:32:33 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:32:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d56b60-c513-4c26-9d77-aec874cbaef9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:32:33 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.086s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ffafed-07d3-4c25-a8af-ad74b0394819]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936] added
Apr 12 12:32:33 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b218b386-f569-4496-bc53-593aaba368c5]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.142s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cf5c1a-126a-4757-9749-eb73cb394171]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AVztbEhi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AVztbEhi" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac36b0a7-1ee0-4271-85f7-6c15ed4841ec]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AVztbEhi'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55bb913-3360-414c-b406-80dea5ebb10b]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[19415829-c439-49b3-8b67-537a4245b8a6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:32:34 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:32:34 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:32:34 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:32:34 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac89eb1-0951-4868-8c4f-c33cc9ba2da2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936, portal: 172.16.0.220,3260]
Apr 12 12:32:34 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936, portal: 172.16.0.220,3260] successful.
Apr 12 12:32:34 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bd4fc6-240c-456a-9978-e22eef67d558]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b09969a-997f-43fc-8031-0fc215f175a1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:32:34 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:32:34 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:32:34 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:32:34 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:32:34 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:32:34 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.505s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[509aff11-6d9e-4be9-a425-518ee464ba91]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVztbEhi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG nova.compute.manager [req-2833adff-d4ac-4de6-bc7f-2f0317c0ca35 req-13bb7321-bde4-4d24-a5eb-cfc18ebdeac5 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Received event network-vif-plugged-b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2833adff-d4ac-4de6-bc7f-2f0317c0ca35 req-13bb7321-bde4-4d24-a5eb-cfc18ebdeac5 service nova] Acquiring lock "839e85a2-f7af-482d-a5e6-09195888300e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2833adff-d4ac-4de6-bc7f-2f0317c0ca35 req-13bb7321-bde4-4d24-a5eb-cfc18ebdeac5 service nova] Lock "839e85a2-f7af-482d-a5e6-09195888300e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2833adff-d4ac-4de6-bc7f-2f0317c0ca35 req-13bb7321-bde4-4d24-a5eb-cfc18ebdeac5 service nova] Lock "839e85a2-f7af-482d-a5e6-09195888300e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:34 user nova-compute[71321]: DEBUG nova.compute.manager [req-2833adff-d4ac-4de6-bc7f-2f0317c0ca35 req-13bb7321-bde4-4d24-a5eb-cfc18ebdeac5 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] No waiting events found dispatching network-vif-plugged-b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:32:34 user nova-compute[71321]: WARNING nova.compute.manager [req-2833adff-d4ac-4de6-bc7f-2f0317c0ca35 req-13bb7321-bde4-4d24-a5eb-cfc18ebdeac5 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Received unexpected event network-vif-plugged-b5f18af0-544d-4978-b20e-85da7e880834 for instance with vm_state active and task_state rescuing.
Apr 12 12:32:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:35 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.537s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:32:35 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] <== connect_volume: return (1541ms) {'type': 'block', 'scsi_wwn': '23434353437643265', 'path': '/dev/sdd'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:32:35 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434353437643265', 'path': '/dev/sdd'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:32:35 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T12:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1139912608',display_name='tempest-ServerActionsTestJSON-server-548854806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1139912608',id=4,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9e64miZ/iyVASS4OS8AZthMPT8KBHm0byN/8NFP7U1AgI9/hOw/R+BSPozX14usgKt+VEqTE1BPs7aRGcfyuCZ/K0LBkD7enTbPYgw3NHHlO3PWScCWY1ae7IFb2uJEw==',key_name='tempest-keypair-1245622558',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:28:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7ba5375005114c8594e0ae86b2f19093',ramdisk_id='',reservation_id='r-kvv9k7th',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1233797030',owner_user_name='tempest-ServerActionsTestJSON-1233797030-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:32:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29f7f46d32f4465ba3e8b504c645c22f',uuid=546c0c08-35f1-4043-ac30-56d49bc86af1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:32:35 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converting VIF {"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:32:35 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f21df63-1895-4500-b119-c4670a7f3569,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21df63-18') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:32:35 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:32:35 user nova-compute[71321]:   <uuid>546c0c08-35f1-4043-ac30-56d49bc86af1</uuid>
Apr 12 12:32:35 user nova-compute[71321]:   <name>instance-00000004</name>
Apr 12 12:32:35 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:32:35 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:32:35 user nova-compute[71321]:   <metadata>
Apr 12 12:32:35 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:32:35 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:32:35 user nova-compute[71321]:       <nova:name>tempest-ServerActionsTestJSON-server-548854806</nova:name>
Apr 12 12:32:35 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:32:33</nova:creationTime>
Apr 12 12:32:35 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:32:35 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:32:35 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:32:35 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:32:35 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:32:35 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:32:35 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:32:35 user nova-compute[71321]:       <nova:owner>
Apr 12 12:32:35 user nova-compute[71321]:         <nova:user uuid="29f7f46d32f4465ba3e8b504c645c22f">tempest-ServerActionsTestJSON-1233797030-project-member</nova:user>
Apr 12 12:32:35 user nova-compute[71321]:         <nova:project uuid="7ba5375005114c8594e0ae86b2f19093">tempest-ServerActionsTestJSON-1233797030</nova:project>
Apr 12 12:32:35 user nova-compute[71321]:       </nova:owner>
Apr 12 12:32:35 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:32:35 user nova-compute[71321]:       <nova:ports>
Apr 12 12:32:35 user nova-compute[71321]:         <nova:port uuid="6f21df63-1895-4500-b119-c4670a7f3569">
Apr 12 12:32:35 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 12:32:35 user nova-compute[71321]:         </nova:port>
Apr 12 12:32:35 user nova-compute[71321]:       </nova:ports>
Apr 12 12:32:35 user nova-compute[71321]:     </nova:instance>
Apr 12 12:32:35 user nova-compute[71321]:   </metadata>
Apr 12 12:32:35 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:32:35 user nova-compute[71321]:     <system>
Apr 12 12:32:35 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:32:35 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:32:35 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:32:35 user nova-compute[71321]:       <entry name="serial">546c0c08-35f1-4043-ac30-56d49bc86af1</entry>
Apr 12 12:32:35 user nova-compute[71321]:       <entry name="uuid">546c0c08-35f1-4043-ac30-56d49bc86af1</entry>
Apr 12 12:32:35 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:32:35 user nova-compute[71321]:     </system>
Apr 12 12:32:35 user nova-compute[71321]:   </sysinfo>
Apr 12 12:32:35 user nova-compute[71321]:   <os>
Apr 12 12:32:35 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:32:35 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:32:35 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:32:35 user nova-compute[71321]:   </os>
Apr 12 12:32:35 user nova-compute[71321]:   <features>
Apr 12 12:32:35 user nova-compute[71321]:     <acpi/>
Apr 12 12:32:35 user nova-compute[71321]:     <apic/>
Apr 12 12:32:35 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:32:35 user nova-compute[71321]:   </features>
Apr 12 12:32:35 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:32:35 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:32:35 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:32:35 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:32:35 user nova-compute[71321]:   </clock>
Apr 12 12:32:35 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:32:35 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:32:35 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:32:35 user nova-compute[71321]:   </cpu>
Apr 12 12:32:35 user nova-compute[71321]:   <devices>
Apr 12 12:32:35 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:32:35 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:32:35 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk"/>
Apr 12 12:32:35 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:32:35 user nova-compute[71321]:     </disk>
Apr 12 12:32:35 user nova-compute[71321]:     <disk type="block" device="disk">
Apr 12 12:32:35 user nova-compute[71321]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:32:35 user nova-compute[71321]:       <source dev="/dev/sdd"/>
Apr 12 12:32:35 user nova-compute[71321]:       <target dev="vdb" bus="virtio"/>
Apr 12 12:32:35 user nova-compute[71321]:       <serial>a2a363ad-a0a5-4076-9530-5488fad60936</serial>
Apr 12 12:32:35 user nova-compute[71321]:     </disk>
Apr 12 12:32:35 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:32:35 user nova-compute[71321]:       <mac address="fa:16:3e:14:16:c4"/>
Apr 12 12:32:35 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:32:35 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:32:35 user nova-compute[71321]:       <target dev="tap6f21df63-18"/>
Apr 12 12:32:35 user nova-compute[71321]:     </interface>
Apr 12 12:32:35 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:32:35 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/console.log" append="off"/>
Apr 12 12:32:35 user nova-compute[71321]:     </serial>
Apr 12 12:32:35 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:32:35 user nova-compute[71321]:     <video>
Apr 12 12:32:35 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:32:35 user nova-compute[71321]:     </video>
Apr 12 12:32:35 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:32:35 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:32:35 user nova-compute[71321]:     </rng>
Apr 12 12:32:35 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:32:35 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:32:35 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:32:35 user nova-compute[71321]:     </memballoon>
Apr 12 12:32:35 user nova-compute[71321]:   </devices>
Apr 12 12:32:35 user nova-compute[71321]: </domain>
Apr 12 12:32:35 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:32:35 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T12:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1139912608',display_name='tempest-ServerActionsTestJSON-server-548854806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1139912608',id=4,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9e64miZ/iyVASS4OS8AZthMPT8KBHm0byN/8NFP7U1AgI9/hOw/R+BSPozX14usgKt+VEqTE1BPs7aRGcfyuCZ/K0LBkD7enTbPYgw3NHHlO3PWScCWY1ae7IFb2uJEw==',key_name='tempest-keypair-1245622558',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:28:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7ba5375005114c8594e0ae86b2f19093',ramdisk_id='',reservation_id='r-kvv9k7th',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1233797030',owner_user_name='tempest-ServerActionsTestJSON-1233797030-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:32:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29f7f46d32f4465ba3e8b504c645c22f',uuid=546c0c08-35f1-4043-ac30-56d49bc86af1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:32:35 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converting VIF {"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:32:35 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f21df63-1895-4500-b119-c4670a7f3569,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21df63-18') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:32:35 user nova-compute[71321]: DEBUG os_vif [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f21df63-1895-4500-b119-c4670a7f3569,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21df63-18') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:32:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:32:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:32:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f21df63-18, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:32:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6f21df63-18, col_values=(('external_ids', {'iface-id': '6f21df63-1895-4500-b119-c4670a7f3569', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:16:c4', 'vm-uuid': '546c0c08-35f1-4043-ac30-56d49bc86af1'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:32:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:32:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:35 user nova-compute[71321]: INFO os_vif [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f21df63-1895-4500-b119-c4670a7f3569,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21df63-18')
Apr 12 12:32:35 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:32:35 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:32:35 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] No VIF found with MAC fa:16:3e:14:16:c4, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:32:36 user nova-compute[71321]: DEBUG nova.compute.manager [req-afe6979f-4daf-407e-a7f7-750c537a91f9 req-839301ba-959d-4d77-8ba5-4fad49531884 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Received event network-vif-plugged-b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:32:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-afe6979f-4daf-407e-a7f7-750c537a91f9 req-839301ba-959d-4d77-8ba5-4fad49531884 service nova] Acquiring lock "839e85a2-f7af-482d-a5e6-09195888300e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-afe6979f-4daf-407e-a7f7-750c537a91f9 req-839301ba-959d-4d77-8ba5-4fad49531884 service nova] Lock "839e85a2-f7af-482d-a5e6-09195888300e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-afe6979f-4daf-407e-a7f7-750c537a91f9 req-839301ba-959d-4d77-8ba5-4fad49531884 service nova] Lock "839e85a2-f7af-482d-a5e6-09195888300e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:36 user nova-compute[71321]: DEBUG nova.compute.manager [req-afe6979f-4daf-407e-a7f7-750c537a91f9 req-839301ba-959d-4d77-8ba5-4fad49531884 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] No waiting events found dispatching network-vif-plugged-b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:32:36 user nova-compute[71321]: WARNING nova.compute.manager [req-afe6979f-4daf-407e-a7f7-750c537a91f9 req-839301ba-959d-4d77-8ba5-4fad49531884 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Received unexpected event network-vif-plugged-b5f18af0-544d-4978-b20e-85da7e880834 for instance with vm_state active and task_state rescuing.
Apr 12 12:32:37 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Removed pending event for 839e85a2-f7af-482d-a5e6-09195888300e due to event {{(pid=71321) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 12:32:37 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302757.0364542, 839e85a2-f7af-482d-a5e6-09195888300e => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:32:37 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] VM Resumed (Lifecycle Event)
Apr 12 12:32:37 user nova-compute[71321]: DEBUG nova.compute.manager [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:32:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:37 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:32:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:37 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:32:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:37 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 12:32:37 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302757.0387397, 839e85a2-f7af-482d-a5e6-09195888300e => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:32:37 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] VM Started (Lifecycle Event)
Apr 12 12:32:37 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:32:37 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:32:37 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 12:32:37 user nova-compute[71321]: DEBUG nova.compute.manager [req-662753d2-8886-42e1-b169-5d836f0d6cdc req-cf95148b-04ac-42a2-93c2-9d30a9ffefbf service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received event network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:32:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-662753d2-8886-42e1-b169-5d836f0d6cdc req-cf95148b-04ac-42a2-93c2-9d30a9ffefbf service nova] Acquiring lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-662753d2-8886-42e1-b169-5d836f0d6cdc req-cf95148b-04ac-42a2-93c2-9d30a9ffefbf service nova] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-662753d2-8886-42e1-b169-5d836f0d6cdc req-cf95148b-04ac-42a2-93c2-9d30a9ffefbf service nova] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:37 user nova-compute[71321]: DEBUG nova.compute.manager [req-662753d2-8886-42e1-b169-5d836f0d6cdc req-cf95148b-04ac-42a2-93c2-9d30a9ffefbf service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] No waiting events found dispatching network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:32:37 user nova-compute[71321]: WARNING nova.compute.manager [req-662753d2-8886-42e1-b169-5d836f0d6cdc req-cf95148b-04ac-42a2-93c2-9d30a9ffefbf service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received unexpected event network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 for instance with vm_state active and task_state rebuild_spawning.
Apr 12 12:32:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-5709a062-96ba-4319-bdcc-7068fb34b556 req-1e8d34de-7d55-4a3d-bc46-42dbf9326dbf service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received event network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:32:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-5709a062-96ba-4319-bdcc-7068fb34b556 req-1e8d34de-7d55-4a3d-bc46-42dbf9326dbf service nova] Acquiring lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-5709a062-96ba-4319-bdcc-7068fb34b556 req-1e8d34de-7d55-4a3d-bc46-42dbf9326dbf service nova] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-5709a062-96ba-4319-bdcc-7068fb34b556 req-1e8d34de-7d55-4a3d-bc46-42dbf9326dbf service nova] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-5709a062-96ba-4319-bdcc-7068fb34b556 req-1e8d34de-7d55-4a3d-bc46-42dbf9326dbf service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] No waiting events found dispatching network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:32:39 user nova-compute[71321]: WARNING nova.compute.manager [req-5709a062-96ba-4319-bdcc-7068fb34b556 req-1e8d34de-7d55-4a3d-bc46-42dbf9326dbf service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received unexpected event network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 for instance with vm_state active and task_state rebuild_spawning.
Apr 12 12:32:39 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:39 user nova-compute[71321]: DEBUG nova.compute.manager [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:32:39 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:32:39 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Removed pending event for 546c0c08-35f1-4043-ac30-56d49bc86af1 due to event {{(pid=71321) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 12:32:39 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302759.9396641, 546c0c08-35f1-4043-ac30-56d49bc86af1 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:32:39 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] VM Resumed (Lifecycle Event)
Apr 12 12:32:39 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Instance spawned successfully.
Apr 12 12:32:39 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:32:39 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:32:39 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:32:39 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:32:39 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:32:39 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:32:39 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:32:39 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:32:39 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:32:40 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 12 12:32:40 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302759.9409275, 546c0c08-35f1-4043-ac30-56d49bc86af1 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:32:40 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] VM Started (Lifecycle Event)
Apr 12 12:32:40 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:32:40 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:32:40 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 12 12:32:40 user nova-compute[71321]: DEBUG nova.compute.manager [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:32:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:40 user nova-compute[71321]: DEBUG nova.objects.instance [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71321) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 12 12:32:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.084s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "9439468d-7a45-443b-87ce-106907761a56" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "9439468d-7a45-443b-87ce-106907761a56" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:44 user nova-compute[71321]: DEBUG nova.compute.manager [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:32:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:44 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:32:44 user nova-compute[71321]: INFO nova.compute.claims [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Claim successful on node user
Apr 12 12:32:44 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:32:44 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:32:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:44 user nova-compute[71321]: DEBUG nova.compute.manager [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:32:44 user nova-compute[71321]: DEBUG nova.compute.manager [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:32:44 user nova-compute[71321]: DEBUG nova.network.neutron [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:32:44 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:32:44 user nova-compute[71321]: DEBUG nova.compute.manager [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:32:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:44 user nova-compute[71321]: DEBUG nova.policy [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:32:44 user nova-compute[71321]: DEBUG nova.compute.manager [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:32:44 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:32:44 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Creating image(s)
Apr 12 12:32:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "/opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "/opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "/opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:45 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.149s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:45 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:45 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.208s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:45 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:45 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk 1073741824" returned: 0 in 0.064s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:45 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:45 user nova-compute[71321]: DEBUG nova.network.neutron [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Successfully created port: 67b56c74-fc25-4bc8-875e-8a134830124b {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:32:45 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.219s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:45 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:32:45 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "4b597d03-8252-4e26-a5a9-651117bf78d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "4b597d03-8252-4e26-a5a9-651117bf78d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:45 user nova-compute[71321]: DEBUG nova.compute.manager [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:32:45 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:45 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Cannot resize image /opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:32:45 user nova-compute[71321]: DEBUG nova.objects.instance [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lazy-loading 'migration_context' on Instance uuid 9439468d-7a45-443b-87ce-106907761a56 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:32:45 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:32:45 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Ensure instance console log exists: /opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:32:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:45 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:32:45 user nova-compute[71321]: INFO nova.compute.claims [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Claim successful on node user
Apr 12 12:32:46 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:32:46 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:32:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:46 user nova-compute[71321]: DEBUG nova.compute.manager [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:32:46 user nova-compute[71321]: DEBUG nova.network.neutron [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Successfully updated port: 67b56c74-fc25-4bc8-875e-8a134830124b {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:32:46 user nova-compute[71321]: DEBUG nova.compute.manager [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:32:46 user nova-compute[71321]: DEBUG nova.network.neutron [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:32:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "refresh_cache-9439468d-7a45-443b-87ce-106907761a56" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:32:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquired lock "refresh_cache-9439468d-7a45-443b-87ce-106907761a56" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:32:46 user nova-compute[71321]: DEBUG nova.network.neutron [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:32:46 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:32:46 user nova-compute[71321]: DEBUG nova.compute.manager [req-e7b2cd5b-e264-4418-9fb7-2b44a3433c83 req-52a4d634-0bd6-4ebf-8635-798e7400a922 service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Received event network-changed-67b56c74-fc25-4bc8-875e-8a134830124b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:32:46 user nova-compute[71321]: DEBUG nova.compute.manager [req-e7b2cd5b-e264-4418-9fb7-2b44a3433c83 req-52a4d634-0bd6-4ebf-8635-798e7400a922 service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Refreshing instance network info cache due to event network-changed-67b56c74-fc25-4bc8-875e-8a134830124b. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:32:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e7b2cd5b-e264-4418-9fb7-2b44a3433c83 req-52a4d634-0bd6-4ebf-8635-798e7400a922 service nova] Acquiring lock "refresh_cache-9439468d-7a45-443b-87ce-106907761a56" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:32:46 user nova-compute[71321]: DEBUG nova.compute.manager [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:32:46 user nova-compute[71321]: DEBUG nova.network.neutron [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:32:46 user nova-compute[71321]: DEBUG nova.compute.manager [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:32:46 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:32:46 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Creating image(s)
Apr 12 12:32:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b597d03-8252-4e26-a5a9-651117bf78d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "/opt/stack/data/nova/instances/4b597d03-8252-4e26-a5a9-651117bf78d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "/opt/stack/data/nova/instances/4b597d03-8252-4e26-a5a9-651117bf78d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:46 user nova-compute[71321]: DEBUG nova.policy [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '35727e3b48da4494808015e2b630a3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466d2a494cf64002a98588909bdcd197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:32:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.140s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.137s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/4b597d03-8252-4e26-a5a9-651117bf78d1/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/4b597d03-8252-4e26-a5a9-651117bf78d1/disk 1073741824" returned: 0 in 0.056s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.138s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b597d03-8252-4e26-a5a9-651117bf78d1/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b597d03-8252-4e26-a5a9-651117bf78d1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG nova.network.neutron [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Updating instance_info_cache with network_info: [{"id": "67b56c74-fc25-4bc8-875e-8a134830124b", "address": "fa:16:3e:14:ba:2c", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b56c74-fc", "ovs_interfaceid": "67b56c74-fc25-4bc8-875e-8a134830124b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Releasing lock "refresh_cache-9439468d-7a45-443b-87ce-106907761a56" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG nova.compute.manager [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Instance network_info: |[{"id": "67b56c74-fc25-4bc8-875e-8a134830124b", "address": "fa:16:3e:14:ba:2c", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b56c74-fc", "ovs_interfaceid": "67b56c74-fc25-4bc8-875e-8a134830124b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e7b2cd5b-e264-4418-9fb7-2b44a3433c83 req-52a4d634-0bd6-4ebf-8635-798e7400a922 service nova] Acquired lock "refresh_cache-9439468d-7a45-443b-87ce-106907761a56" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG nova.network.neutron [req-e7b2cd5b-e264-4418-9fb7-2b44a3433c83 req-52a4d634-0bd6-4ebf-8635-798e7400a922 service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Refreshing network info cache for port 67b56c74-fc25-4bc8-875e-8a134830124b {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Start _get_guest_xml network_info=[{"id": "67b56c74-fc25-4bc8-875e-8a134830124b", "address": "fa:16:3e:14:ba:2c", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b56c74-fc", "ovs_interfaceid": "67b56c74-fc25-4bc8-875e-8a134830124b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:32:47 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:32:47 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:32:47 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:32:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-806455308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-806455308',id=16,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1ZrjP9KAJCgyaL5zcIDkfonF0SjjghGFN4rxSk+Gs/fi7zbEzghBorK6ScclR6/kTKn5pVT08v7lhEUGdgEMCcBQsph3fKqP0aQS3e3cPR0dYvUMVDLU1ho++DwuWEcA==',key_name='tempest-keypair-250399543',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fec0c6dc7ab46b0b6b0a580252f40e3',ramdisk_id='',reservation_id='r-d9g2es3z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2036744628',owner_user_name='tempest-AttachVolumeShelveTestJSON-2036744628-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:32:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e4935eed324b868477f8e88918364a',uuid=9439468d-7a45-443b-87ce-106907761a56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67b56c74-fc25-4bc8-875e-8a134830124b", "address": "fa:16:3e:14:ba:2c", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b56c74-fc", "ovs_interfaceid": "67b56c74-fc25-4bc8-875e-8a134830124b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Converting VIF {"id": "67b56c74-fc25-4bc8-875e-8a134830124b", "address": "fa:16:3e:14:ba:2c", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b56c74-fc", "ovs_interfaceid": "67b56c74-fc25-4bc8-875e-8a134830124b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:ba:2c,bridge_name='br-int',has_traffic_filtering=True,id=67b56c74-fc25-4bc8-875e-8a134830124b,network=Network(4ba97279-e122-4c2b-b931-dde33e1d71df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b56c74-fc') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG nova.objects.instance [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lazy-loading 'pci_devices' on Instance uuid 9439468d-7a45-443b-87ce-106907761a56 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b597d03-8252-4e26-a5a9-651117bf78d1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Cannot resize image /opt/stack/data/nova/instances/4b597d03-8252-4e26-a5a9-651117bf78d1/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG nova.objects.instance [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lazy-loading 'migration_context' on Instance uuid 4b597d03-8252-4e26-a5a9-651117bf78d1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:32:47 user nova-compute[71321]:   <uuid>9439468d-7a45-443b-87ce-106907761a56</uuid>
Apr 12 12:32:47 user nova-compute[71321]:   <name>instance-00000010</name>
Apr 12 12:32:47 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:32:47 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:32:47 user nova-compute[71321]:   <metadata>
Apr 12 12:32:47 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:32:47 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:32:47 user nova-compute[71321]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-806455308</nova:name>
Apr 12 12:32:47 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:32:47</nova:creationTime>
Apr 12 12:32:47 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:32:47 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:32:47 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:32:47 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:32:47 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:32:47 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:32:47 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:32:47 user nova-compute[71321]:       <nova:owner>
Apr 12 12:32:47 user nova-compute[71321]:         <nova:user uuid="46e4935eed324b868477f8e88918364a">tempest-AttachVolumeShelveTestJSON-2036744628-project-member</nova:user>
Apr 12 12:32:47 user nova-compute[71321]:         <nova:project uuid="5fec0c6dc7ab46b0b6b0a580252f40e3">tempest-AttachVolumeShelveTestJSON-2036744628</nova:project>
Apr 12 12:32:47 user nova-compute[71321]:       </nova:owner>
Apr 12 12:32:47 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:32:47 user nova-compute[71321]:       <nova:ports>
Apr 12 12:32:47 user nova-compute[71321]:         <nova:port uuid="67b56c74-fc25-4bc8-875e-8a134830124b">
Apr 12 12:32:47 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 12:32:47 user nova-compute[71321]:         </nova:port>
Apr 12 12:32:47 user nova-compute[71321]:       </nova:ports>
Apr 12 12:32:47 user nova-compute[71321]:     </nova:instance>
Apr 12 12:32:47 user nova-compute[71321]:   </metadata>
Apr 12 12:32:47 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:32:47 user nova-compute[71321]:     <system>
Apr 12 12:32:47 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:32:47 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:32:47 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:32:47 user nova-compute[71321]:       <entry name="serial">9439468d-7a45-443b-87ce-106907761a56</entry>
Apr 12 12:32:47 user nova-compute[71321]:       <entry name="uuid">9439468d-7a45-443b-87ce-106907761a56</entry>
Apr 12 12:32:47 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:32:47 user nova-compute[71321]:     </system>
Apr 12 12:32:47 user nova-compute[71321]:   </sysinfo>
Apr 12 12:32:47 user nova-compute[71321]:   <os>
Apr 12 12:32:47 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:32:47 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:32:47 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:32:47 user nova-compute[71321]:   </os>
Apr 12 12:32:47 user nova-compute[71321]:   <features>
Apr 12 12:32:47 user nova-compute[71321]:     <acpi/>
Apr 12 12:32:47 user nova-compute[71321]:     <apic/>
Apr 12 12:32:47 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:32:47 user nova-compute[71321]:   </features>
Apr 12 12:32:47 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:32:47 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:32:47 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:32:47 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:32:47 user nova-compute[71321]:   </clock>
Apr 12 12:32:47 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:32:47 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:32:47 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:32:47 user nova-compute[71321]:   </cpu>
Apr 12 12:32:47 user nova-compute[71321]:   <devices>
Apr 12 12:32:47 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:32:47 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:32:47 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk"/>
Apr 12 12:32:47 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:32:47 user nova-compute[71321]:     </disk>
Apr 12 12:32:47 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:32:47 user nova-compute[71321]:       <mac address="fa:16:3e:14:ba:2c"/>
Apr 12 12:32:47 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:32:47 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:32:47 user nova-compute[71321]:       <target dev="tap67b56c74-fc"/>
Apr 12 12:32:47 user nova-compute[71321]:     </interface>
Apr 12 12:32:47 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:32:47 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/console.log" append="off"/>
Apr 12 12:32:47 user nova-compute[71321]:     </serial>
Apr 12 12:32:47 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:32:47 user nova-compute[71321]:     <video>
Apr 12 12:32:47 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:32:47 user nova-compute[71321]:     </video>
Apr 12 12:32:47 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:32:47 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:32:47 user nova-compute[71321]:     </rng>
Apr 12 12:32:47 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:32:47 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:32:47 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:32:47 user nova-compute[71321]:     </memballoon>
Apr 12 12:32:47 user nova-compute[71321]:   </devices>
Apr 12 12:32:47 user nova-compute[71321]: </domain>
Apr 12 12:32:47 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:32:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-806455308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-806455308',id=16,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1ZrjP9KAJCgyaL5zcIDkfonF0SjjghGFN4rxSk+Gs/fi7zbEzghBorK6ScclR6/kTKn5pVT08v7lhEUGdgEMCcBQsph3fKqP0aQS3e3cPR0dYvUMVDLU1ho++DwuWEcA==',key_name='tempest-keypair-250399543',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fec0c6dc7ab46b0b6b0a580252f40e3',ramdisk_id='',reservation_id='r-d9g2es3z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2036744628',owner_user_name='tempest-AttachVolumeShelveTestJSON-2036744628-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:32:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e4935eed324b868477f8e88918364a',uuid=9439468d-7a45-443b-87ce-106907761a56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67b56c74-fc25-4bc8-875e-8a134830124b", "address": "fa:16:3e:14:ba:2c", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b56c74-fc", "ovs_interfaceid": "67b56c74-fc25-4bc8-875e-8a134830124b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Converting VIF {"id": "67b56c74-fc25-4bc8-875e-8a134830124b", "address": "fa:16:3e:14:ba:2c", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b56c74-fc", "ovs_interfaceid": "67b56c74-fc25-4bc8-875e-8a134830124b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:ba:2c,bridge_name='br-int',has_traffic_filtering=True,id=67b56c74-fc25-4bc8-875e-8a134830124b,network=Network(4ba97279-e122-4c2b-b931-dde33e1d71df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b56c74-fc') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG os_vif [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:ba:2c,bridge_name='br-int',has_traffic_filtering=True,id=67b56c74-fc25-4bc8-875e-8a134830124b,network=Network(4ba97279-e122-4c2b-b931-dde33e1d71df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b56c74-fc') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Ensure instance console log exists: /opt/stack/data/nova/instances/4b597d03-8252-4e26-a5a9-651117bf78d1/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67b56c74-fc, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap67b56c74-fc, col_values=(('external_ids', {'iface-id': '67b56c74-fc25-4bc8-875e-8a134830124b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:ba:2c', 'vm-uuid': '9439468d-7a45-443b-87ce-106907761a56'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:47 user nova-compute[71321]: INFO os_vif [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:ba:2c,bridge_name='br-int',has_traffic_filtering=True,id=67b56c74-fc25-4bc8-875e-8a134830124b,network=Network(4ba97279-e122-4c2b-b931-dde33e1d71df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b56c74-fc')
Apr 12 12:32:47 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] No VIF found with MAC fa:16:3e:14:ba:2c, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:32:47 user nova-compute[71321]: DEBUG nova.network.neutron [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Successfully created port: 77d477e8-bd8b-4918-af70-09d64ecf39d5 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:32:48 user nova-compute[71321]: DEBUG nova.network.neutron [req-e7b2cd5b-e264-4418-9fb7-2b44a3433c83 req-52a4d634-0bd6-4ebf-8635-798e7400a922 service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Updated VIF entry in instance network info cache for port 67b56c74-fc25-4bc8-875e-8a134830124b. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:32:48 user nova-compute[71321]: DEBUG nova.network.neutron [req-e7b2cd5b-e264-4418-9fb7-2b44a3433c83 req-52a4d634-0bd6-4ebf-8635-798e7400a922 service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Updating instance_info_cache with network_info: [{"id": "67b56c74-fc25-4bc8-875e-8a134830124b", "address": "fa:16:3e:14:ba:2c", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b56c74-fc", "ovs_interfaceid": "67b56c74-fc25-4bc8-875e-8a134830124b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:32:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e7b2cd5b-e264-4418-9fb7-2b44a3433c83 req-52a4d634-0bd6-4ebf-8635-798e7400a922 service nova] Releasing lock "refresh_cache-9439468d-7a45-443b-87ce-106907761a56" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:32:48 user nova-compute[71321]: DEBUG nova.network.neutron [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Successfully updated port: 77d477e8-bd8b-4918-af70-09d64ecf39d5 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:32:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "refresh_cache-4b597d03-8252-4e26-a5a9-651117bf78d1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:32:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquired lock "refresh_cache-4b597d03-8252-4e26-a5a9-651117bf78d1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:32:48 user nova-compute[71321]: DEBUG nova.network.neutron [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:32:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:48 user nova-compute[71321]: DEBUG nova.compute.manager [req-d50f3103-6bb7-4f7c-87b3-b83c65d9105a req-cc54ae35-8fe6-4e70-a52b-1adad56d3abc service nova] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Received event network-changed-77d477e8-bd8b-4918-af70-09d64ecf39d5 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:32:48 user nova-compute[71321]: DEBUG nova.compute.manager [req-d50f3103-6bb7-4f7c-87b3-b83c65d9105a req-cc54ae35-8fe6-4e70-a52b-1adad56d3abc service nova] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Refreshing instance network info cache due to event network-changed-77d477e8-bd8b-4918-af70-09d64ecf39d5. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:32:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d50f3103-6bb7-4f7c-87b3-b83c65d9105a req-cc54ae35-8fe6-4e70-a52b-1adad56d3abc service nova] Acquiring lock "refresh_cache-4b597d03-8252-4e26-a5a9-651117bf78d1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:32:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:48 user nova-compute[71321]: DEBUG nova.network.neutron [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:32:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:49 user nova-compute[71321]: DEBUG nova.network.neutron [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Updating instance_info_cache with network_info: [{"id": "77d477e8-bd8b-4918-af70-09d64ecf39d5", "address": "fa:16:3e:ff:04:04", "network": {"id": "0fcb9046-707e-462c-937c-3ba5aebe64e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-529948515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "466d2a494cf64002a98588909bdcd197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d477e8-bd", "ovs_interfaceid": "77d477e8-bd8b-4918-af70-09d64ecf39d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:32:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Releasing lock "refresh_cache-4b597d03-8252-4e26-a5a9-651117bf78d1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:32:49 user nova-compute[71321]: DEBUG nova.compute.manager [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Instance network_info: |[{"id": "77d477e8-bd8b-4918-af70-09d64ecf39d5", "address": "fa:16:3e:ff:04:04", "network": {"id": "0fcb9046-707e-462c-937c-3ba5aebe64e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-529948515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "466d2a494cf64002a98588909bdcd197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d477e8-bd", "ovs_interfaceid": "77d477e8-bd8b-4918-af70-09d64ecf39d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:32:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d50f3103-6bb7-4f7c-87b3-b83c65d9105a req-cc54ae35-8fe6-4e70-a52b-1adad56d3abc service nova] Acquired lock "refresh_cache-4b597d03-8252-4e26-a5a9-651117bf78d1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:32:49 user nova-compute[71321]: DEBUG nova.network.neutron [req-d50f3103-6bb7-4f7c-87b3-b83c65d9105a req-cc54ae35-8fe6-4e70-a52b-1adad56d3abc service nova] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Refreshing network info cache for port 77d477e8-bd8b-4918-af70-09d64ecf39d5 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:32:49 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Start _get_guest_xml network_info=[{"id": "77d477e8-bd8b-4918-af70-09d64ecf39d5", "address": "fa:16:3e:ff:04:04", "network": {"id": "0fcb9046-707e-462c-937c-3ba5aebe64e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-529948515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "466d2a494cf64002a98588909bdcd197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d477e8-bd", "ovs_interfaceid": "77d477e8-bd8b-4918-af70-09d64ecf39d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:32:49 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:32:49 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:32:49 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:32:49 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:32:49 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:32:49 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:32:49 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:32:49 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:32:49 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:32:49 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:32:49 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:32:49 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:32:49 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:32:49 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:32:50 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:32:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1237193295',display_name='tempest-VolumesSnapshotTestJSON-instance-1237193295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1237193295',id=17,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='466d2a494cf64002a98588909bdcd197',ramdisk_id='',reservation_id='r-fmq4y5ha',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-760244133',owner_user_name='tempest-VolumesSnapshotTestJSON-760244133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:32:46Z,user_data=None,user_id='35727e3b48da4494808015e2b630a3f9',uuid=4b597d03-8252-4e26-a5a9-651117bf78d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77d477e8-bd8b-4918-af70-09d64ecf39d5", "address": "fa:16:3e:ff:04:04", "network": {"id": "0fcb9046-707e-462c-937c-3ba5aebe64e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-529948515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "466d2a494cf64002a98588909bdcd197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d477e8-bd", "ovs_interfaceid": "77d477e8-bd8b-4918-af70-09d64ecf39d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:32:50 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Converting VIF {"id": "77d477e8-bd8b-4918-af70-09d64ecf39d5", "address": "fa:16:3e:ff:04:04", "network": {"id": "0fcb9046-707e-462c-937c-3ba5aebe64e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-529948515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "466d2a494cf64002a98588909bdcd197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d477e8-bd", "ovs_interfaceid": "77d477e8-bd8b-4918-af70-09d64ecf39d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:32:50 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:04:04,bridge_name='br-int',has_traffic_filtering=True,id=77d477e8-bd8b-4918-af70-09d64ecf39d5,network=Network(0fcb9046-707e-462c-937c-3ba5aebe64e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77d477e8-bd') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:32:50 user nova-compute[71321]: DEBUG nova.objects.instance [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b597d03-8252-4e26-a5a9-651117bf78d1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:32:50 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:32:50 user nova-compute[71321]:   <uuid>4b597d03-8252-4e26-a5a9-651117bf78d1</uuid>
Apr 12 12:32:50 user nova-compute[71321]:   <name>instance-00000011</name>
Apr 12 12:32:50 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:32:50 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:32:50 user nova-compute[71321]:   <metadata>
Apr 12 12:32:50 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:32:50 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:32:50 user nova-compute[71321]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1237193295</nova:name>
Apr 12 12:32:50 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:32:49</nova:creationTime>
Apr 12 12:32:50 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:32:50 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:32:50 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:32:50 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:32:50 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:32:50 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:32:50 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:32:50 user nova-compute[71321]:       <nova:owner>
Apr 12 12:32:50 user nova-compute[71321]:         <nova:user uuid="35727e3b48da4494808015e2b630a3f9">tempest-VolumesSnapshotTestJSON-760244133-project-member</nova:user>
Apr 12 12:32:50 user nova-compute[71321]:         <nova:project uuid="466d2a494cf64002a98588909bdcd197">tempest-VolumesSnapshotTestJSON-760244133</nova:project>
Apr 12 12:32:50 user nova-compute[71321]:       </nova:owner>
Apr 12 12:32:50 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:32:50 user nova-compute[71321]:       <nova:ports>
Apr 12 12:32:50 user nova-compute[71321]:         <nova:port uuid="77d477e8-bd8b-4918-af70-09d64ecf39d5">
Apr 12 12:32:50 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 12:32:50 user nova-compute[71321]:         </nova:port>
Apr 12 12:32:50 user nova-compute[71321]:       </nova:ports>
Apr 12 12:32:50 user nova-compute[71321]:     </nova:instance>
Apr 12 12:32:50 user nova-compute[71321]:   </metadata>
Apr 12 12:32:50 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:32:50 user nova-compute[71321]:     <system>
Apr 12 12:32:50 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:32:50 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:32:50 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:32:50 user nova-compute[71321]:       <entry name="serial">4b597d03-8252-4e26-a5a9-651117bf78d1</entry>
Apr 12 12:32:50 user nova-compute[71321]:       <entry name="uuid">4b597d03-8252-4e26-a5a9-651117bf78d1</entry>
Apr 12 12:32:50 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:32:50 user nova-compute[71321]:     </system>
Apr 12 12:32:50 user nova-compute[71321]:   </sysinfo>
Apr 12 12:32:50 user nova-compute[71321]:   <os>
Apr 12 12:32:50 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:32:50 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:32:50 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:32:50 user nova-compute[71321]:   </os>
Apr 12 12:32:50 user nova-compute[71321]:   <features>
Apr 12 12:32:50 user nova-compute[71321]:     <acpi/>
Apr 12 12:32:50 user nova-compute[71321]:     <apic/>
Apr 12 12:32:50 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:32:50 user nova-compute[71321]:   </features>
Apr 12 12:32:50 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:32:50 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:32:50 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:32:50 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:32:50 user nova-compute[71321]:   </clock>
Apr 12 12:32:50 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:32:50 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:32:50 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:32:50 user nova-compute[71321]:   </cpu>
Apr 12 12:32:50 user nova-compute[71321]:   <devices>
Apr 12 12:32:50 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:32:50 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:32:50 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/4b597d03-8252-4e26-a5a9-651117bf78d1/disk"/>
Apr 12 12:32:50 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:32:50 user nova-compute[71321]:     </disk>
Apr 12 12:32:50 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:32:50 user nova-compute[71321]:       <mac address="fa:16:3e:ff:04:04"/>
Apr 12 12:32:50 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:32:50 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:32:50 user nova-compute[71321]:       <target dev="tap77d477e8-bd"/>
Apr 12 12:32:50 user nova-compute[71321]:     </interface>
Apr 12 12:32:50 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:32:50 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/4b597d03-8252-4e26-a5a9-651117bf78d1/console.log" append="off"/>
Apr 12 12:32:50 user nova-compute[71321]:     </serial>
Apr 12 12:32:50 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:32:50 user nova-compute[71321]:     <video>
Apr 12 12:32:50 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:32:50 user nova-compute[71321]:     </video>
Apr 12 12:32:50 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:32:50 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:32:50 user nova-compute[71321]:     </rng>
Apr 12 12:32:50 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:32:50 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:32:50 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:32:50 user nova-compute[71321]:     </memballoon>
Apr 12 12:32:50 user nova-compute[71321]:   </devices>
Apr 12 12:32:50 user nova-compute[71321]: </domain>
Apr 12 12:32:50 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:32:50 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:32:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1237193295',display_name='tempest-VolumesSnapshotTestJSON-instance-1237193295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1237193295',id=17,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='466d2a494cf64002a98588909bdcd197',ramdisk_id='',reservation_id='r-fmq4y5ha',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-760244133',owner_user_name='tempest-VolumesSnapshotTestJSON-760244133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:32:46Z,user_data=None,user_id='35727e3b48da4494808015e2b630a3f9',uuid=4b597d03-8252-4e26-a5a9-651117bf78d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77d477e8-bd8b-4918-af70-09d64ecf39d5", "address": "fa:16:3e:ff:04:04", "network": {"id": "0fcb9046-707e-462c-937c-3ba5aebe64e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-529948515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "466d2a494cf64002a98588909bdcd197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d477e8-bd", "ovs_interfaceid": "77d477e8-bd8b-4918-af70-09d64ecf39d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:32:50 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Converting VIF {"id": "77d477e8-bd8b-4918-af70-09d64ecf39d5", "address": "fa:16:3e:ff:04:04", "network": {"id": "0fcb9046-707e-462c-937c-3ba5aebe64e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-529948515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "466d2a494cf64002a98588909bdcd197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d477e8-bd", "ovs_interfaceid": "77d477e8-bd8b-4918-af70-09d64ecf39d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:32:50 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:04:04,bridge_name='br-int',has_traffic_filtering=True,id=77d477e8-bd8b-4918-af70-09d64ecf39d5,network=Network(0fcb9046-707e-462c-937c-3ba5aebe64e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77d477e8-bd') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:32:50 user nova-compute[71321]: DEBUG os_vif [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:04:04,bridge_name='br-int',has_traffic_filtering=True,id=77d477e8-bd8b-4918-af70-09d64ecf39d5,network=Network(0fcb9046-707e-462c-937c-3ba5aebe64e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77d477e8-bd') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:32:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:32:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:32:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77d477e8-bd, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:32:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap77d477e8-bd, col_values=(('external_ids', {'iface-id': '77d477e8-bd8b-4918-af70-09d64ecf39d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:04:04', 'vm-uuid': '4b597d03-8252-4e26-a5a9-651117bf78d1'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:32:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:32:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:50 user nova-compute[71321]: INFO os_vif [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:04:04,bridge_name='br-int',has_traffic_filtering=True,id=77d477e8-bd8b-4918-af70-09d64ecf39d5,network=Network(0fcb9046-707e-462c-937c-3ba5aebe64e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77d477e8-bd')
Apr 12 12:32:50 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:32:50 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] No VIF found with MAC fa:16:3e:ff:04:04, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:32:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:50 user nova-compute[71321]: DEBUG nova.network.neutron [req-d50f3103-6bb7-4f7c-87b3-b83c65d9105a req-cc54ae35-8fe6-4e70-a52b-1adad56d3abc service nova] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Updated VIF entry in instance network info cache for port 77d477e8-bd8b-4918-af70-09d64ecf39d5. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:32:50 user nova-compute[71321]: DEBUG nova.network.neutron [req-d50f3103-6bb7-4f7c-87b3-b83c65d9105a req-cc54ae35-8fe6-4e70-a52b-1adad56d3abc service nova] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Updating instance_info_cache with network_info: [{"id": "77d477e8-bd8b-4918-af70-09d64ecf39d5", "address": "fa:16:3e:ff:04:04", "network": {"id": "0fcb9046-707e-462c-937c-3ba5aebe64e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-529948515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "466d2a494cf64002a98588909bdcd197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d477e8-bd", "ovs_interfaceid": "77d477e8-bd8b-4918-af70-09d64ecf39d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:32:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d50f3103-6bb7-4f7c-87b3-b83c65d9105a req-cc54ae35-8fe6-4e70-a52b-1adad56d3abc service nova] Releasing lock "refresh_cache-4b597d03-8252-4e26-a5a9-651117bf78d1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:32:50 user nova-compute[71321]: DEBUG nova.compute.manager [req-d6c9e3bf-7d9e-43b2-b1c4-c073fa084e50 req-15014306-6022-41cd-a4ac-4509f7ea8ab4 service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Received event network-vif-plugged-67b56c74-fc25-4bc8-875e-8a134830124b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:32:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d6c9e3bf-7d9e-43b2-b1c4-c073fa084e50 req-15014306-6022-41cd-a4ac-4509f7ea8ab4 service nova] Acquiring lock "9439468d-7a45-443b-87ce-106907761a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d6c9e3bf-7d9e-43b2-b1c4-c073fa084e50 req-15014306-6022-41cd-a4ac-4509f7ea8ab4 service nova] Lock "9439468d-7a45-443b-87ce-106907761a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d6c9e3bf-7d9e-43b2-b1c4-c073fa084e50 req-15014306-6022-41cd-a4ac-4509f7ea8ab4 service nova] Lock "9439468d-7a45-443b-87ce-106907761a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:50 user nova-compute[71321]: DEBUG nova.compute.manager [req-d6c9e3bf-7d9e-43b2-b1c4-c073fa084e50 req-15014306-6022-41cd-a4ac-4509f7ea8ab4 service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] No waiting events found dispatching network-vif-plugged-67b56c74-fc25-4bc8-875e-8a134830124b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:32:50 user nova-compute[71321]: WARNING nova.compute.manager [req-d6c9e3bf-7d9e-43b2-b1c4-c073fa084e50 req-15014306-6022-41cd-a4ac-4509f7ea8ab4 service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Received unexpected event network-vif-plugged-67b56c74-fc25-4bc8-875e-8a134830124b for instance with vm_state building and task_state spawning.
Apr 12 12:32:50 user nova-compute[71321]: DEBUG nova.compute.manager [req-d6c9e3bf-7d9e-43b2-b1c4-c073fa084e50 req-15014306-6022-41cd-a4ac-4509f7ea8ab4 service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Received event network-vif-plugged-67b56c74-fc25-4bc8-875e-8a134830124b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:32:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d6c9e3bf-7d9e-43b2-b1c4-c073fa084e50 req-15014306-6022-41cd-a4ac-4509f7ea8ab4 service nova] Acquiring lock "9439468d-7a45-443b-87ce-106907761a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d6c9e3bf-7d9e-43b2-b1c4-c073fa084e50 req-15014306-6022-41cd-a4ac-4509f7ea8ab4 service nova] Lock "9439468d-7a45-443b-87ce-106907761a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d6c9e3bf-7d9e-43b2-b1c4-c073fa084e50 req-15014306-6022-41cd-a4ac-4509f7ea8ab4 service nova] Lock "9439468d-7a45-443b-87ce-106907761a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:50 user nova-compute[71321]: DEBUG nova.compute.manager [req-d6c9e3bf-7d9e-43b2-b1c4-c073fa084e50 req-15014306-6022-41cd-a4ac-4509f7ea8ab4 service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] No waiting events found dispatching network-vif-plugged-67b56c74-fc25-4bc8-875e-8a134830124b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:32:50 user nova-compute[71321]: WARNING nova.compute.manager [req-d6c9e3bf-7d9e-43b2-b1c4-c073fa084e50 req-15014306-6022-41cd-a4ac-4509f7ea8ab4 service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Received unexpected event network-vif-plugged-67b56c74-fc25-4bc8-875e-8a134830124b for instance with vm_state building and task_state spawning.
Apr 12 12:32:51 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302771.3229868, 9439468d-7a45-443b-87ce-106907761a56 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:32:51 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 9439468d-7a45-443b-87ce-106907761a56] VM Resumed (Lifecycle Event)
Apr 12 12:32:51 user nova-compute[71321]: DEBUG nova.compute.manager [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:32:51 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:32:51 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 9439468d-7a45-443b-87ce-106907761a56] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:32:51 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 9439468d-7a45-443b-87ce-106907761a56] Instance spawned successfully.
Apr 12 12:32:51 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:32:51 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 9439468d-7a45-443b-87ce-106907761a56] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:32:51 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 9439468d-7a45-443b-87ce-106907761a56] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:32:51 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302771.3283904, 9439468d-7a45-443b-87ce-106907761a56 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:32:51 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 9439468d-7a45-443b-87ce-106907761a56] VM Started (Lifecycle Event)
Apr 12 12:32:51 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:32:51 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:32:51 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:32:51 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:32:51 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:32:51 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:32:51 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 9439468d-7a45-443b-87ce-106907761a56] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:32:51 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 9439468d-7a45-443b-87ce-106907761a56] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:32:51 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 9439468d-7a45-443b-87ce-106907761a56] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:32:51 user nova-compute[71321]: INFO nova.compute.manager [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Took 6.56 seconds to spawn the instance on the hypervisor.
Apr 12 12:32:51 user nova-compute[71321]: DEBUG nova.compute.manager [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:32:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:51 user nova-compute[71321]: INFO nova.compute.manager [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Took 7.57 seconds to build instance.
Apr 12 12:32:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "9439468d-7a45-443b-87ce-106907761a56" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.685s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:51 user nova-compute[71321]: DEBUG nova.compute.manager [req-4722d876-d9cc-4cfa-abd1-22082dd47320 req-7047e40e-09a2-4e23-a8c9-52832b224c81 service nova] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Received event network-vif-plugged-77d477e8-bd8b-4918-af70-09d64ecf39d5 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:32:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4722d876-d9cc-4cfa-abd1-22082dd47320 req-7047e40e-09a2-4e23-a8c9-52832b224c81 service nova] Acquiring lock "4b597d03-8252-4e26-a5a9-651117bf78d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4722d876-d9cc-4cfa-abd1-22082dd47320 req-7047e40e-09a2-4e23-a8c9-52832b224c81 service nova] Lock "4b597d03-8252-4e26-a5a9-651117bf78d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4722d876-d9cc-4cfa-abd1-22082dd47320 req-7047e40e-09a2-4e23-a8c9-52832b224c81 service nova] Lock "4b597d03-8252-4e26-a5a9-651117bf78d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:51 user nova-compute[71321]: DEBUG nova.compute.manager [req-4722d876-d9cc-4cfa-abd1-22082dd47320 req-7047e40e-09a2-4e23-a8c9-52832b224c81 service nova] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] No waiting events found dispatching network-vif-plugged-77d477e8-bd8b-4918-af70-09d64ecf39d5 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:32:51 user nova-compute[71321]: WARNING nova.compute.manager [req-4722d876-d9cc-4cfa-abd1-22082dd47320 req-7047e40e-09a2-4e23-a8c9-52832b224c81 service nova] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Received unexpected event network-vif-plugged-77d477e8-bd8b-4918-af70-09d64ecf39d5 for instance with vm_state building and task_state spawning.
Apr 12 12:32:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:53 user nova-compute[71321]: DEBUG nova.compute.manager [req-676d7e3a-7981-4014-bb94-10d78f2423de req-432c0cc6-c2b8-472a-98c2-5e4911452539 service nova] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Received event network-vif-plugged-77d477e8-bd8b-4918-af70-09d64ecf39d5 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:32:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-676d7e3a-7981-4014-bb94-10d78f2423de req-432c0cc6-c2b8-472a-98c2-5e4911452539 service nova] Acquiring lock "4b597d03-8252-4e26-a5a9-651117bf78d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:32:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-676d7e3a-7981-4014-bb94-10d78f2423de req-432c0cc6-c2b8-472a-98c2-5e4911452539 service nova] Lock "4b597d03-8252-4e26-a5a9-651117bf78d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:32:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-676d7e3a-7981-4014-bb94-10d78f2423de req-432c0cc6-c2b8-472a-98c2-5e4911452539 service nova] Lock "4b597d03-8252-4e26-a5a9-651117bf78d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:53 user nova-compute[71321]: DEBUG nova.compute.manager [req-676d7e3a-7981-4014-bb94-10d78f2423de req-432c0cc6-c2b8-472a-98c2-5e4911452539 service nova] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] No waiting events found dispatching network-vif-plugged-77d477e8-bd8b-4918-af70-09d64ecf39d5 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:32:53 user nova-compute[71321]: WARNING nova.compute.manager [req-676d7e3a-7981-4014-bb94-10d78f2423de req-432c0cc6-c2b8-472a-98c2-5e4911452539 service nova] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Received unexpected event network-vif-plugged-77d477e8-bd8b-4918-af70-09d64ecf39d5 for instance with vm_state building and task_state spawning.
Apr 12 12:32:54 user nova-compute[71321]: DEBUG nova.compute.manager [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:32:54 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:32:54 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302774.1888034, 4b597d03-8252-4e26-a5a9-651117bf78d1 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:32:54 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] VM Resumed (Lifecycle Event)
Apr 12 12:32:54 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:32:54 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Instance spawned successfully.
Apr 12 12:32:54 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:32:54 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:32:54 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:32:54 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302774.1889122, 4b597d03-8252-4e26-a5a9-651117bf78d1 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:32:54 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] VM Started (Lifecycle Event)
Apr 12 12:32:54 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:32:54 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:32:54 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:32:54 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:32:54 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:32:54 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:32:54 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:32:54 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:32:54 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:32:54 user nova-compute[71321]: INFO nova.compute.manager [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Took 7.79 seconds to spawn the instance on the hypervisor.
Apr 12 12:32:54 user nova-compute[71321]: DEBUG nova.compute.manager [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:32:54 user nova-compute[71321]: INFO nova.compute.manager [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Took 8.69 seconds to build instance.
Apr 12 12:32:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "4b597d03-8252-4e26-a5a9-651117bf78d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.789s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:32:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:32:59 user nova-compute[71321]: INFO nova.compute.manager [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Rescuing
Apr 12 12:32:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "refresh_cache-10116da0-785c-41cf-96bb-95721af863db" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:32:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquired lock "refresh_cache-10116da0-785c-41cf-96bb-95721af863db" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:32:59 user nova-compute[71321]: DEBUG nova.network.neutron [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:33:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:00 user nova-compute[71321]: DEBUG nova.network.neutron [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Updating instance_info_cache with network_info: [{"id": "cbb69638-6a5f-4d12-8737-45850145fa0e", "address": "fa:16:3e:57:7c:99", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb69638-6a", "ovs_interfaceid": "cbb69638-6a5f-4d12-8737-45850145fa0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:33:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Releasing lock "refresh_cache-10116da0-785c-41cf-96bb-95721af863db" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:33:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG nova.compute.manager [req-15320253-0cfa-40fe-85c5-2d36e53eec03 req-066a3938-f0c7-4a55-baa6-c261a29523ff service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] Received event network-vif-unplugged-cbb69638-6a5f-4d12-8737-45850145fa0e {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-15320253-0cfa-40fe-85c5-2d36e53eec03 req-066a3938-f0c7-4a55-baa6-c261a29523ff service nova] Acquiring lock "10116da0-785c-41cf-96bb-95721af863db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-15320253-0cfa-40fe-85c5-2d36e53eec03 req-066a3938-f0c7-4a55-baa6-c261a29523ff service nova] Lock "10116da0-785c-41cf-96bb-95721af863db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-15320253-0cfa-40fe-85c5-2d36e53eec03 req-066a3938-f0c7-4a55-baa6-c261a29523ff service nova] Lock "10116da0-785c-41cf-96bb-95721af863db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG nova.compute.manager [req-15320253-0cfa-40fe-85c5-2d36e53eec03 req-066a3938-f0c7-4a55-baa6-c261a29523ff service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] No waiting events found dispatching network-vif-unplugged-cbb69638-6a5f-4d12-8737-45850145fa0e {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:33:01 user nova-compute[71321]: WARNING nova.compute.manager [req-15320253-0cfa-40fe-85c5-2d36e53eec03 req-066a3938-f0c7-4a55-baa6-c261a29523ff service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] Received unexpected event network-vif-unplugged-cbb69638-6a5f-4d12-8737-45850145fa0e for instance with vm_state active and task_state rescuing.
Apr 12 12:33:01 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 10116da0-785c-41cf-96bb-95721af863db] Instance destroyed successfully.
Apr 12 12:33:01 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Attempting rescue
Apr 12 12:33:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71321) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Instance directory exists: not creating {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 12:33:01 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Creating image(s)
Apr 12 12:33:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "/opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "/opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "/opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG nova.objects.instance [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'trusted_certs' on Instance uuid 10116da0-785c-41cf-96bb-95721af863db {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.137s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk.rescue {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk.rescue" returned: 0 in 0.057s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG nova.objects.instance [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'migration_context' on Instance uuid 10116da0-785c-41cf-96bb-95721af863db {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Start _get_guest_xml network_info=[{"id": "cbb69638-6a5f-4d12-8737-45850145fa0e", "address": "fa:16:3e:57:7c:99", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "vif_mac": "fa:16:3e:57:7c:99"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb69638-6a", "ovs_interfaceid": "cbb69638-6a5f-4d12-8737-45850145fa0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG nova.objects.instance [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'resources' on Instance uuid 10116da0-785c-41cf-96bb-95721af863db {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG nova.objects.instance [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'numa_topology' on Instance uuid 10116da0-785c-41cf-96bb-95721af863db {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:33:01 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:33:01 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:33:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG nova.objects.instance [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'vcpu_model' on Instance uuid 10116da0-785c-41cf-96bb-95721af863db {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:28:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1720191836',display_name='tempest-ServerRescueNegativeTestJSON-server-1720191836',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1720191836',id=1,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:28:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9ec9671123c4a00a2880de4b4df8d3e',ramdisk_id='',reservation_id='r-68hyvfbd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1979263125',owner_user_name='tempest-ServerRescueNegativeTestJSON-1979263125-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:28:32Z,user_data=None,user_id='1db0203a6e6f4cc3bccbf19577a0c82f',uuid=10116da0-785c-41cf-96bb-95721af863db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cbb69638-6a5f-4d12-8737-45850145fa0e", "address": "fa:16:3e:57:7c:99", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "vif_mac": "fa:16:3e:57:7c:99"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb69638-6a", "ovs_interfaceid": "cbb69638-6a5f-4d12-8737-45850145fa0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Converting VIF {"id": "cbb69638-6a5f-4d12-8737-45850145fa0e", "address": "fa:16:3e:57:7c:99", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "vif_mac": "fa:16:3e:57:7c:99"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb69638-6a", "ovs_interfaceid": "cbb69638-6a5f-4d12-8737-45850145fa0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:7c:99,bridge_name='br-int',has_traffic_filtering=True,id=cbb69638-6a5f-4d12-8737-45850145fa0e,network=Network(0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbb69638-6a') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG nova.objects.instance [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'pci_devices' on Instance uuid 10116da0-785c-41cf-96bb-95721af863db {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:33:01 user nova-compute[71321]:   <uuid>10116da0-785c-41cf-96bb-95721af863db</uuid>
Apr 12 12:33:01 user nova-compute[71321]:   <name>instance-00000001</name>
Apr 12 12:33:01 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:33:01 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:33:01 user nova-compute[71321]:   <metadata>
Apr 12 12:33:01 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:33:01 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:33:01 user nova-compute[71321]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1720191836</nova:name>
Apr 12 12:33:01 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:33:01</nova:creationTime>
Apr 12 12:33:01 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:33:01 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:33:01 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:33:01 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:33:01 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:33:01 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:33:01 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:33:01 user nova-compute[71321]:       <nova:owner>
Apr 12 12:33:01 user nova-compute[71321]:         <nova:user uuid="1db0203a6e6f4cc3bccbf19577a0c82f">tempest-ServerRescueNegativeTestJSON-1979263125-project-member</nova:user>
Apr 12 12:33:01 user nova-compute[71321]:         <nova:project uuid="f9ec9671123c4a00a2880de4b4df8d3e">tempest-ServerRescueNegativeTestJSON-1979263125</nova:project>
Apr 12 12:33:01 user nova-compute[71321]:       </nova:owner>
Apr 12 12:33:01 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:33:01 user nova-compute[71321]:       <nova:ports>
Apr 12 12:33:01 user nova-compute[71321]:         <nova:port uuid="cbb69638-6a5f-4d12-8737-45850145fa0e">
Apr 12 12:33:01 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 12:33:01 user nova-compute[71321]:         </nova:port>
Apr 12 12:33:01 user nova-compute[71321]:       </nova:ports>
Apr 12 12:33:01 user nova-compute[71321]:     </nova:instance>
Apr 12 12:33:01 user nova-compute[71321]:   </metadata>
Apr 12 12:33:01 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:33:01 user nova-compute[71321]:     <system>
Apr 12 12:33:01 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:33:01 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:33:01 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:33:01 user nova-compute[71321]:       <entry name="serial">10116da0-785c-41cf-96bb-95721af863db</entry>
Apr 12 12:33:01 user nova-compute[71321]:       <entry name="uuid">10116da0-785c-41cf-96bb-95721af863db</entry>
Apr 12 12:33:01 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:33:01 user nova-compute[71321]:     </system>
Apr 12 12:33:01 user nova-compute[71321]:   </sysinfo>
Apr 12 12:33:01 user nova-compute[71321]:   <os>
Apr 12 12:33:01 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:33:01 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:33:01 user nova-compute[71321]:   </os>
Apr 12 12:33:01 user nova-compute[71321]:   <features>
Apr 12 12:33:01 user nova-compute[71321]:     <acpi/>
Apr 12 12:33:01 user nova-compute[71321]:     <apic/>
Apr 12 12:33:01 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:33:01 user nova-compute[71321]:   </features>
Apr 12 12:33:01 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:33:01 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:33:01 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:33:01 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:33:01 user nova-compute[71321]:   </clock>
Apr 12 12:33:01 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:33:01 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:33:01 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:33:01 user nova-compute[71321]:   </cpu>
Apr 12 12:33:01 user nova-compute[71321]:   <devices>
Apr 12 12:33:01 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:33:01 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:33:01 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk.rescue"/>
Apr 12 12:33:01 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:33:01 user nova-compute[71321]:     </disk>
Apr 12 12:33:01 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:33:01 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:33:01 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk"/>
Apr 12 12:33:01 user nova-compute[71321]:       <target dev="vdb" bus="virtio"/>
Apr 12 12:33:01 user nova-compute[71321]:     </disk>
Apr 12 12:33:01 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:33:01 user nova-compute[71321]:       <mac address="fa:16:3e:57:7c:99"/>
Apr 12 12:33:01 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:33:01 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:33:01 user nova-compute[71321]:       <target dev="tapcbb69638-6a"/>
Apr 12 12:33:01 user nova-compute[71321]:     </interface>
Apr 12 12:33:01 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:33:01 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/console.log" append="off"/>
Apr 12 12:33:01 user nova-compute[71321]:     </serial>
Apr 12 12:33:01 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:33:01 user nova-compute[71321]:     <video>
Apr 12 12:33:01 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:33:01 user nova-compute[71321]:     </video>
Apr 12 12:33:01 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:33:01 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:33:01 user nova-compute[71321]:     </rng>
Apr 12 12:33:01 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:33:01 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:33:01 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:33:01 user nova-compute[71321]:     </memballoon>
Apr 12 12:33:01 user nova-compute[71321]:   </devices>
Apr 12 12:33:01 user nova-compute[71321]: </domain>
Apr 12 12:33:01 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:01 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 10116da0-785c-41cf-96bb-95721af863db] Instance destroyed successfully.
Apr 12 12:33:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:33:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] No VIF found with MAC fa:16:3e:57:7c:99, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:33:03 user nova-compute[71321]: DEBUG nova.compute.manager [req-3a642664-2d77-46be-8055-d34fe164c475 req-28b02d2a-37f5-4b90-b743-e49ea29997a1 service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] Received event network-vif-plugged-cbb69638-6a5f-4d12-8737-45850145fa0e {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:33:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3a642664-2d77-46be-8055-d34fe164c475 req-28b02d2a-37f5-4b90-b743-e49ea29997a1 service nova] Acquiring lock "10116da0-785c-41cf-96bb-95721af863db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:33:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3a642664-2d77-46be-8055-d34fe164c475 req-28b02d2a-37f5-4b90-b743-e49ea29997a1 service nova] Lock "10116da0-785c-41cf-96bb-95721af863db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:33:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3a642664-2d77-46be-8055-d34fe164c475 req-28b02d2a-37f5-4b90-b743-e49ea29997a1 service nova] Lock "10116da0-785c-41cf-96bb-95721af863db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:33:03 user nova-compute[71321]: DEBUG nova.compute.manager [req-3a642664-2d77-46be-8055-d34fe164c475 req-28b02d2a-37f5-4b90-b743-e49ea29997a1 service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] No waiting events found dispatching network-vif-plugged-cbb69638-6a5f-4d12-8737-45850145fa0e {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:33:03 user nova-compute[71321]: WARNING nova.compute.manager [req-3a642664-2d77-46be-8055-d34fe164c475 req-28b02d2a-37f5-4b90-b743-e49ea29997a1 service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] Received unexpected event network-vif-plugged-cbb69638-6a5f-4d12-8737-45850145fa0e for instance with vm_state active and task_state rescuing.
Apr 12 12:33:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:05 user nova-compute[71321]: DEBUG nova.compute.manager [req-c5250ba4-aa96-45cf-ad1c-2cd35139e1d0 req-a01b1ff0-a18d-47bc-bf0c-190739e2b0be service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] Received event network-vif-plugged-cbb69638-6a5f-4d12-8737-45850145fa0e {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:33:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c5250ba4-aa96-45cf-ad1c-2cd35139e1d0 req-a01b1ff0-a18d-47bc-bf0c-190739e2b0be service nova] Acquiring lock "10116da0-785c-41cf-96bb-95721af863db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:33:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c5250ba4-aa96-45cf-ad1c-2cd35139e1d0 req-a01b1ff0-a18d-47bc-bf0c-190739e2b0be service nova] Lock "10116da0-785c-41cf-96bb-95721af863db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:33:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c5250ba4-aa96-45cf-ad1c-2cd35139e1d0 req-a01b1ff0-a18d-47bc-bf0c-190739e2b0be service nova] Lock "10116da0-785c-41cf-96bb-95721af863db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:33:05 user nova-compute[71321]: DEBUG nova.compute.manager [req-c5250ba4-aa96-45cf-ad1c-2cd35139e1d0 req-a01b1ff0-a18d-47bc-bf0c-190739e2b0be service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] No waiting events found dispatching network-vif-plugged-cbb69638-6a5f-4d12-8737-45850145fa0e {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:33:05 user nova-compute[71321]: WARNING nova.compute.manager [req-c5250ba4-aa96-45cf-ad1c-2cd35139e1d0 req-a01b1ff0-a18d-47bc-bf0c-190739e2b0be service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] Received unexpected event network-vif-plugged-cbb69638-6a5f-4d12-8737-45850145fa0e for instance with vm_state active and task_state rescuing.
Apr 12 12:33:05 user nova-compute[71321]: DEBUG nova.compute.manager [req-c5250ba4-aa96-45cf-ad1c-2cd35139e1d0 req-a01b1ff0-a18d-47bc-bf0c-190739e2b0be service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] Received event network-vif-plugged-cbb69638-6a5f-4d12-8737-45850145fa0e {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:33:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c5250ba4-aa96-45cf-ad1c-2cd35139e1d0 req-a01b1ff0-a18d-47bc-bf0c-190739e2b0be service nova] Acquiring lock "10116da0-785c-41cf-96bb-95721af863db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:33:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c5250ba4-aa96-45cf-ad1c-2cd35139e1d0 req-a01b1ff0-a18d-47bc-bf0c-190739e2b0be service nova] Lock "10116da0-785c-41cf-96bb-95721af863db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:33:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c5250ba4-aa96-45cf-ad1c-2cd35139e1d0 req-a01b1ff0-a18d-47bc-bf0c-190739e2b0be service nova] Lock "10116da0-785c-41cf-96bb-95721af863db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:33:05 user nova-compute[71321]: DEBUG nova.compute.manager [req-c5250ba4-aa96-45cf-ad1c-2cd35139e1d0 req-a01b1ff0-a18d-47bc-bf0c-190739e2b0be service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] No waiting events found dispatching network-vif-plugged-cbb69638-6a5f-4d12-8737-45850145fa0e {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:33:05 user nova-compute[71321]: WARNING nova.compute.manager [req-c5250ba4-aa96-45cf-ad1c-2cd35139e1d0 req-a01b1ff0-a18d-47bc-bf0c-190739e2b0be service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] Received unexpected event network-vif-plugged-cbb69638-6a5f-4d12-8737-45850145fa0e for instance with vm_state active and task_state rescuing.
Apr 12 12:33:05 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Removed pending event for 10116da0-785c-41cf-96bb-95721af863db due to event {{(pid=71321) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 12:33:05 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302785.8125706, 10116da0-785c-41cf-96bb-95721af863db => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:33:05 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] VM Resumed (Lifecycle Event)
Apr 12 12:33:05 user nova-compute[71321]: DEBUG nova.compute.manager [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:33:05 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:33:05 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:33:05 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 12:33:05 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302785.812853, 10116da0-785c-41cf-96bb-95721af863db => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:33:05 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] VM Started (Lifecycle Event)
Apr 12 12:33:05 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:33:05 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:33:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "8403a098-a141-4feb-9eed-3731e2c7c152" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:33:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "8403a098-a141-4feb-9eed-3731e2c7c152" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:33:06 user nova-compute[71321]: DEBUG nova.compute.manager [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:33:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:33:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:33:06 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:33:06 user nova-compute[71321]: INFO nova.compute.claims [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Claim successful on node user
Apr 12 12:33:07 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:33:07 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:33:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:33:07 user nova-compute[71321]: DEBUG nova.compute.manager [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:33:07 user nova-compute[71321]: DEBUG nova.compute.manager [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:33:07 user nova-compute[71321]: DEBUG nova.network.neutron [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:33:07 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:33:07 user nova-compute[71321]: DEBUG nova.compute.manager [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:33:07 user nova-compute[71321]: DEBUG nova.policy [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc42504b7aab4fedb136acd998adeddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab04e4f968f4c07af43f3fe6651713a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:33:07 user nova-compute[71321]: DEBUG nova.compute.manager [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:33:07 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:33:07 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Creating image(s)
Apr 12 12:33:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "/opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:33:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "/opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:33:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "/opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:33:07 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:07 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.157s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:33:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:33:07 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:07 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.161s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:07 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:07 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk 1073741824" returned: 0 in 0.050s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:33:07 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.152s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:08 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:33:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:08 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Cannot resize image /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:33:08 user nova-compute[71321]: DEBUG nova.objects.instance [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lazy-loading 'migration_context' on Instance uuid 8403a098-a141-4feb-9eed-3731e2c7c152 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:33:08 user nova-compute[71321]: DEBUG nova.network.neutron [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Successfully created port: 12dd9e3e-1713-4f14-8893-3084e8140f87 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:33:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:33:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Ensure instance console log exists: /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:33:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:33:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:33:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG nova.network.neutron [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Successfully updated port: 12dd9e3e-1713-4f14-8893-3084e8140f87 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "refresh_cache-8403a098-a141-4feb-9eed-3731e2c7c152" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquired lock "refresh_cache-8403a098-a141-4feb-9eed-3731e2c7c152" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG nova.network.neutron [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG nova.compute.manager [req-47045a0e-cdd7-4918-b2f8-9683a840c016 req-814ab14c-46c2-461b-9da3-07735fc23cc8 service nova] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Received event network-changed-12dd9e3e-1713-4f14-8893-3084e8140f87 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG nova.compute.manager [req-47045a0e-cdd7-4918-b2f8-9683a840c016 req-814ab14c-46c2-461b-9da3-07735fc23cc8 service nova] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Refreshing instance network info cache due to event network-changed-12dd9e3e-1713-4f14-8893-3084e8140f87. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-47045a0e-cdd7-4918-b2f8-9683a840c016 req-814ab14c-46c2-461b-9da3-07735fc23cc8 service nova] Acquiring lock "refresh_cache-8403a098-a141-4feb-9eed-3731e2c7c152" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG nova.network.neutron [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG nova.network.neutron [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Updating instance_info_cache with network_info: [{"id": "12dd9e3e-1713-4f14-8893-3084e8140f87", "address": "fa:16:3e:4c:01:43", "network": {"id": "963759e8-808d-494c-9dea-0efa9f78804a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-684057570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ab04e4f968f4c07af43f3fe6651713a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12dd9e3e-17", "ovs_interfaceid": "12dd9e3e-1713-4f14-8893-3084e8140f87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Releasing lock "refresh_cache-8403a098-a141-4feb-9eed-3731e2c7c152" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG nova.compute.manager [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Instance network_info: |[{"id": "12dd9e3e-1713-4f14-8893-3084e8140f87", "address": "fa:16:3e:4c:01:43", "network": {"id": "963759e8-808d-494c-9dea-0efa9f78804a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-684057570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ab04e4f968f4c07af43f3fe6651713a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12dd9e3e-17", "ovs_interfaceid": "12dd9e3e-1713-4f14-8893-3084e8140f87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-47045a0e-cdd7-4918-b2f8-9683a840c016 req-814ab14c-46c2-461b-9da3-07735fc23cc8 service nova] Acquired lock "refresh_cache-8403a098-a141-4feb-9eed-3731e2c7c152" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG nova.network.neutron [req-47045a0e-cdd7-4918-b2f8-9683a840c016 req-814ab14c-46c2-461b-9da3-07735fc23cc8 service nova] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Refreshing network info cache for port 12dd9e3e-1713-4f14-8893-3084e8140f87 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Start _get_guest_xml network_info=[{"id": "12dd9e3e-1713-4f14-8893-3084e8140f87", "address": "fa:16:3e:4c:01:43", "network": {"id": "963759e8-808d-494c-9dea-0efa9f78804a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-684057570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ab04e4f968f4c07af43f3fe6651713a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12dd9e3e-17", "ovs_interfaceid": "12dd9e3e-1713-4f14-8893-3084e8140f87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:33:09 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:33:09 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:33:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:33:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-17230305',display_name='tempest-ServersNegativeTestJSON-server-17230305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-17230305',id=18,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ab04e4f968f4c07af43f3fe6651713a',ramdisk_id='',reservation_id='r-pl1rg0gl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1331801987',owner_user_name='tempest-ServersNegativeTestJSON-1331801987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:33:07Z,user_data=None,user_id='bc42504b7aab4fedb136acd998adeddb',uuid=8403a098-a141-4feb-9eed-3731e2c7c152,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12dd9e3e-1713-4f14-8893-3084e8140f87", "address": "fa:16:3e:4c:01:43", "network": {"id": "963759e8-808d-494c-9dea-0efa9f78804a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-684057570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ab04e4f968f4c07af43f3fe6651713a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12dd9e3e-17", "ovs_interfaceid": "12dd9e3e-1713-4f14-8893-3084e8140f87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Converting VIF {"id": "12dd9e3e-1713-4f14-8893-3084e8140f87", "address": "fa:16:3e:4c:01:43", "network": {"id": "963759e8-808d-494c-9dea-0efa9f78804a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-684057570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ab04e4f968f4c07af43f3fe6651713a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12dd9e3e-17", "ovs_interfaceid": "12dd9e3e-1713-4f14-8893-3084e8140f87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:01:43,bridge_name='br-int',has_traffic_filtering=True,id=12dd9e3e-1713-4f14-8893-3084e8140f87,network=Network(963759e8-808d-494c-9dea-0efa9f78804a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12dd9e3e-17') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG nova.objects.instance [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lazy-loading 'pci_devices' on Instance uuid 8403a098-a141-4feb-9eed-3731e2c7c152 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:33:09 user nova-compute[71321]:   <uuid>8403a098-a141-4feb-9eed-3731e2c7c152</uuid>
Apr 12 12:33:09 user nova-compute[71321]:   <name>instance-00000012</name>
Apr 12 12:33:09 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:33:09 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:33:09 user nova-compute[71321]:   <metadata>
Apr 12 12:33:09 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:33:09 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:33:09 user nova-compute[71321]:       <nova:name>tempest-ServersNegativeTestJSON-server-17230305</nova:name>
Apr 12 12:33:09 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:33:09</nova:creationTime>
Apr 12 12:33:09 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:33:09 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:33:09 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:33:09 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:33:09 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:33:09 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:33:09 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:33:09 user nova-compute[71321]:       <nova:owner>
Apr 12 12:33:09 user nova-compute[71321]:         <nova:user uuid="bc42504b7aab4fedb136acd998adeddb">tempest-ServersNegativeTestJSON-1331801987-project-member</nova:user>
Apr 12 12:33:09 user nova-compute[71321]:         <nova:project uuid="7ab04e4f968f4c07af43f3fe6651713a">tempest-ServersNegativeTestJSON-1331801987</nova:project>
Apr 12 12:33:09 user nova-compute[71321]:       </nova:owner>
Apr 12 12:33:09 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:33:09 user nova-compute[71321]:       <nova:ports>
Apr 12 12:33:09 user nova-compute[71321]:         <nova:port uuid="12dd9e3e-1713-4f14-8893-3084e8140f87">
Apr 12 12:33:09 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 12:33:09 user nova-compute[71321]:         </nova:port>
Apr 12 12:33:09 user nova-compute[71321]:       </nova:ports>
Apr 12 12:33:09 user nova-compute[71321]:     </nova:instance>
Apr 12 12:33:09 user nova-compute[71321]:   </metadata>
Apr 12 12:33:09 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:33:09 user nova-compute[71321]:     <system>
Apr 12 12:33:09 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:33:09 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:33:09 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:33:09 user nova-compute[71321]:       <entry name="serial">8403a098-a141-4feb-9eed-3731e2c7c152</entry>
Apr 12 12:33:09 user nova-compute[71321]:       <entry name="uuid">8403a098-a141-4feb-9eed-3731e2c7c152</entry>
Apr 12 12:33:09 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:33:09 user nova-compute[71321]:     </system>
Apr 12 12:33:09 user nova-compute[71321]:   </sysinfo>
Apr 12 12:33:09 user nova-compute[71321]:   <os>
Apr 12 12:33:09 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:33:09 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:33:09 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:33:09 user nova-compute[71321]:   </os>
Apr 12 12:33:09 user nova-compute[71321]:   <features>
Apr 12 12:33:09 user nova-compute[71321]:     <acpi/>
Apr 12 12:33:09 user nova-compute[71321]:     <apic/>
Apr 12 12:33:09 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:33:09 user nova-compute[71321]:   </features>
Apr 12 12:33:09 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:33:09 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:33:09 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:33:09 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:33:09 user nova-compute[71321]:   </clock>
Apr 12 12:33:09 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:33:09 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:33:09 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:33:09 user nova-compute[71321]:   </cpu>
Apr 12 12:33:09 user nova-compute[71321]:   <devices>
Apr 12 12:33:09 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:33:09 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:33:09 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk"/>
Apr 12 12:33:09 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:33:09 user nova-compute[71321]:     </disk>
Apr 12 12:33:09 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:33:09 user nova-compute[71321]:       <mac address="fa:16:3e:4c:01:43"/>
Apr 12 12:33:09 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:33:09 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:33:09 user nova-compute[71321]:       <target dev="tap12dd9e3e-17"/>
Apr 12 12:33:09 user nova-compute[71321]:     </interface>
Apr 12 12:33:09 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:33:09 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/console.log" append="off"/>
Apr 12 12:33:09 user nova-compute[71321]:     </serial>
Apr 12 12:33:09 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:33:09 user nova-compute[71321]:     <video>
Apr 12 12:33:09 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:33:09 user nova-compute[71321]:     </video>
Apr 12 12:33:09 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:33:09 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:33:09 user nova-compute[71321]:     </rng>
Apr 12 12:33:09 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:33:09 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:33:09 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:33:09 user nova-compute[71321]:     </memballoon>
Apr 12 12:33:09 user nova-compute[71321]:   </devices>
Apr 12 12:33:09 user nova-compute[71321]: </domain>
Apr 12 12:33:09 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:33:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-17230305',display_name='tempest-ServersNegativeTestJSON-server-17230305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-17230305',id=18,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ab04e4f968f4c07af43f3fe6651713a',ramdisk_id='',reservation_id='r-pl1rg0gl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1331801987',owner_user_name='tempest-ServersNegativeTestJSON-1331801987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:33:07Z,user_data=None,user_id='bc42504b7aab4fedb136acd998adeddb',uuid=8403a098-a141-4feb-9eed-3731e2c7c152,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12dd9e3e-1713-4f14-8893-3084e8140f87", "address": "fa:16:3e:4c:01:43", "network": {"id": "963759e8-808d-494c-9dea-0efa9f78804a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-684057570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ab04e4f968f4c07af43f3fe6651713a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12dd9e3e-17", "ovs_interfaceid": "12dd9e3e-1713-4f14-8893-3084e8140f87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Converting VIF {"id": "12dd9e3e-1713-4f14-8893-3084e8140f87", "address": "fa:16:3e:4c:01:43", "network": {"id": "963759e8-808d-494c-9dea-0efa9f78804a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-684057570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ab04e4f968f4c07af43f3fe6651713a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12dd9e3e-17", "ovs_interfaceid": "12dd9e3e-1713-4f14-8893-3084e8140f87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:01:43,bridge_name='br-int',has_traffic_filtering=True,id=12dd9e3e-1713-4f14-8893-3084e8140f87,network=Network(963759e8-808d-494c-9dea-0efa9f78804a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12dd9e3e-17') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG os_vif [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:01:43,bridge_name='br-int',has_traffic_filtering=True,id=12dd9e3e-1713-4f14-8893-3084e8140f87,network=Network(963759e8-808d-494c-9dea-0efa9f78804a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12dd9e3e-17') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12dd9e3e-17, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap12dd9e3e-17, col_values=(('external_ids', {'iface-id': '12dd9e3e-1713-4f14-8893-3084e8140f87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:01:43', 'vm-uuid': '8403a098-a141-4feb-9eed-3731e2c7c152'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:09 user nova-compute[71321]: INFO os_vif [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:01:43,bridge_name='br-int',has_traffic_filtering=True,id=12dd9e3e-1713-4f14-8893-3084e8140f87,network=Network(963759e8-808d-494c-9dea-0efa9f78804a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12dd9e3e-17')
Apr 12 12:33:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:33:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] No VIF found with MAC fa:16:3e:4c:01:43, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:33:10 user nova-compute[71321]: DEBUG nova.network.neutron [req-47045a0e-cdd7-4918-b2f8-9683a840c016 req-814ab14c-46c2-461b-9da3-07735fc23cc8 service nova] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Updated VIF entry in instance network info cache for port 12dd9e3e-1713-4f14-8893-3084e8140f87. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:33:10 user nova-compute[71321]: DEBUG nova.network.neutron [req-47045a0e-cdd7-4918-b2f8-9683a840c016 req-814ab14c-46c2-461b-9da3-07735fc23cc8 service nova] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Updating instance_info_cache with network_info: [{"id": "12dd9e3e-1713-4f14-8893-3084e8140f87", "address": "fa:16:3e:4c:01:43", "network": {"id": "963759e8-808d-494c-9dea-0efa9f78804a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-684057570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ab04e4f968f4c07af43f3fe6651713a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12dd9e3e-17", "ovs_interfaceid": "12dd9e3e-1713-4f14-8893-3084e8140f87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:33:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-47045a0e-cdd7-4918-b2f8-9683a840c016 req-814ab14c-46c2-461b-9da3-07735fc23cc8 service nova] Releasing lock "refresh_cache-8403a098-a141-4feb-9eed-3731e2c7c152" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:33:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:11 user nova-compute[71321]: DEBUG nova.compute.manager [req-e5ec4933-ece0-42ec-a5f2-f9fbb61ed6f2 req-28af3d74-e1ae-4791-8802-a9fc8a3b0026 service nova] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Received event network-vif-plugged-12dd9e3e-1713-4f14-8893-3084e8140f87 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:33:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e5ec4933-ece0-42ec-a5f2-f9fbb61ed6f2 req-28af3d74-e1ae-4791-8802-a9fc8a3b0026 service nova] Acquiring lock "8403a098-a141-4feb-9eed-3731e2c7c152-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:33:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e5ec4933-ece0-42ec-a5f2-f9fbb61ed6f2 req-28af3d74-e1ae-4791-8802-a9fc8a3b0026 service nova] Lock "8403a098-a141-4feb-9eed-3731e2c7c152-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:33:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e5ec4933-ece0-42ec-a5f2-f9fbb61ed6f2 req-28af3d74-e1ae-4791-8802-a9fc8a3b0026 service nova] Lock "8403a098-a141-4feb-9eed-3731e2c7c152-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:33:11 user nova-compute[71321]: DEBUG nova.compute.manager [req-e5ec4933-ece0-42ec-a5f2-f9fbb61ed6f2 req-28af3d74-e1ae-4791-8802-a9fc8a3b0026 service nova] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] No waiting events found dispatching network-vif-plugged-12dd9e3e-1713-4f14-8893-3084e8140f87 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:33:11 user nova-compute[71321]: WARNING nova.compute.manager [req-e5ec4933-ece0-42ec-a5f2-f9fbb61ed6f2 req-28af3d74-e1ae-4791-8802-a9fc8a3b0026 service nova] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Received unexpected event network-vif-plugged-12dd9e3e-1713-4f14-8893-3084e8140f87 for instance with vm_state building and task_state spawning.
Apr 12 12:33:12 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:12 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:12 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:12 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:33:13 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302793.6628206, 8403a098-a141-4feb-9eed-3731e2c7c152 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:33:13 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] VM Resumed (Lifecycle Event)
Apr 12 12:33:13 user nova-compute[71321]: DEBUG nova.compute.manager [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:33:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:33:13 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Instance spawned successfully.
Apr 12 12:33:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:33:13 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:33:13 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:33:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:33:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:33:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:33:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:33:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:33:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:33:13 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:33:13 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302793.6631281, 8403a098-a141-4feb-9eed-3731e2c7c152 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:33:13 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] VM Started (Lifecycle Event)
Apr 12 12:33:13 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:33:13 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:33:13 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:33:13 user nova-compute[71321]: INFO nova.compute.manager [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Took 6.37 seconds to spawn the instance on the hypervisor.
Apr 12 12:33:13 user nova-compute[71321]: DEBUG nova.compute.manager [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:33:13 user nova-compute[71321]: DEBUG nova.compute.manager [req-527a0b3b-705b-47dd-a5ec-eb2fa3bc6a91 req-3f1fa96d-8c39-44fc-b322-b7c3b5679684 service nova] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Received event network-vif-plugged-12dd9e3e-1713-4f14-8893-3084e8140f87 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:33:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-527a0b3b-705b-47dd-a5ec-eb2fa3bc6a91 req-3f1fa96d-8c39-44fc-b322-b7c3b5679684 service nova] Acquiring lock "8403a098-a141-4feb-9eed-3731e2c7c152-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:33:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-527a0b3b-705b-47dd-a5ec-eb2fa3bc6a91 req-3f1fa96d-8c39-44fc-b322-b7c3b5679684 service nova] Lock "8403a098-a141-4feb-9eed-3731e2c7c152-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:33:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-527a0b3b-705b-47dd-a5ec-eb2fa3bc6a91 req-3f1fa96d-8c39-44fc-b322-b7c3b5679684 service nova] Lock "8403a098-a141-4feb-9eed-3731e2c7c152-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:33:13 user nova-compute[71321]: DEBUG nova.compute.manager [req-527a0b3b-705b-47dd-a5ec-eb2fa3bc6a91 req-3f1fa96d-8c39-44fc-b322-b7c3b5679684 service nova] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] No waiting events found dispatching network-vif-plugged-12dd9e3e-1713-4f14-8893-3084e8140f87 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:33:13 user nova-compute[71321]: WARNING nova.compute.manager [req-527a0b3b-705b-47dd-a5ec-eb2fa3bc6a91 req-3f1fa96d-8c39-44fc-b322-b7c3b5679684 service nova] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Received unexpected event network-vif-plugged-12dd9e3e-1713-4f14-8893-3084e8140f87 for instance with vm_state building and task_state spawning.
Apr 12 12:33:13 user nova-compute[71321]: INFO nova.compute.manager [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Took 7.23 seconds to build instance.
Apr 12 12:33:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "8403a098-a141-4feb-9eed-3731e2c7c152" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.338s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:33:14 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:33:14 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:33:14 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Didn't find any instances for network info cache update. {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 12:33:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:15 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:33:15 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:33:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:33:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:33:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:33:15 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:33:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:33:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:33:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b597d03-8252-4e26-a5a9-651117bf78d1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:15 user nova-compute[71321]: DEBUG nova.objects.instance [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lazy-loading 'flavor' on Instance uuid d584edf2-12e3-48d1-947f-fdfb0c9c7377 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:33:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:33:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b597d03-8252-4e26-a5a9-651117bf78d1/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b597d03-8252-4e26-a5a9-651117bf78d1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b597d03-8252-4e26-a5a9-651117bf78d1/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:33:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:33:16 user nova-compute[71321]: INFO nova.compute.manager [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Attaching volume 46cf147c-77ee-4b66-83bd-b6421617f8e7 to /dev/vdb
Apr 12 12:33:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:16 user nova-compute[71321]: DEBUG os_brick.utils [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:33:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:16 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd6d7c0-5200-40c0-971a-c9a7dcf3d415]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.070s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:16 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[914e2573-e9b5-493f-9f66-b6016bfecd8b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:16 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fbb9e5-032e-4187-91ce-079cb7cca81b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:16 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0d3456-18f7-4717-9817-734bf8091e6c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:33:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:33:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:33:16 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:33:16 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[518f1e84-799a-4751-b6d2-d3e50b08d9cf]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:33:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:33:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:33:16 user nova-compute[71321]: DEBUG os_brick.utils [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] <== get_connector_properties: return (245ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:33:16 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Updating existing volume attachment record: bd26c76b-baac-4140-a87d-993b1e96af6b {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:33:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:17 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:33:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:18 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:33:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:19 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:33:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49339083-8dd4-454b-b7aa-73d91238bef4/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49339083-8dd4-454b-b7aa-73d91238bef4/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49339083-8dd4-454b-b7aa-73d91238bef4/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49339083-8dd4-454b-b7aa-73d91238bef4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:20 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:33:20 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:33:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=7255MB free_disk=26.445526123046875GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:33:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:33:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:33:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 10116da0-785c-41cf-96bb-95721af863db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:33:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance a4107f2d-88e4-4846-9ece-cb16ad7ecd02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:33:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:33:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 839e85a2-f7af-482d-a5e6-09195888300e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:33:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:33:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 49339083-8dd4-454b-b7aa-73d91238bef4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:33:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance cda12475-d730-4c07-af54-a3a64482fc94 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:33:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance c5b9b1bb-a3d9-4073-8d49-70360dae6f29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:33:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 9439468d-7a45-443b-87ce-106907761a56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:33:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 4b597d03-8252-4e26-a5a9-651117bf78d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:33:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 8403a098-a141-4feb-9eed-3731e2c7c152 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:33:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:33:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.703s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsJwkyNu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:33:21 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:33:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:33:21 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:33:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:33:21 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:33:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f8d112-5061-40d5-9807-8d7330994c28]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:33:21 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10902a3-b0cd-4d01-a872-8d877940184f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7] added
Apr 12 12:33:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[242a33fd-7499-4c63-a4a2-d75b3513b75f]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[281b6e19-37ed-4f53-af79-6ad4beca8a9c]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fsJwkyNu {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fsJwkyNu" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5e09a3-0b98-4e79-82d4-554b959702fe]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fsJwkyNu'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa629ad8-9ba2-4c6c-b866-297d0e70a9e7]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8772e333-4a96-4b1d-920c-9d0ce113bda8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:33:21 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:33:21 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:33:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:33:21 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:33:21 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:33:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4463e1a1-f4ca-41d9-9f49-2c26b24339ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7, portal: 172.16.0.220,3260]
Apr 12 12:33:21 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7, portal: 172.16.0.220,3260] successful.
Apr 12 12:33:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe885cdb-687c-41a4-8a5d-66876a840d9b]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[337b853d-71e8-4f80-8b42-8feac52e4acf]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:33:21 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:33:21 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:33:21 user nova-compute[71321]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7 (non-flash)
Apr 12 12:33:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:33:21 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:33:21 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:33:21 user nova-compute[71321]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7 (non-flash)
Apr 12 12:33:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] HCTL ('36', '-', '-', 0) found on session 18 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.187s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff54e44-013c-4c5d-a76e-7a9f9a077280]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:33:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsJwkyNu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:33:22 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:33:22 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:33:22 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:33:22 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:33:22 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:33:22 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:33:22 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.497s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:33:22 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] <== connect_volume: return (1499ms) {'type': 'block', 'scsi_wwn': '23239303134643131', 'path': '/dev/sde'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:33:22 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239303134643131', 'path': '/dev/sde'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:33:22 user nova-compute[71321]: DEBUG nova.objects.instance [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lazy-loading 'flavor' on Instance uuid d584edf2-12e3-48d1-947f-fdfb0c9c7377 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:33:22 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 12:33:22 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:33:22 user nova-compute[71321]:   <source dev="/dev/sde"/>
Apr 12 12:33:22 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:33:22 user nova-compute[71321]:   <serial>46cf147c-77ee-4b66-83bd-b6421617f8e7</serial>
Apr 12 12:33:22 user nova-compute[71321]: </disk>
Apr 12 12:33:22 user nova-compute[71321]:  {{(pid=71321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 12:33:23 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:33:23 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:33:23 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] No VIF found with MAC fa:16:3e:eb:10:b5, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:33:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.489s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:33:24 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:24 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:33:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:33:25 user nova-compute[71321]: INFO nova.compute.manager [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Detaching volume 46cf147c-77ee-4b66-83bd-b6421617f8e7
Apr 12 12:33:25 user nova-compute[71321]: INFO nova.virt.block_device [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Attempting to driver detach volume 46cf147c-77ee-4b66-83bd-b6421617f8e7 from mountpoint /dev/vdb
Apr 12 12:33:25 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Attempting to detach device vdb from instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 from the persistent domain config. {{(pid=71321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 12:33:25 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:33:25 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:33:25 user nova-compute[71321]:   <source dev="/dev/sde"/>
Apr 12 12:33:25 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:33:25 user nova-compute[71321]:   <serial>46cf147c-77ee-4b66-83bd-b6421617f8e7</serial>
Apr 12 12:33:25 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 12:33:25 user nova-compute[71321]: </disk>
Apr 12 12:33:25 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:33:25 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Successfully detached device vdb from instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 from the persistent domain config.
Apr 12 12:33:25 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 from the live domain config. {{(pid=71321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 12:33:25 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:33:25 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:33:25 user nova-compute[71321]:   <source dev="/dev/sde"/>
Apr 12 12:33:25 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:33:25 user nova-compute[71321]:   <serial>46cf147c-77ee-4b66-83bd-b6421617f8e7</serial>
Apr 12 12:33:25 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 12:33:25 user nova-compute[71321]: </disk>
Apr 12 12:33:25 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:33:25 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Received event <DeviceRemovedEvent: 1681302805.9062464, d584edf2-12e3-48d1-947f-fdfb0c9c7377 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 12:33:25 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 {{(pid=71321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 12:33:25 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Successfully detached device vdb from instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 from the live domain config.
Apr 12 12:33:25 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:33:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsJwkyNu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:33:25 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:33:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:33:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:33:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:25 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[373b989d-8457-4ec0-9fd6-54aad353d322]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:33:25 user nova-compute[71321]: No targets found.
Apr 12 12:33:25 user nova-compute[71321]: iSNS:
Apr 12 12:33:25 user nova-compute[71321]: No targets found.
Apr 12 12:33:25 user nova-compute[71321]: STATIC:
Apr 12 12:33:25 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54
Apr 12 12:33:25 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:33:25 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:33:25 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936
Apr 12 12:33:25 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:33:25 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:33:25 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7
Apr 12 12:33:25 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:33:25 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:33:25 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f
Apr 12 12:33:25 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:33:25 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:33:25 user nova-compute[71321]: FIRMWARE:
Apr 12 12:33:25 user nova-compute[71321]: No targets found.
Apr 12 12:33:25 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:33:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:33:25 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:33:25 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:33:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:33:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:25 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[871bebdf-26d7-445d-83a9-1e288c5870fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e062a7-a7ef-4d93-af4f-0a1e1fa48d9c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:33:26 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:33:26 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:33:26 user nova-compute[71321]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7 (non-flash)
Apr 12 12:33:26 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:33:26 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:33:26 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:33:26 user nova-compute[71321]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7 (non-flash)
Apr 12 12:33:26 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef8a06f490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7'): ({'sde'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Removing single pathed devices sde {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a132d3-b412-41db-8427-0e7b359f9e93]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.036s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d65f77-0ab0-4c7b-b433-2d0651963418]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Flushing IO for device /dev/sde {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3220271-2e56-4c37-af0d-61af7f0ff342]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.072s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b53347c-06f7-4812-a77d-0824aeba666c]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] SCSI volumes sde have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbe3ac0-caf0-4e41-b293-735af3a271a6]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[434a8673-36fa-4ebd-866d-ad67c8181321]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7, portal: 172.16.0.220,3260]
Apr 12 12:33:26 user nova-compute[71321]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7, portal: 172.16.0.220,3260] successful.
Apr 12 12:33:26 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46cf147c-77ee-4b66-83bd-b6421617f8e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ad7f28-dacd-40ad-a863-3bc4bf677ada]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] <== disconnect_volume: return (406ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:33:26 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:33:27 user nova-compute[71321]: DEBUG nova.objects.instance [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lazy-loading 'flavor' on Instance uuid d584edf2-12e3-48d1-947f-fdfb0c9c7377 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:33:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.005s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:33:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:39 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:39 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3bc44de8-c835-4334-b021-0bf30c5187b0 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Acquiring lock "49339083-8dd4-454b-b7aa-73d91238bef4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:33:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3bc44de8-c835-4334-b021-0bf30c5187b0 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "49339083-8dd4-454b-b7aa-73d91238bef4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:33:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3bc44de8-c835-4334-b021-0bf30c5187b0 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Acquiring lock "49339083-8dd4-454b-b7aa-73d91238bef4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:33:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3bc44de8-c835-4334-b021-0bf30c5187b0 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "49339083-8dd4-454b-b7aa-73d91238bef4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:33:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3bc44de8-c835-4334-b021-0bf30c5187b0 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "49339083-8dd4-454b-b7aa-73d91238bef4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:33:40 user nova-compute[71321]: INFO nova.compute.manager [None req-3bc44de8-c835-4334-b021-0bf30c5187b0 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Terminating instance
Apr 12 12:33:40 user nova-compute[71321]: DEBUG nova.compute.manager [None req-3bc44de8-c835-4334-b021-0bf30c5187b0 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:33:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:40 user nova-compute[71321]: DEBUG nova.compute.manager [req-8e49f557-192a-4ef3-b272-d427fd4873f2 req-b44f0e17-bc20-490a-ad7a-8a688d8dc56c service nova] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Received event network-vif-unplugged-c1091e67-edef-41a6-bb9e-e1928024f799 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:33:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-8e49f557-192a-4ef3-b272-d427fd4873f2 req-b44f0e17-bc20-490a-ad7a-8a688d8dc56c service nova] Acquiring lock "49339083-8dd4-454b-b7aa-73d91238bef4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:33:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-8e49f557-192a-4ef3-b272-d427fd4873f2 req-b44f0e17-bc20-490a-ad7a-8a688d8dc56c service nova] Lock "49339083-8dd4-454b-b7aa-73d91238bef4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:33:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-8e49f557-192a-4ef3-b272-d427fd4873f2 req-b44f0e17-bc20-490a-ad7a-8a688d8dc56c service nova] Lock "49339083-8dd4-454b-b7aa-73d91238bef4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:33:40 user nova-compute[71321]: DEBUG nova.compute.manager [req-8e49f557-192a-4ef3-b272-d427fd4873f2 req-b44f0e17-bc20-490a-ad7a-8a688d8dc56c service nova] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] No waiting events found dispatching network-vif-unplugged-c1091e67-edef-41a6-bb9e-e1928024f799 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:33:40 user nova-compute[71321]: DEBUG nova.compute.manager [req-8e49f557-192a-4ef3-b272-d427fd4873f2 req-b44f0e17-bc20-490a-ad7a-8a688d8dc56c service nova] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Received event network-vif-unplugged-c1091e67-edef-41a6-bb9e-e1928024f799 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:33:40 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Instance destroyed successfully.
Apr 12 12:33:40 user nova-compute[71321]: DEBUG nova.objects.instance [None req-3bc44de8-c835-4334-b021-0bf30c5187b0 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lazy-loading 'resources' on Instance uuid 49339083-8dd4-454b-b7aa-73d91238bef4 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:33:40 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-3bc44de8-c835-4334-b021-0bf30c5187b0 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:31:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-487067793',display_name='tempest-VolumesNegativeTest-instance-487067793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-487067793',id=13,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:31:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9cc629696bdf4ed2bc9da7e20e8102fb',ramdisk_id='',reservation_id='r-62mt0aym',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-809350896',owner_user_name='tempest-VolumesNegativeTest-809350896-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:31:57Z,user_data=None,user_id='ddeb0b1b08ba4cbcb08705c49517f43f',uuid=49339083-8dd4-454b-b7aa-73d91238bef4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1091e67-edef-41a6-bb9e-e1928024f799", "address": "fa:16:3e:2a:04:13", "network": {"id": "d1dedd7c-8d21-42ac-b2f0-d1edea608e69", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "df919367bacb43bb89689f1b01773445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1091e67-ed", "ovs_interfaceid": "c1091e67-edef-41a6-bb9e-e1928024f799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:33:40 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-3bc44de8-c835-4334-b021-0bf30c5187b0 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Converting VIF {"id": "c1091e67-edef-41a6-bb9e-e1928024f799", "address": "fa:16:3e:2a:04:13", "network": {"id": "d1dedd7c-8d21-42ac-b2f0-d1edea608e69", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "df919367bacb43bb89689f1b01773445", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1091e67-ed", "ovs_interfaceid": "c1091e67-edef-41a6-bb9e-e1928024f799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:33:40 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-3bc44de8-c835-4334-b021-0bf30c5187b0 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:04:13,bridge_name='br-int',has_traffic_filtering=True,id=c1091e67-edef-41a6-bb9e-e1928024f799,network=Network(d1dedd7c-8d21-42ac-b2f0-d1edea608e69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1091e67-ed') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:33:40 user nova-compute[71321]: DEBUG os_vif [None req-3bc44de8-c835-4334-b021-0bf30c5187b0 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:04:13,bridge_name='br-int',has_traffic_filtering=True,id=c1091e67-edef-41a6-bb9e-e1928024f799,network=Network(d1dedd7c-8d21-42ac-b2f0-d1edea608e69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1091e67-ed') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:33:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1091e67-ed, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:33:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:40 user nova-compute[71321]: INFO os_vif [None req-3bc44de8-c835-4334-b021-0bf30c5187b0 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:04:13,bridge_name='br-int',has_traffic_filtering=True,id=c1091e67-edef-41a6-bb9e-e1928024f799,network=Network(d1dedd7c-8d21-42ac-b2f0-d1edea608e69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1091e67-ed')
Apr 12 12:33:40 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-3bc44de8-c835-4334-b021-0bf30c5187b0 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Deleting instance files /opt/stack/data/nova/instances/49339083-8dd4-454b-b7aa-73d91238bef4_del
Apr 12 12:33:40 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-3bc44de8-c835-4334-b021-0bf30c5187b0 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Deletion of /opt/stack/data/nova/instances/49339083-8dd4-454b-b7aa-73d91238bef4_del complete
Apr 12 12:33:40 user nova-compute[71321]: INFO nova.compute.manager [None req-3bc44de8-c835-4334-b021-0bf30c5187b0 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Took 0.69 seconds to destroy the instance on the hypervisor.
Apr 12 12:33:40 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-3bc44de8-c835-4334-b021-0bf30c5187b0 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:33:40 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:33:40 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:33:41 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:33:41 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Took 0.94 seconds to deallocate network for instance.
Apr 12 12:33:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3bc44de8-c835-4334-b021-0bf30c5187b0 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:33:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3bc44de8-c835-4334-b021-0bf30c5187b0 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:33:42 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-3bc44de8-c835-4334-b021-0bf30c5187b0 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:33:42 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-3bc44de8-c835-4334-b021-0bf30c5187b0 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:33:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3bc44de8-c835-4334-b021-0bf30c5187b0 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:33:42 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-3bc44de8-c835-4334-b021-0bf30c5187b0 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Deleted allocations for instance 49339083-8dd4-454b-b7aa-73d91238bef4
Apr 12 12:33:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3bc44de8-c835-4334-b021-0bf30c5187b0 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "49339083-8dd4-454b-b7aa-73d91238bef4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.184s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:33:42 user nova-compute[71321]: DEBUG nova.compute.manager [req-7683c5a8-14ea-45a7-b82b-c4ded06431d4 req-1c85ec1d-412e-4744-a23e-1d757cca4276 service nova] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Received event network-vif-plugged-c1091e67-edef-41a6-bb9e-e1928024f799 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:33:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7683c5a8-14ea-45a7-b82b-c4ded06431d4 req-1c85ec1d-412e-4744-a23e-1d757cca4276 service nova] Acquiring lock "49339083-8dd4-454b-b7aa-73d91238bef4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:33:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7683c5a8-14ea-45a7-b82b-c4ded06431d4 req-1c85ec1d-412e-4744-a23e-1d757cca4276 service nova] Lock "49339083-8dd4-454b-b7aa-73d91238bef4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:33:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7683c5a8-14ea-45a7-b82b-c4ded06431d4 req-1c85ec1d-412e-4744-a23e-1d757cca4276 service nova] Lock "49339083-8dd4-454b-b7aa-73d91238bef4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:33:42 user nova-compute[71321]: DEBUG nova.compute.manager [req-7683c5a8-14ea-45a7-b82b-c4ded06431d4 req-1c85ec1d-412e-4744-a23e-1d757cca4276 service nova] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] No waiting events found dispatching network-vif-plugged-c1091e67-edef-41a6-bb9e-e1928024f799 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:33:42 user nova-compute[71321]: WARNING nova.compute.manager [req-7683c5a8-14ea-45a7-b82b-c4ded06431d4 req-1c85ec1d-412e-4744-a23e-1d757cca4276 service nova] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Received unexpected event network-vif-plugged-c1091e67-edef-41a6-bb9e-e1928024f799 for instance with vm_state deleted and task_state None.
Apr 12 12:33:42 user nova-compute[71321]: DEBUG nova.compute.manager [req-7683c5a8-14ea-45a7-b82b-c4ded06431d4 req-1c85ec1d-412e-4744-a23e-1d757cca4276 service nova] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Received event network-vif-deleted-c1091e67-edef-41a6-bb9e-e1928024f799 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:33:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:33:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:33:44 user nova-compute[71321]: DEBUG nova.compute.manager [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:33:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:33:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:33:44 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:33:44 user nova-compute[71321]: INFO nova.compute.claims [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Claim successful on node user
Apr 12 12:33:44 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:33:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:44 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:33:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:33:44 user nova-compute[71321]: DEBUG nova.compute.manager [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:33:44 user nova-compute[71321]: DEBUG nova.compute.manager [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:33:44 user nova-compute[71321]: DEBUG nova.network.neutron [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:33:44 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:33:44 user nova-compute[71321]: DEBUG nova.compute.manager [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:33:45 user nova-compute[71321]: INFO nova.virt.block_device [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Booting with volume 0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d at /dev/vda
Apr 12 12:33:45 user nova-compute[71321]: DEBUG os_brick.utils [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:33:45 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:45 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:45 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbbbfbd-b904-4078-b703-260d1ed7183a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:45 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:45 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:45 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[061abf7e-c6e6-4b6f-8b86-23d010699f6b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:45 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:45 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:45 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc10e8c-93ed-46d9-a202-b3dbe5a1db53]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:45 user nova-compute[71321]: DEBUG nova.policy [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e17bc9d4cf743c19f9493d30b62fc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f1f2dba8e4325b550ad91403e60ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:33:45 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f683084-6559-438c-9f54-de802f9ac98a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:45 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:45 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:33:45 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:33:45 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:45 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:33:45 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:33:45 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d68ffbd-8bdc-459a-8761-2edc3a6d3909]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:45 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:33:45 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:33:45 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:33:45 user nova-compute[71321]: DEBUG os_brick.utils [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:33:45 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Updating existing volume attachment record: 58695eb7-6546-4c6f-bc04-5c195666edf4 {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:33:45 user nova-compute[71321]: DEBUG nova.network.neutron [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Successfully created port: 94f43c42-9d4d-4625-b558-4be918b78ffb {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:33:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:46 user nova-compute[71321]: DEBUG nova.network.neutron [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Successfully created port: 4a995fb4-7c9a-443c-a66a-47c04d7862ea {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:33:47 user nova-compute[71321]: DEBUG nova.network.neutron [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Successfully created port: 501229b8-6d04-45a8-97df-927b8ec14ca3 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:33:47 user nova-compute[71321]: DEBUG nova.network.neutron [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Successfully created port: e59fa8d8-7765-453d-a135-0abe5f1cae78 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:33:48 user nova-compute[71321]: DEBUG nova.network.neutron [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Successfully created port: bad3a184-db6f-4d2d-ac53-f1155fcf0fe1 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:33:49 user nova-compute[71321]: DEBUG nova.network.neutron [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Successfully updated port: 94f43c42-9d4d-4625-b558-4be918b78ffb {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:33:49 user nova-compute[71321]: DEBUG nova.compute.manager [req-a1c5dbf9-b631-4311-93d3-60c1a9303aac req-64321216-232e-4f87-9dad-a80ed6b474a5 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-changed-94f43c42-9d4d-4625-b558-4be918b78ffb {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:33:49 user nova-compute[71321]: DEBUG nova.compute.manager [req-a1c5dbf9-b631-4311-93d3-60c1a9303aac req-64321216-232e-4f87-9dad-a80ed6b474a5 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Refreshing instance network info cache due to event network-changed-94f43c42-9d4d-4625-b558-4be918b78ffb. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:33:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a1c5dbf9-b631-4311-93d3-60c1a9303aac req-64321216-232e-4f87-9dad-a80ed6b474a5 service nova] Acquiring lock "refresh_cache-81cb942b-5bd6-47c4-8130-f5a4d17f10fa" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:33:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a1c5dbf9-b631-4311-93d3-60c1a9303aac req-64321216-232e-4f87-9dad-a80ed6b474a5 service nova] Acquired lock "refresh_cache-81cb942b-5bd6-47c4-8130-f5a4d17f10fa" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:33:49 user nova-compute[71321]: DEBUG nova.network.neutron [req-a1c5dbf9-b631-4311-93d3-60c1a9303aac req-64321216-232e-4f87-9dad-a80ed6b474a5 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Refreshing network info cache for port 94f43c42-9d4d-4625-b558-4be918b78ffb {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:33:49 user nova-compute[71321]: DEBUG nova.network.neutron [req-a1c5dbf9-b631-4311-93d3-60c1a9303aac req-64321216-232e-4f87-9dad-a80ed6b474a5 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:33:49 user nova-compute[71321]: INFO nova.virt.block_device [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Booting with volume a2ae34a9-43d0-4111-84c5-370193d88db8 at /dev/vdb
Apr 12 12:33:49 user nova-compute[71321]: DEBUG os_brick.utils [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:33:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:49 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bda29a-0758-44a8-87ad-0b0f29e4146f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:49 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[296e65dd-e5ce-41a7-9cde-2e1ae90df7c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:49 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a6ba26-0919-4020-b8d6-d2ce3ff0bc6c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:49 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da6bfd2-a0a7-4e2b-b77b-bfa70dcba2b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:33:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:33:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:33:49 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:33:49 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e56c4a-f5db-44a9-8433-d6139342a5e2]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:33:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:33:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:33:49 user nova-compute[71321]: DEBUG os_brick.utils [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:33:49 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Updating existing volume attachment record: b26bfd22-8cb2-4b43-8492-7d18171d9bda {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:33:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:49 user nova-compute[71321]: DEBUG nova.network.neutron [req-a1c5dbf9-b631-4311-93d3-60c1a9303aac req-64321216-232e-4f87-9dad-a80ed6b474a5 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:33:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a1c5dbf9-b631-4311-93d3-60c1a9303aac req-64321216-232e-4f87-9dad-a80ed6b474a5 service nova] Releasing lock "refresh_cache-81cb942b-5bd6-47c4-8130-f5a4d17f10fa" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:33:50 user nova-compute[71321]: DEBUG nova.network.neutron [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Successfully updated port: 76450ca6-4f7a-4e03-9269-feaacfced76a {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:33:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:51 user nova-compute[71321]: DEBUG nova.network.neutron [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Successfully updated port: 5dfbb175-cb83-461e-91da-d7cbde98c3e6 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:33:51 user nova-compute[71321]: DEBUG nova.compute.manager [req-23e54edb-47d7-4f24-a667-edddc5a008c3 req-1e30459d-0173-411a-b668-9fd8520e4a1a service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-changed-76450ca6-4f7a-4e03-9269-feaacfced76a {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:33:51 user nova-compute[71321]: DEBUG nova.compute.manager [req-23e54edb-47d7-4f24-a667-edddc5a008c3 req-1e30459d-0173-411a-b668-9fd8520e4a1a service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Refreshing instance network info cache due to event network-changed-76450ca6-4f7a-4e03-9269-feaacfced76a. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:33:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-23e54edb-47d7-4f24-a667-edddc5a008c3 req-1e30459d-0173-411a-b668-9fd8520e4a1a service nova] Acquiring lock "refresh_cache-81cb942b-5bd6-47c4-8130-f5a4d17f10fa" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:33:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-23e54edb-47d7-4f24-a667-edddc5a008c3 req-1e30459d-0173-411a-b668-9fd8520e4a1a service nova] Acquired lock "refresh_cache-81cb942b-5bd6-47c4-8130-f5a4d17f10fa" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:33:51 user nova-compute[71321]: DEBUG nova.network.neutron [req-23e54edb-47d7-4f24-a667-edddc5a008c3 req-1e30459d-0173-411a-b668-9fd8520e4a1a service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Refreshing network info cache for port 76450ca6-4f7a-4e03-9269-feaacfced76a {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:33:51 user nova-compute[71321]: DEBUG nova.network.neutron [req-23e54edb-47d7-4f24-a667-edddc5a008c3 req-1e30459d-0173-411a-b668-9fd8520e4a1a service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:33:52 user nova-compute[71321]: DEBUG nova.network.neutron [req-23e54edb-47d7-4f24-a667-edddc5a008c3 req-1e30459d-0173-411a-b668-9fd8520e4a1a service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:33:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-23e54edb-47d7-4f24-a667-edddc5a008c3 req-1e30459d-0173-411a-b668-9fd8520e4a1a service nova] Releasing lock "refresh_cache-81cb942b-5bd6-47c4-8130-f5a4d17f10fa" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:33:52 user nova-compute[71321]: DEBUG nova.compute.manager [req-23e54edb-47d7-4f24-a667-edddc5a008c3 req-1e30459d-0173-411a-b668-9fd8520e4a1a service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-changed-5dfbb175-cb83-461e-91da-d7cbde98c3e6 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:33:52 user nova-compute[71321]: DEBUG nova.compute.manager [req-23e54edb-47d7-4f24-a667-edddc5a008c3 req-1e30459d-0173-411a-b668-9fd8520e4a1a service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Refreshing instance network info cache due to event network-changed-5dfbb175-cb83-461e-91da-d7cbde98c3e6. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:33:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-23e54edb-47d7-4f24-a667-edddc5a008c3 req-1e30459d-0173-411a-b668-9fd8520e4a1a service nova] Acquiring lock "refresh_cache-81cb942b-5bd6-47c4-8130-f5a4d17f10fa" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:33:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-23e54edb-47d7-4f24-a667-edddc5a008c3 req-1e30459d-0173-411a-b668-9fd8520e4a1a service nova] Acquired lock "refresh_cache-81cb942b-5bd6-47c4-8130-f5a4d17f10fa" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:33:52 user nova-compute[71321]: DEBUG nova.network.neutron [req-23e54edb-47d7-4f24-a667-edddc5a008c3 req-1e30459d-0173-411a-b668-9fd8520e4a1a service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Refreshing network info cache for port 5dfbb175-cb83-461e-91da-d7cbde98c3e6 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:33:52 user nova-compute[71321]: DEBUG nova.network.neutron [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Successfully updated port: 4a995fb4-7c9a-443c-a66a-47c04d7862ea {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:33:52 user nova-compute[71321]: DEBUG nova.network.neutron [req-23e54edb-47d7-4f24-a667-edddc5a008c3 req-1e30459d-0173-411a-b668-9fd8520e4a1a service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:33:52 user nova-compute[71321]: DEBUG nova.network.neutron [req-23e54edb-47d7-4f24-a667-edddc5a008c3 req-1e30459d-0173-411a-b668-9fd8520e4a1a service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:33:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-23e54edb-47d7-4f24-a667-edddc5a008c3 req-1e30459d-0173-411a-b668-9fd8520e4a1a service nova] Releasing lock "refresh_cache-81cb942b-5bd6-47c4-8130-f5a4d17f10fa" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:33:52 user nova-compute[71321]: DEBUG nova.network.neutron [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Successfully updated port: 501229b8-6d04-45a8-97df-927b8ec14ca3 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:33:53 user nova-compute[71321]: DEBUG nova.compute.manager [req-ef4564b3-c5c6-4801-a2f2-426016c00993 req-453dd856-1f79-46d7-bebf-2ae4f51dfd52 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-changed-4a995fb4-7c9a-443c-a66a-47c04d7862ea {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:33:53 user nova-compute[71321]: DEBUG nova.compute.manager [req-ef4564b3-c5c6-4801-a2f2-426016c00993 req-453dd856-1f79-46d7-bebf-2ae4f51dfd52 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Refreshing instance network info cache due to event network-changed-4a995fb4-7c9a-443c-a66a-47c04d7862ea. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:33:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ef4564b3-c5c6-4801-a2f2-426016c00993 req-453dd856-1f79-46d7-bebf-2ae4f51dfd52 service nova] Acquiring lock "refresh_cache-81cb942b-5bd6-47c4-8130-f5a4d17f10fa" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:33:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ef4564b3-c5c6-4801-a2f2-426016c00993 req-453dd856-1f79-46d7-bebf-2ae4f51dfd52 service nova] Acquired lock "refresh_cache-81cb942b-5bd6-47c4-8130-f5a4d17f10fa" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:33:53 user nova-compute[71321]: DEBUG nova.network.neutron [req-ef4564b3-c5c6-4801-a2f2-426016c00993 req-453dd856-1f79-46d7-bebf-2ae4f51dfd52 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Refreshing network info cache for port 4a995fb4-7c9a-443c-a66a-47c04d7862ea {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:33:53 user nova-compute[71321]: DEBUG nova.network.neutron [req-ef4564b3-c5c6-4801-a2f2-426016c00993 req-453dd856-1f79-46d7-bebf-2ae4f51dfd52 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:33:54 user nova-compute[71321]: INFO nova.virt.block_device [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Booting with volume 82dcc4b0-743f-4c37-97fc-757dae433d0f at /dev/vdc
Apr 12 12:33:54 user nova-compute[71321]: DEBUG nova.network.neutron [req-ef4564b3-c5c6-4801-a2f2-426016c00993 req-453dd856-1f79-46d7-bebf-2ae4f51dfd52 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:33:54 user nova-compute[71321]: DEBUG nova.network.neutron [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Successfully updated port: e59fa8d8-7765-453d-a135-0abe5f1cae78 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:33:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ef4564b3-c5c6-4801-a2f2-426016c00993 req-453dd856-1f79-46d7-bebf-2ae4f51dfd52 service nova] Releasing lock "refresh_cache-81cb942b-5bd6-47c4-8130-f5a4d17f10fa" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:33:54 user nova-compute[71321]: DEBUG nova.compute.manager [req-ef4564b3-c5c6-4801-a2f2-426016c00993 req-453dd856-1f79-46d7-bebf-2ae4f51dfd52 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-changed-501229b8-6d04-45a8-97df-927b8ec14ca3 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:33:54 user nova-compute[71321]: DEBUG nova.compute.manager [req-ef4564b3-c5c6-4801-a2f2-426016c00993 req-453dd856-1f79-46d7-bebf-2ae4f51dfd52 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Refreshing instance network info cache due to event network-changed-501229b8-6d04-45a8-97df-927b8ec14ca3. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:33:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ef4564b3-c5c6-4801-a2f2-426016c00993 req-453dd856-1f79-46d7-bebf-2ae4f51dfd52 service nova] Acquiring lock "refresh_cache-81cb942b-5bd6-47c4-8130-f5a4d17f10fa" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:33:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ef4564b3-c5c6-4801-a2f2-426016c00993 req-453dd856-1f79-46d7-bebf-2ae4f51dfd52 service nova] Acquired lock "refresh_cache-81cb942b-5bd6-47c4-8130-f5a4d17f10fa" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:33:54 user nova-compute[71321]: DEBUG nova.network.neutron [req-ef4564b3-c5c6-4801-a2f2-426016c00993 req-453dd856-1f79-46d7-bebf-2ae4f51dfd52 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Refreshing network info cache for port 501229b8-6d04-45a8-97df-927b8ec14ca3 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:33:54 user nova-compute[71321]: DEBUG os_brick.utils [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:33:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:54 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7965c60-ba4b-48bc-a51b-f3558d0bee1c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:54 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8742d2e2-6d5c-4431-8365-5d34d2bf9b01]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:54 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb74d93-74b4-4d28-84d7-6d484ed51d73]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:54 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced9b207-3d08-48e6-9646-ecd47bfa8710]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:33:54 user nova-compute[71321]: DEBUG nova.network.neutron [req-ef4564b3-c5c6-4801-a2f2-426016c00993 req-453dd856-1f79-46d7-bebf-2ae4f51dfd52 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:33:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:33:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:33:54 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:33:54 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fadd77e-5b10-412d-bee9-492098f4999e]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:33:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:33:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:33:54 user nova-compute[71321]: DEBUG os_brick.utils [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:33:54 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Updating existing volume attachment record: e9fdd035-e1d6-478c-aade-09dbda4c9279 {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:33:54 user nova-compute[71321]: DEBUG nova.network.neutron [req-ef4564b3-c5c6-4801-a2f2-426016c00993 req-453dd856-1f79-46d7-bebf-2ae4f51dfd52 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:33:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ef4564b3-c5c6-4801-a2f2-426016c00993 req-453dd856-1f79-46d7-bebf-2ae4f51dfd52 service nova] Releasing lock "refresh_cache-81cb942b-5bd6-47c4-8130-f5a4d17f10fa" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:33:55 user nova-compute[71321]: DEBUG nova.network.neutron [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Successfully updated port: bad3a184-db6f-4d2d-ac53-f1155fcf0fe1 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:33:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "refresh_cache-81cb942b-5bd6-47c4-8130-f5a4d17f10fa" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:33:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquired lock "refresh_cache-81cb942b-5bd6-47c4-8130-f5a4d17f10fa" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:33:55 user nova-compute[71321]: DEBUG nova.network.neutron [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:33:55 user nova-compute[71321]: DEBUG nova.network.neutron [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:33:55 user nova-compute[71321]: DEBUG nova.compute.manager [req-846d4bb6-d6c8-44cc-99bd-da7e2bf4112e req-62aa9ff2-0dbc-49cb-b83e-e4aacfb35491 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-changed-e59fa8d8-7765-453d-a135-0abe5f1cae78 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:33:55 user nova-compute[71321]: DEBUG nova.compute.manager [req-846d4bb6-d6c8-44cc-99bd-da7e2bf4112e req-62aa9ff2-0dbc-49cb-b83e-e4aacfb35491 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Refreshing instance network info cache due to event network-changed-e59fa8d8-7765-453d-a135-0abe5f1cae78. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:33:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-846d4bb6-d6c8-44cc-99bd-da7e2bf4112e req-62aa9ff2-0dbc-49cb-b83e-e4aacfb35491 service nova] Acquiring lock "refresh_cache-81cb942b-5bd6-47c4-8130-f5a4d17f10fa" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:33:55 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681302820.8688962, 49339083-8dd4-454b-b7aa-73d91238bef4 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:33:55 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] VM Stopped (Lifecycle Event)
Apr 12 12:33:55 user nova-compute[71321]: DEBUG nova.compute.manager [None req-ffe6b1e7-e274-48ec-970a-7efa1f550604 None None] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:33:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "239b22bb-d381-4bd3-9b73-642f174d7664" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:33:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "239b22bb-d381-4bd3-9b73-642f174d7664" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:33:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:33:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:33:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:33:56 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:33:56 user nova-compute[71321]: INFO nova.compute.claims [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Claim successful on node user
Apr 12 12:33:57 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:33:57 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:33:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.495s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:33:57 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:33:57 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:33:57 user nova-compute[71321]: DEBUG nova.network.neutron [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Updating instance_info_cache with network_info: [{"id": "94f43c42-9d4d-4625-b558-4be918b78ffb", "address": "fa:16:3e:08:8e:12", "network": {"id": "255979eb-ff62-4b24-9a5a-06bc3b6da2c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1439583801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f43c42-9d", "ovs_interfaceid": "94f43c42-9d4d-4625-b558-4be918b78ffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76450ca6-4f7a-4e03-9269-feaacfced76a", "address": "fa:16:3e:73:82:20", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76450ca6-4f", "ovs_interfaceid": "76450ca6-4f7a-4e03-9269-feaacfced76a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5dfbb175-cb83-461e-91da-d7cbde98c3e6", "address": "fa:16:3e:cf:39:d7", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dfbb175-cb", "ovs_interfaceid": "5dfbb175-cb83-461e-91da-d7cbde98c3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a995fb4-7c9a-443c-a66a-47c04d7862ea", "address": "fa:16:3e:24:fd:5a", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a995fb4-7c", "ovs_interfaceid": "4a995fb4-7c9a-443c-a66a-47c04d7862ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "501229b8-6d04-45a8-97df-927b8ec14ca3", "address": "fa:16:3e:b5:8f:dc", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap501229b8-6d", "ovs_interfaceid": "501229b8-6d04-45a8-97df-927b8ec14ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e59fa8d8-7765-453d-a135-0abe5f1cae78", "address": "fa:16:3e:6c:6f:97", "network": {"id": "d2127306-286f-42cb-9dcf-1b4c2e4a9861", "bridge": "br-int", "label": "tempest-device-tagging-net2-1354193313", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape59fa8d8-77", "ovs_interfaceid": "e59fa8d8-7765-453d-a135-0abe5f1cae78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bad3a184-db6f-4d2d-ac53-f1155fcf0fe1", "address": "fa:16:3e:e0:e2:20", "network": {"id": "d2127306-286f-42cb-9dcf-1b4c2e4a9861", "bridge": "br-int", "label": "tempest-device-tagging-net2-1354193313", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad3a184-db", "ovs_interfaceid": "bad3a184-db6f-4d2d-ac53-f1155fcf0fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:33:57 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:33:57 user nova-compute[71321]: DEBUG nova.network.neutron [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:33:57 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:33:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Releasing lock "refresh_cache-81cb942b-5bd6-47c4-8130-f5a4d17f10fa" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:33:57 user nova-compute[71321]: DEBUG nova.compute.manager [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Instance network_info: |[{"id": "94f43c42-9d4d-4625-b558-4be918b78ffb", "address": "fa:16:3e:08:8e:12", "network": {"id": "255979eb-ff62-4b24-9a5a-06bc3b6da2c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1439583801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f43c42-9d", "ovs_interfaceid": "94f43c42-9d4d-4625-b558-4be918b78ffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76450ca6-4f7a-4e03-9269-feaacfced76a", "address": "fa:16:3e:73:82:20", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76450ca6-4f", "ovs_interfaceid": "76450ca6-4f7a-4e03-9269-feaacfced76a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5dfbb175-cb83-461e-91da-d7cbde98c3e6", "address": "fa:16:3e:cf:39:d7", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dfbb175-cb", "ovs_interfaceid": "5dfbb175-cb83-461e-91da-d7cbde98c3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a995fb4-7c9a-443c-a66a-47c04d7862ea", "address": "fa:16:3e:24:fd:5a", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a995fb4-7c", "ovs_interfaceid": "4a995fb4-7c9a-443c-a66a-47c04d7862ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "501229b8-6d04-45a8-97df-927b8ec14ca3", "address": "fa:16:3e:b5:8f:dc", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap501229b8-6d", "ovs_interfaceid": "501229b8-6d04-45a8-97df-927b8ec14ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e59fa8d8-7765-453d-a135-0abe5f1cae78", "address": "fa:16:3e:6c:6f:97", "network": {"id": "d2127306-286f-42cb-9dcf-1b4c2e4a9861", "bridge": "br-int", "label": "tempest-device-tagging-net2-1354193313", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape59fa8d8-77", "ovs_interfaceid": "e59fa8d8-7765-453d-a135-0abe5f1cae78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bad3a184-db6f-4d2d-ac53-f1155fcf0fe1", "address": "fa:16:3e:e0:e2:20", "network": {"id": "d2127306-286f-42cb-9dcf-1b4c2e4a9861", "bridge": "br-int", "label": "tempest-device-tagging-net2-1354193313", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad3a184-db", "ovs_interfaceid": "bad3a184-db6f-4d2d-ac53-f1155fcf0fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:33:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-846d4bb6-d6c8-44cc-99bd-da7e2bf4112e req-62aa9ff2-0dbc-49cb-b83e-e4aacfb35491 service nova] Acquired lock "refresh_cache-81cb942b-5bd6-47c4-8130-f5a4d17f10fa" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:33:57 user nova-compute[71321]: DEBUG nova.network.neutron [req-846d4bb6-d6c8-44cc-99bd-da7e2bf4112e req-62aa9ff2-0dbc-49cb-b83e-e4aacfb35491 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Refreshing network info cache for port e59fa8d8-7765-453d-a135-0abe5f1cae78 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:33:57 user nova-compute[71321]: INFO nova.virt.block_device [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Booting with volume snapshot fca54acc-fe2c-4a63-b476-9ecf7045a772 at /dev/vda
Apr 12 12:33:57 user nova-compute[71321]: DEBUG nova.policy [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '076e65b43f664765ad1d48be6e814f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ada441da2124adda751365952320e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:33:58 user nova-compute[71321]: DEBUG nova.network.neutron [req-846d4bb6-d6c8-44cc-99bd-da7e2bf4112e req-62aa9ff2-0dbc-49cb-b83e-e4aacfb35491 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Updated VIF entry in instance network info cache for port e59fa8d8-7765-453d-a135-0abe5f1cae78. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:33:58 user nova-compute[71321]: DEBUG nova.network.neutron [req-846d4bb6-d6c8-44cc-99bd-da7e2bf4112e req-62aa9ff2-0dbc-49cb-b83e-e4aacfb35491 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Updating instance_info_cache with network_info: [{"id": "94f43c42-9d4d-4625-b558-4be918b78ffb", "address": "fa:16:3e:08:8e:12", "network": {"id": "255979eb-ff62-4b24-9a5a-06bc3b6da2c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1439583801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f43c42-9d", "ovs_interfaceid": "94f43c42-9d4d-4625-b558-4be918b78ffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76450ca6-4f7a-4e03-9269-feaacfced76a", "address": "fa:16:3e:73:82:20", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76450ca6-4f", "ovs_interfaceid": "76450ca6-4f7a-4e03-9269-feaacfced76a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5dfbb175-cb83-461e-91da-d7cbde98c3e6", "address": "fa:16:3e:cf:39:d7", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dfbb175-cb", "ovs_interfaceid": "5dfbb175-cb83-461e-91da-d7cbde98c3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a995fb4-7c9a-443c-a66a-47c04d7862ea", "address": "fa:16:3e:24:fd:5a", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a995fb4-7c", "ovs_interfaceid": "4a995fb4-7c9a-443c-a66a-47c04d7862ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "501229b8-6d04-45a8-97df-927b8ec14ca3", "address": "fa:16:3e:b5:8f:dc", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap501229b8-6d", "ovs_interfaceid": "501229b8-6d04-45a8-97df-927b8ec14ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e59fa8d8-7765-453d-a135-0abe5f1cae78", "address": "fa:16:3e:6c:6f:97", "network": {"id": "d2127306-286f-42cb-9dcf-1b4c2e4a9861", "bridge": "br-int", "label": "tempest-device-tagging-net2-1354193313", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape59fa8d8-77", "ovs_interfaceid": "e59fa8d8-7765-453d-a135-0abe5f1cae78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bad3a184-db6f-4d2d-ac53-f1155fcf0fe1", "address": "fa:16:3e:e0:e2:20", "network": {"id": "d2127306-286f-42cb-9dcf-1b4c2e4a9861", "bridge": "br-int", "label": "tempest-device-tagging-net2-1354193313", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad3a184-db", "ovs_interfaceid": "bad3a184-db6f-4d2d-ac53-f1155fcf0fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:33:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-846d4bb6-d6c8-44cc-99bd-da7e2bf4112e req-62aa9ff2-0dbc-49cb-b83e-e4aacfb35491 service nova] Releasing lock "refresh_cache-81cb942b-5bd6-47c4-8130-f5a4d17f10fa" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:33:58 user nova-compute[71321]: DEBUG nova.compute.manager [req-846d4bb6-d6c8-44cc-99bd-da7e2bf4112e req-62aa9ff2-0dbc-49cb-b83e-e4aacfb35491 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-changed-bad3a184-db6f-4d2d-ac53-f1155fcf0fe1 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:33:58 user nova-compute[71321]: DEBUG nova.compute.manager [req-846d4bb6-d6c8-44cc-99bd-da7e2bf4112e req-62aa9ff2-0dbc-49cb-b83e-e4aacfb35491 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Refreshing instance network info cache due to event network-changed-bad3a184-db6f-4d2d-ac53-f1155fcf0fe1. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:33:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-846d4bb6-d6c8-44cc-99bd-da7e2bf4112e req-62aa9ff2-0dbc-49cb-b83e-e4aacfb35491 service nova] Acquiring lock "refresh_cache-81cb942b-5bd6-47c4-8130-f5a4d17f10fa" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:33:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-846d4bb6-d6c8-44cc-99bd-da7e2bf4112e req-62aa9ff2-0dbc-49cb-b83e-e4aacfb35491 service nova] Acquired lock "refresh_cache-81cb942b-5bd6-47c4-8130-f5a4d17f10fa" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:33:58 user nova-compute[71321]: DEBUG nova.network.neutron [req-846d4bb6-d6c8-44cc-99bd-da7e2bf4112e req-62aa9ff2-0dbc-49cb-b83e-e4aacfb35491 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Refreshing network info cache for port bad3a184-db6f-4d2d-ac53-f1155fcf0fe1 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:33:58 user nova-compute[71321]: DEBUG nova.network.neutron [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Successfully created port: 593b7bab-955d-417a-88c5-6016acf5efe6 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG nova.network.neutron [req-846d4bb6-d6c8-44cc-99bd-da7e2bf4112e req-62aa9ff2-0dbc-49cb-b83e-e4aacfb35491 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Updated VIF entry in instance network info cache for port bad3a184-db6f-4d2d-ac53-f1155fcf0fe1. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG nova.network.neutron [req-846d4bb6-d6c8-44cc-99bd-da7e2bf4112e req-62aa9ff2-0dbc-49cb-b83e-e4aacfb35491 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Updating instance_info_cache with network_info: [{"id": "94f43c42-9d4d-4625-b558-4be918b78ffb", "address": "fa:16:3e:08:8e:12", "network": {"id": "255979eb-ff62-4b24-9a5a-06bc3b6da2c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1439583801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f43c42-9d", "ovs_interfaceid": "94f43c42-9d4d-4625-b558-4be918b78ffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76450ca6-4f7a-4e03-9269-feaacfced76a", "address": "fa:16:3e:73:82:20", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76450ca6-4f", "ovs_interfaceid": "76450ca6-4f7a-4e03-9269-feaacfced76a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5dfbb175-cb83-461e-91da-d7cbde98c3e6", "address": "fa:16:3e:cf:39:d7", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dfbb175-cb", "ovs_interfaceid": "5dfbb175-cb83-461e-91da-d7cbde98c3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a995fb4-7c9a-443c-a66a-47c04d7862ea", "address": "fa:16:3e:24:fd:5a", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a995fb4-7c", "ovs_interfaceid": "4a995fb4-7c9a-443c-a66a-47c04d7862ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "501229b8-6d04-45a8-97df-927b8ec14ca3", "address": "fa:16:3e:b5:8f:dc", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap501229b8-6d", "ovs_interfaceid": "501229b8-6d04-45a8-97df-927b8ec14ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e59fa8d8-7765-453d-a135-0abe5f1cae78", "address": "fa:16:3e:6c:6f:97", "network": {"id": "d2127306-286f-42cb-9dcf-1b4c2e4a9861", "bridge": "br-int", "label": "tempest-device-tagging-net2-1354193313", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape59fa8d8-77", "ovs_interfaceid": "e59fa8d8-7765-453d-a135-0abe5f1cae78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bad3a184-db6f-4d2d-ac53-f1155fcf0fe1", "address": "fa:16:3e:e0:e2:20", "network": {"id": "d2127306-286f-42cb-9dcf-1b4c2e4a9861", "bridge": "br-int", "label": "tempest-device-tagging-net2-1354193313", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad3a184-db", "ovs_interfaceid": "bad3a184-db6f-4d2d-ac53-f1155fcf0fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-846d4bb6-d6c8-44cc-99bd-da7e2bf4112e req-62aa9ff2-0dbc-49cb-b83e-e4aacfb35491 service nova] Releasing lock "refresh_cache-81cb942b-5bd6-47c4-8130-f5a4d17f10fa" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG nova.compute.manager [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:33:59 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Creating image(s)
Apr 12 12:33:59 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Did not create local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Ensure instance console log exists: /opt/stack/data/nova/instances/81cb942b-5bd6-47c4-8130-f5a4d17f10fa/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Start _get_guest_xml network_info=[{"id": "94f43c42-9d4d-4625-b558-4be918b78ffb", "address": "fa:16:3e:08:8e:12", "network": {"id": "255979eb-ff62-4b24-9a5a-06bc3b6da2c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1439583801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f43c42-9d", "ovs_interfaceid": "94f43c42-9d4d-4625-b558-4be918b78ffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76450ca6-4f7a-4e03-9269-feaacfced76a", "address": "fa:16:3e:73:82:20", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76450ca6-4f", "ovs_interfaceid": "76450ca6-4f7a-4e03-9269-feaacfced76a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5dfbb175-cb83-461e-91da-d7cbde98c3e6", "address": "fa:16:3e:cf:39:d7", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dfbb175-cb", "ovs_interfaceid": "5dfbb175-cb83-461e-91da-d7cbde98c3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a995fb4-7c9a-443c-a66a-47c04d7862ea", "address": "fa:16:3e:24:fd:5a", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a995fb4-7c", "ovs_interfaceid": "4a995fb4-7c9a-443c-a66a-47c04d7862ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "501229b8-6d04-45a8-97df-927b8ec14ca3", "address": "fa:16:3e:b5:8f:dc", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap501229b8-6d", "ovs_interfaceid": "501229b8-6d04-45a8-97df-927b8ec14ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e59fa8d8-7765-453d-a135-0abe5f1cae78", "address": "fa:16:3e:6c:6f:97", "network": {"id": "d2127306-286f-42cb-9dcf-1b4c2e4a9861", "bridge": "br-int", "label": "tempest-device-tagging-net2-1354193313", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape59fa8d8-77", "ovs_interfaceid": "e59fa8d8-7765-453d-a135-0abe5f1cae78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bad3a184-db6f-4d2d-ac53-f1155fcf0fe1", "address": "fa:16:3e:e0:e2:20", "network": {"id": "d2127306-286f-42cb-9dcf-1b4c2e4a9861", "bridge": "br-int", "label": "tempest-device-tagging-net2-1354193313", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad3a184-db", "ovs_interfaceid": "bad3a184-db6f-4d2d-ac53-f1155fcf0fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '58695eb7-6546-4c6f-bc04-5c195666edf4', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kMLsNoeY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '81cb942b-5bd6-47c4-8130-f5a4d17f10fa', 'attached_at': '', 'detached_at': '', 'volume_id': '0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d', 'serial': '0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': 'b26bfd22-8cb2-4b43-8492-7d18171d9bda', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UEzQqwmP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '81cb942b-5bd6-47c4-8130-f5a4d17f10fa', 'attached_at': '', 'detached_at': '', 'volume_id': 'a2ae34a9-43d0-4111-84c5-370193d88db8', 'serial': 'a2ae34a9-43d0-4111-84c5-370193d88db8'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': 1, 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': 'e9fdd035-e1d6-478c-aade-09dbda4c9279', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QWCjzXJI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '81cb942b-5bd6-47c4-8130-f5a4d17f10fa', 'attached_at': '', 'detached_at': '', 'volume_id': '82dcc4b0-743f-4c37-97fc-757dae433d0f', 'serial': '82dcc4b0-743f-4c37-97fc-757dae433d0f'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': 2, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:33:59 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:33:59 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:33:59 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kMLsNoeY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:33:59 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:33:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:33:59 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:33:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:33:59 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2476e1f-bfe6-43f0-9a97-072de535d9b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:33:59 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d66a657-35c8-4835-ac58-7c9588fb0c17]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d] added
Apr 12 12:33:59 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b71ea48-f114-49d5-af61-8b8fb9259804]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[013a38c5-7d32-4170-80ef-a5b3ed26f6b8]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kMLsNoeY {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kMLsNoeY" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[59322b2b-19fa-4518-9b2d-ae2e9638089c]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kMLsNoeY'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[25367411-8839-41dd-bf25-0de1e61ceb35]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eabc793-c70d-43dc-a8bb-4f1106ce08e1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:33:59 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:33:59 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:33:59 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:33:59 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:33:59 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:33:59 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef80a1eb-1108-41a2-8721-5044cfe62242]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d, portal: 172.16.0.220,3260]
Apr 12 12:33:59 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d, portal: 172.16.0.220,3260] successful.
Apr 12 12:33:59 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd1bbcd-0bd3-463c-93e3-5900e04b84c7]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1e7c99-11d4-42aa-9c9e-de71b5d7c022]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:33:59 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:33:59 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:33:59 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:33:59 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:33:59 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:33:59 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:33:59 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:33:59 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aaa5c1e-e6af-400d-82d0-7d60065db7ef]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kMLsNoeY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG nova.network.neutron [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Successfully updated port: 593b7bab-955d-417a-88c5-6016acf5efe6 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "refresh_cache-239b22bb-d381-4bd3-9b73-642f174d7664" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquired lock "refresh_cache-239b22bb-d381-4bd3-9b73-642f174d7664" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG nova.network.neutron [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG nova.compute.manager [req-0dd09083-e1ce-4573-98f0-9579002747cb req-c77e30c4-8b18-4efd-99dc-f0c84b53860f service nova] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Received event network-changed-593b7bab-955d-417a-88c5-6016acf5efe6 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG nova.compute.manager [req-0dd09083-e1ce-4573-98f0-9579002747cb req-c77e30c4-8b18-4efd-99dc-f0c84b53860f service nova] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Refreshing instance network info cache due to event network-changed-593b7bab-955d-417a-88c5-6016acf5efe6. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0dd09083-e1ce-4573-98f0-9579002747cb req-c77e30c4-8b18-4efd-99dc-f0c84b53860f service nova] Acquiring lock "refresh_cache-239b22bb-d381-4bd3-9b73-642f174d7664" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:33:59 user nova-compute[71321]: DEBUG nova.network.neutron [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG nova.network.neutron [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Updating instance_info_cache with network_info: [{"id": "593b7bab-955d-417a-88c5-6016acf5efe6", "address": "fa:16:3e:38:0a:d9", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593b7bab-95", "ovs_interfaceid": "593b7bab-955d-417a-88c5-6016acf5efe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Releasing lock "refresh_cache-239b22bb-d381-4bd3-9b73-642f174d7664" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Instance network_info: |[{"id": "593b7bab-955d-417a-88c5-6016acf5efe6", "address": "fa:16:3e:38:0a:d9", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593b7bab-95", "ovs_interfaceid": "593b7bab-955d-417a-88c5-6016acf5efe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0dd09083-e1ce-4573-98f0-9579002747cb req-c77e30c4-8b18-4efd-99dc-f0c84b53860f service nova] Acquired lock "refresh_cache-239b22bb-d381-4bd3-9b73-642f174d7664" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG nova.network.neutron [req-0dd09083-e1ce-4573-98f0-9579002747cb req-c77e30c4-8b18-4efd-99dc-f0c84b53860f service nova] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Refreshing network info cache for port 593b7bab-955d-417a-88c5-6016acf5efe6 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26264336638386262', 'path': '/dev/sde'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264336638386262', 'path': '/dev/sde'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UEzQqwmP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:34:00 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:34:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:34:00 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:34:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:34:00 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG nova.network.neutron [req-0dd09083-e1ce-4573-98f0-9579002747cb req-c77e30c4-8b18-4efd-99dc-f0c84b53860f service nova] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Updated VIF entry in instance network info cache for port 593b7bab-955d-417a-88c5-6016acf5efe6. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG nova.network.neutron [req-0dd09083-e1ce-4573-98f0-9579002747cb req-c77e30c4-8b18-4efd-99dc-f0c84b53860f service nova] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Updating instance_info_cache with network_info: [{"id": "593b7bab-955d-417a-88c5-6016acf5efe6", "address": "fa:16:3e:38:0a:d9", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593b7bab-95", "ovs_interfaceid": "593b7bab-955d-417a-88c5-6016acf5efe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c79f05b-abc7-46e2-aa67-3b52bafa25dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:34:00 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0dd09083-e1ce-4573-98f0-9579002747cb req-c77e30c4-8b18-4efd-99dc-f0c84b53860f service nova] Releasing lock "refresh_cache-239b22bb-d381-4bd3-9b73-642f174d7664" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a0cf8c-a4a0-4b7f-b248-5249d41d0017]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8] added
Apr 12 12:34:00 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb22dcb-fd3d-45b4-80c3-7b16f83f9c84]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13993e6-5652-4750-97d0-6f57afba5bbc]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UEzQqwmP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UEzQqwmP" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4714fb36-e0f0-48d2-ac4f-e4295d4b4db4]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UEzQqwmP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6c7faf-7228-4e1c-b184-a3933cc393c5]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9df8d3d-2d83-4d26-8715-f38f40302b06]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:34:00 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:34:00 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:34:00 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:34:00 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:34:00 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:34:00 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:34:00 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:34:00 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e1183a-44cb-42a7-a259-6643dc732e89]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8, portal: 172.16.0.220,3260]
Apr 12 12:34:00 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8, portal: 172.16.0.220,3260] successful.
Apr 12 12:34:00 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f403eb-72f0-452d-9110-c08e5baffe2d]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab38aa6-c33b-4980-bd11-d774ea6c6658]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:34:00 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:34:00 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:34:00 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:34:00 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:34:00 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:34:00 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:34:00 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:34:00 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:34:00 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:34:00 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] HCTL ('37', '-', '-', 0) found on session 20 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f052e58a-40bd-475b-bd52-4ed487e4f1b9]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Searching for a device in session 20 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UEzQqwmP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:34:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:01 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:34:01 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23437316563623631', 'path': '/dev/sdf'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:34:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437316563623631', 'path': '/dev/sdf'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:34:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:34:01 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QWCjzXJI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:34:01 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:34:01 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:34:01 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:34:01 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:34:01 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:34:01 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:34:01 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:34:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:01 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0511aa-5802-4756-b043-437c0e6e3542]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:01 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:34:01 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:01 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f738ed0c-c674-4e97-93e6-50b3d1a1bb80]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:01 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f] added
Apr 12 12:34:01 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:01 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca78cb07-6c8e-4198-9079-f35126ca1582]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:01 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:01 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1041d5e-bce3-422d-bdc8-ae7b9f703c37]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:01 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QWCjzXJI {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QWCjzXJI" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:01 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a597291-3625-46d2-b273-6bb30b2ef524]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:01 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QWCjzXJI'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e00203-2f30-41cc-a496-f4cfbc077a5f]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e5d81e-6aa9-48aa-9fb8-1c812652b3e9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:34:02 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:34:02 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:34:02 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:34:02 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:34:02 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:34:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:34:02 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:34:02 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:34:02 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:34:02 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:34:02 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:34:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[596a77a0-09cd-4e61-b08e-089c9bd9f4a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f, portal: 172.16.0.220,3260]
Apr 12 12:34:02 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f, portal: 172.16.0.220,3260] successful.
Apr 12 12:34:02 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ce8ee9-8e55-4468-8326-8fea33b6f9e6]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2495fd26-9e32-4464-8f05-c9a11e956f38]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:34:02 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:34:02 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:34:02 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:34:02 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:34:02 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:34:02 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:34:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:34:02 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:34:02 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:34:02 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:34:02 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:34:02 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:34:02 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:34:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:34:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:34:02 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] HCTL ('38', '-', '-', 0) found on session 21 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:34:02 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:34:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da46880-da8a-495b-bad1-891bb5c47348]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:02 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Searching for a device in session 21 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:34:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QWCjzXJI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26232626365306634', 'path': '/dev/sdg'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232626365306634', 'path': '/dev/sdg'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:33:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-256759259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-256759259',id=19,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxNMexTFhDz2xFUAc4wGA58bVNqR+Fa59qGoEiKr99V0q4IOgnoQTzSr7XTI3nk5SwdCrf8QdfX2WZWlW4pIaFx6quZwUHVtAENs6MteuKUONpmPxi7z1AGiMPLRGF49A==',key_name='tempest-keypair-2067665587',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f89f1f2dba8e4325b550ad91403e60ad',ramdisk_id='',reservation_id='r-mobcfx4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-602948185',owner_user_name='tempest-TaggedBootDevicesTest_v242-602948185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:33:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e17bc9d4cf743c19f9493d30b62fc16',uuid=81cb942b-5bd6-47c4-8130-f5a4d17f10fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94f43c42-9d4d-4625-b558-4be918b78ffb", "address": "fa:16:3e:08:8e:12", "network": {"id": "255979eb-ff62-4b24-9a5a-06bc3b6da2c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1439583801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f43c42-9d", "ovs_interfaceid": "94f43c42-9d4d-4625-b558-4be918b78ffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converting VIF {"id": "94f43c42-9d4d-4625-b558-4be918b78ffb", "address": "fa:16:3e:08:8e:12", "network": {"id": "255979eb-ff62-4b24-9a5a-06bc3b6da2c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1439583801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f43c42-9d", "ovs_interfaceid": "94f43c42-9d4d-4625-b558-4be918b78ffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:8e:12,bridge_name='br-int',has_traffic_filtering=True,id=94f43c42-9d4d-4625-b558-4be918b78ffb,network=Network(255979eb-ff62-4b24-9a5a-06bc3b6da2c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94f43c42-9d') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:33:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-256759259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-256759259',id=19,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxNMexTFhDz2xFUAc4wGA58bVNqR+Fa59qGoEiKr99V0q4IOgnoQTzSr7XTI3nk5SwdCrf8QdfX2WZWlW4pIaFx6quZwUHVtAENs6MteuKUONpmPxi7z1AGiMPLRGF49A==',key_name='tempest-keypair-2067665587',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f89f1f2dba8e4325b550ad91403e60ad',ramdisk_id='',reservation_id='r-mobcfx4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-602948185',owner_user_name='tempest-TaggedBootDevicesTest_v242-602948185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:33:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e17bc9d4cf743c19f9493d30b62fc16',uuid=81cb942b-5bd6-47c4-8130-f5a4d17f10fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76450ca6-4f7a-4e03-9269-feaacfced76a", "address": "fa:16:3e:73:82:20", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76450ca6-4f", "ovs_interfaceid": "76450ca6-4f7a-4e03-9269-feaacfced76a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converting VIF {"id": "76450ca6-4f7a-4e03-9269-feaacfced76a", "address": "fa:16:3e:73:82:20", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76450ca6-4f", "ovs_interfaceid": "76450ca6-4f7a-4e03-9269-feaacfced76a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:82:20,bridge_name='br-int',has_traffic_filtering=True,id=76450ca6-4f7a-4e03-9269-feaacfced76a,network=Network(cdff297b-c932-49f5-8f91-31b7a475af78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap76450ca6-4f') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:33:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-256759259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-256759259',id=19,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxNMexTFhDz2xFUAc4wGA58bVNqR+Fa59qGoEiKr99V0q4IOgnoQTzSr7XTI3nk5SwdCrf8QdfX2WZWlW4pIaFx6quZwUHVtAENs6MteuKUONpmPxi7z1AGiMPLRGF49A==',key_name='tempest-keypair-2067665587',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f89f1f2dba8e4325b550ad91403e60ad',ramdisk_id='',reservation_id='r-mobcfx4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-602948185',owner_user_name='tempest-TaggedBootDevicesTest_v242-602948185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:33:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e17bc9d4cf743c19f9493d30b62fc16',uuid=81cb942b-5bd6-47c4-8130-f5a4d17f10fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5dfbb175-cb83-461e-91da-d7cbde98c3e6", "address": "fa:16:3e:cf:39:d7", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dfbb175-cb", "ovs_interfaceid": "5dfbb175-cb83-461e-91da-d7cbde98c3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converting VIF {"id": "5dfbb175-cb83-461e-91da-d7cbde98c3e6", "address": "fa:16:3e:cf:39:d7", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dfbb175-cb", "ovs_interfaceid": "5dfbb175-cb83-461e-91da-d7cbde98c3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:39:d7,bridge_name='br-int',has_traffic_filtering=True,id=5dfbb175-cb83-461e-91da-d7cbde98c3e6,network=Network(cdff297b-c932-49f5-8f91-31b7a475af78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5dfbb175-cb') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:33:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-256759259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-256759259',id=19,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxNMexTFhDz2xFUAc4wGA58bVNqR+Fa59qGoEiKr99V0q4IOgnoQTzSr7XTI3nk5SwdCrf8QdfX2WZWlW4pIaFx6quZwUHVtAENs6MteuKUONpmPxi7z1AGiMPLRGF49A==',key_name='tempest-keypair-2067665587',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f89f1f2dba8e4325b550ad91403e60ad',ramdisk_id='',reservation_id='r-mobcfx4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-602948185',owner_user_name='tempest-TaggedBootDevicesTest_v242-602948185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:33:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e17bc9d4cf743c19f9493d30b62fc16',uuid=81cb942b-5bd6-47c4-8130-f5a4d17f10fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a995fb4-7c9a-443c-a66a-47c04d7862ea", "address": "fa:16:3e:24:fd:5a", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a995fb4-7c", "ovs_interfaceid": "4a995fb4-7c9a-443c-a66a-47c04d7862ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converting VIF {"id": "4a995fb4-7c9a-443c-a66a-47c04d7862ea", "address": "fa:16:3e:24:fd:5a", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a995fb4-7c", "ovs_interfaceid": "4a995fb4-7c9a-443c-a66a-47c04d7862ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:fd:5a,bridge_name='br-int',has_traffic_filtering=True,id=4a995fb4-7c9a-443c-a66a-47c04d7862ea,network=Network(cdff297b-c932-49f5-8f91-31b7a475af78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a995fb4-7c') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:33:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-256759259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-256759259',id=19,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxNMexTFhDz2xFUAc4wGA58bVNqR+Fa59qGoEiKr99V0q4IOgnoQTzSr7XTI3nk5SwdCrf8QdfX2WZWlW4pIaFx6quZwUHVtAENs6MteuKUONpmPxi7z1AGiMPLRGF49A==',key_name='tempest-keypair-2067665587',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f89f1f2dba8e4325b550ad91403e60ad',ramdisk_id='',reservation_id='r-mobcfx4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-602948185',owner_user_name='tempest-TaggedBootDevicesTest_v242-602948185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:33:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e17bc9d4cf743c19f9493d30b62fc16',uuid=81cb942b-5bd6-47c4-8130-f5a4d17f10fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "501229b8-6d04-45a8-97df-927b8ec14ca3", "address": "fa:16:3e:b5:8f:dc", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap501229b8-6d", "ovs_interfaceid": "501229b8-6d04-45a8-97df-927b8ec14ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converting VIF {"id": "501229b8-6d04-45a8-97df-927b8ec14ca3", "address": "fa:16:3e:b5:8f:dc", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap501229b8-6d", "ovs_interfaceid": "501229b8-6d04-45a8-97df-927b8ec14ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:8f:dc,bridge_name='br-int',has_traffic_filtering=True,id=501229b8-6d04-45a8-97df-927b8ec14ca3,network=Network(cdff297b-c932-49f5-8f91-31b7a475af78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap501229b8-6d') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:33:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-256759259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-256759259',id=19,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxNMexTFhDz2xFUAc4wGA58bVNqR+Fa59qGoEiKr99V0q4IOgnoQTzSr7XTI3nk5SwdCrf8QdfX2WZWlW4pIaFx6quZwUHVtAENs6MteuKUONpmPxi7z1AGiMPLRGF49A==',key_name='tempest-keypair-2067665587',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f89f1f2dba8e4325b550ad91403e60ad',ramdisk_id='',reservation_id='r-mobcfx4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-602948185',owner_user_name='tempest-TaggedBootDevicesTest_v242-602948185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:33:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e17bc9d4cf743c19f9493d30b62fc16',uuid=81cb942b-5bd6-47c4-8130-f5a4d17f10fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e59fa8d8-7765-453d-a135-0abe5f1cae78", "address": "fa:16:3e:6c:6f:97", "network": {"id": "d2127306-286f-42cb-9dcf-1b4c2e4a9861", "bridge": "br-int", "label": "tempest-device-tagging-net2-1354193313", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape59fa8d8-77", "ovs_interfaceid": "e59fa8d8-7765-453d-a135-0abe5f1cae78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converting VIF {"id": "e59fa8d8-7765-453d-a135-0abe5f1cae78", "address": "fa:16:3e:6c:6f:97", "network": {"id": "d2127306-286f-42cb-9dcf-1b4c2e4a9861", "bridge": "br-int", "label": "tempest-device-tagging-net2-1354193313", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape59fa8d8-77", "ovs_interfaceid": "e59fa8d8-7765-453d-a135-0abe5f1cae78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:6f:97,bridge_name='br-int',has_traffic_filtering=True,id=e59fa8d8-7765-453d-a135-0abe5f1cae78,network=Network(d2127306-286f-42cb-9dcf-1b4c2e4a9861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape59fa8d8-77') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:33:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-256759259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-256759259',id=19,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxNMexTFhDz2xFUAc4wGA58bVNqR+Fa59qGoEiKr99V0q4IOgnoQTzSr7XTI3nk5SwdCrf8QdfX2WZWlW4pIaFx6quZwUHVtAENs6MteuKUONpmPxi7z1AGiMPLRGF49A==',key_name='tempest-keypair-2067665587',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f89f1f2dba8e4325b550ad91403e60ad',ramdisk_id='',reservation_id='r-mobcfx4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-602948185',owner_user_name='tempest-TaggedBootDevicesTest_v242-602948185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:33:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e17bc9d4cf743c19f9493d30b62fc16',uuid=81cb942b-5bd6-47c4-8130-f5a4d17f10fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bad3a184-db6f-4d2d-ac53-f1155fcf0fe1", "address": "fa:16:3e:e0:e2:20", "network": {"id": "d2127306-286f-42cb-9dcf-1b4c2e4a9861", "bridge": "br-int", "label": "tempest-device-tagging-net2-1354193313", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad3a184-db", "ovs_interfaceid": "bad3a184-db6f-4d2d-ac53-f1155fcf0fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converting VIF {"id": "bad3a184-db6f-4d2d-ac53-f1155fcf0fe1", "address": "fa:16:3e:e0:e2:20", "network": {"id": "d2127306-286f-42cb-9dcf-1b4c2e4a9861", "bridge": "br-int", "label": "tempest-device-tagging-net2-1354193313", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad3a184-db", "ovs_interfaceid": "bad3a184-db6f-4d2d-ac53-f1155fcf0fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e2:20,bridge_name='br-int',has_traffic_filtering=True,id=bad3a184-db6f-4d2d-ac53-f1155fcf0fe1,network=Network(d2127306-286f-42cb-9dcf-1b4c2e4a9861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad3a184-db') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.objects.instance [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lazy-loading 'pci_devices' on Instance uuid 81cb942b-5bd6-47c4-8130-f5a4d17f10fa {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:34:03 user nova-compute[71321]:   <uuid>81cb942b-5bd6-47c4-8130-f5a4d17f10fa</uuid>
Apr 12 12:34:03 user nova-compute[71321]:   <name>instance-00000013</name>
Apr 12 12:34:03 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:34:03 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:34:03 user nova-compute[71321]:   <metadata>
Apr 12 12:34:03 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:34:03 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:34:03 user nova-compute[71321]:       <nova:name>tempest-device-tagging-server-256759259</nova:name>
Apr 12 12:34:03 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:33:59</nova:creationTime>
Apr 12 12:34:03 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:34:03 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:34:03 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:34:03 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:34:03 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:34:03 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:34:03 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:34:03 user nova-compute[71321]:       <nova:owner>
Apr 12 12:34:03 user nova-compute[71321]:         <nova:user uuid="5e17bc9d4cf743c19f9493d30b62fc16">tempest-TaggedBootDevicesTest_v242-602948185-project-member</nova:user>
Apr 12 12:34:03 user nova-compute[71321]:         <nova:project uuid="f89f1f2dba8e4325b550ad91403e60ad">tempest-TaggedBootDevicesTest_v242-602948185</nova:project>
Apr 12 12:34:03 user nova-compute[71321]:       </nova:owner>
Apr 12 12:34:03 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:34:03 user nova-compute[71321]:       <nova:ports>
Apr 12 12:34:03 user nova-compute[71321]:         <nova:port uuid="94f43c42-9d4d-4625-b558-4be918b78ffb">
Apr 12 12:34:03 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 12:34:03 user nova-compute[71321]:         </nova:port>
Apr 12 12:34:03 user nova-compute[71321]:         <nova:port uuid="76450ca6-4f7a-4e03-9269-feaacfced76a">
Apr 12 12:34:03 user nova-compute[71321]:           <nova:ip type="fixed" address="10.1.1.68" ipVersion="4"/>
Apr 12 12:34:03 user nova-compute[71321]:         </nova:port>
Apr 12 12:34:03 user nova-compute[71321]:         <nova:port uuid="5dfbb175-cb83-461e-91da-d7cbde98c3e6">
Apr 12 12:34:03 user nova-compute[71321]:           <nova:ip type="fixed" address="10.1.1.55" ipVersion="4"/>
Apr 12 12:34:03 user nova-compute[71321]:         </nova:port>
Apr 12 12:34:03 user nova-compute[71321]:         <nova:port uuid="4a995fb4-7c9a-443c-a66a-47c04d7862ea">
Apr 12 12:34:03 user nova-compute[71321]:           <nova:ip type="fixed" address="10.1.1.231" ipVersion="4"/>
Apr 12 12:34:03 user nova-compute[71321]:         </nova:port>
Apr 12 12:34:03 user nova-compute[71321]:         <nova:port uuid="501229b8-6d04-45a8-97df-927b8ec14ca3">
Apr 12 12:34:03 user nova-compute[71321]:           <nova:ip type="fixed" address="10.1.1.183" ipVersion="4"/>
Apr 12 12:34:03 user nova-compute[71321]:         </nova:port>
Apr 12 12:34:03 user nova-compute[71321]:         <nova:port uuid="e59fa8d8-7765-453d-a135-0abe5f1cae78">
Apr 12 12:34:03 user nova-compute[71321]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 12 12:34:03 user nova-compute[71321]:         </nova:port>
Apr 12 12:34:03 user nova-compute[71321]:         <nova:port uuid="bad3a184-db6f-4d2d-ac53-f1155fcf0fe1">
Apr 12 12:34:03 user nova-compute[71321]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 12 12:34:03 user nova-compute[71321]:         </nova:port>
Apr 12 12:34:03 user nova-compute[71321]:       </nova:ports>
Apr 12 12:34:03 user nova-compute[71321]:     </nova:instance>
Apr 12 12:34:03 user nova-compute[71321]:   </metadata>
Apr 12 12:34:03 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:34:03 user nova-compute[71321]:     <system>
Apr 12 12:34:03 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:34:03 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:34:03 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:34:03 user nova-compute[71321]:       <entry name="serial">81cb942b-5bd6-47c4-8130-f5a4d17f10fa</entry>
Apr 12 12:34:03 user nova-compute[71321]:       <entry name="uuid">81cb942b-5bd6-47c4-8130-f5a4d17f10fa</entry>
Apr 12 12:34:03 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:34:03 user nova-compute[71321]:     </system>
Apr 12 12:34:03 user nova-compute[71321]:   </sysinfo>
Apr 12 12:34:03 user nova-compute[71321]:   <os>
Apr 12 12:34:03 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:34:03 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:34:03 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:34:03 user nova-compute[71321]:   </os>
Apr 12 12:34:03 user nova-compute[71321]:   <features>
Apr 12 12:34:03 user nova-compute[71321]:     <acpi/>
Apr 12 12:34:03 user nova-compute[71321]:     <apic/>
Apr 12 12:34:03 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:34:03 user nova-compute[71321]:   </features>
Apr 12 12:34:03 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:34:03 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:34:03 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:34:03 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:34:03 user nova-compute[71321]:   </clock>
Apr 12 12:34:03 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:34:03 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:34:03 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:34:03 user nova-compute[71321]:   </cpu>
Apr 12 12:34:03 user nova-compute[71321]:   <devices>
Apr 12 12:34:03 user nova-compute[71321]:     <disk type="file" device="cdrom">
Apr 12 12:34:03 user nova-compute[71321]:       <driver name="qemu" type="raw" cache="none"/>
Apr 12 12:34:03 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/81cb942b-5bd6-47c4-8130-f5a4d17f10fa/disk.config"/>
Apr 12 12:34:03 user nova-compute[71321]:       <target dev="hda" bus="ide"/>
Apr 12 12:34:03 user nova-compute[71321]:     </disk>
Apr 12 12:34:03 user nova-compute[71321]:     <disk type="block" device="disk">
Apr 12 12:34:03 user nova-compute[71321]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:34:03 user nova-compute[71321]:       <source dev="/dev/sde"/>
Apr 12 12:34:03 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:34:03 user nova-compute[71321]:       <serial>0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d</serial>
Apr 12 12:34:03 user nova-compute[71321]:     </disk>
Apr 12 12:34:03 user nova-compute[71321]:     <disk type="block" device="disk">
Apr 12 12:34:03 user nova-compute[71321]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:34:03 user nova-compute[71321]:       <source dev="/dev/sdf"/>
Apr 12 12:34:03 user nova-compute[71321]:       <target dev="vdb" bus="virtio"/>
Apr 12 12:34:03 user nova-compute[71321]:       <serial>a2ae34a9-43d0-4111-84c5-370193d88db8</serial>
Apr 12 12:34:03 user nova-compute[71321]:     </disk>
Apr 12 12:34:03 user nova-compute[71321]:     <disk type="block" device="disk">
Apr 12 12:34:03 user nova-compute[71321]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:34:03 user nova-compute[71321]:       <source dev="/dev/sdg"/>
Apr 12 12:34:03 user nova-compute[71321]:       <target dev="vdc" bus="virtio"/>
Apr 12 12:34:03 user nova-compute[71321]:       <serial>82dcc4b0-743f-4c37-97fc-757dae433d0f</serial>
Apr 12 12:34:03 user nova-compute[71321]:     </disk>
Apr 12 12:34:03 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:34:03 user nova-compute[71321]:       <mac address="fa:16:3e:08:8e:12"/>
Apr 12 12:34:03 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:34:03 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:34:03 user nova-compute[71321]:       <target dev="tap94f43c42-9d"/>
Apr 12 12:34:03 user nova-compute[71321]:     </interface>
Apr 12 12:34:03 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:34:03 user nova-compute[71321]:       <mac address="fa:16:3e:73:82:20"/>
Apr 12 12:34:03 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:34:03 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:34:03 user nova-compute[71321]:       <target dev="tap76450ca6-4f"/>
Apr 12 12:34:03 user nova-compute[71321]:     </interface>
Apr 12 12:34:03 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:34:03 user nova-compute[71321]:       <mac address="fa:16:3e:cf:39:d7"/>
Apr 12 12:34:03 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:34:03 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:34:03 user nova-compute[71321]:       <target dev="tap5dfbb175-cb"/>
Apr 12 12:34:03 user nova-compute[71321]:     </interface>
Apr 12 12:34:03 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:34:03 user nova-compute[71321]:       <mac address="fa:16:3e:24:fd:5a"/>
Apr 12 12:34:03 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:34:03 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:34:03 user nova-compute[71321]:       <target dev="tap4a995fb4-7c"/>
Apr 12 12:34:03 user nova-compute[71321]:     </interface>
Apr 12 12:34:03 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:34:03 user nova-compute[71321]:       <mac address="fa:16:3e:b5:8f:dc"/>
Apr 12 12:34:03 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:34:03 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:34:03 user nova-compute[71321]:       <target dev="tap501229b8-6d"/>
Apr 12 12:34:03 user nova-compute[71321]:     </interface>
Apr 12 12:34:03 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:34:03 user nova-compute[71321]:       <mac address="fa:16:3e:6c:6f:97"/>
Apr 12 12:34:03 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:34:03 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:34:03 user nova-compute[71321]:       <target dev="tape59fa8d8-77"/>
Apr 12 12:34:03 user nova-compute[71321]:     </interface>
Apr 12 12:34:03 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:34:03 user nova-compute[71321]:       <mac address="fa:16:3e:e0:e2:20"/>
Apr 12 12:34:03 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:34:03 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:34:03 user nova-compute[71321]:       <target dev="tapbad3a184-db"/>
Apr 12 12:34:03 user nova-compute[71321]:     </interface>
Apr 12 12:34:03 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:34:03 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/81cb942b-5bd6-47c4-8130-f5a4d17f10fa/console.log" append="off"/>
Apr 12 12:34:03 user nova-compute[71321]:     </serial>
Apr 12 12:34:03 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:34:03 user nova-compute[71321]:     <video>
Apr 12 12:34:03 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:34:03 user nova-compute[71321]:     </video>
Apr 12 12:34:03 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:34:03 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:34:03 user nova-compute[71321]:     </rng>
Apr 12 12:34:03 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:34:03 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:34:03 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:34:03 user nova-compute[71321]:     </memballoon>
Apr 12 12:34:03 user nova-compute[71321]:   </devices>
Apr 12 12:34:03 user nova-compute[71321]: </domain>
Apr 12 12:34:03 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:33:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-256759259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-256759259',id=19,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxNMexTFhDz2xFUAc4wGA58bVNqR+Fa59qGoEiKr99V0q4IOgnoQTzSr7XTI3nk5SwdCrf8QdfX2WZWlW4pIaFx6quZwUHVtAENs6MteuKUONpmPxi7z1AGiMPLRGF49A==',key_name='tempest-keypair-2067665587',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f89f1f2dba8e4325b550ad91403e60ad',ramdisk_id='',reservation_id='r-mobcfx4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-602948185',owner_user_name='tempest-TaggedBootDevicesTest_v242-602948185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:33:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e17bc9d4cf743c19f9493d30b62fc16',uuid=81cb942b-5bd6-47c4-8130-f5a4d17f10fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94f43c42-9d4d-4625-b558-4be918b78ffb", "address": "fa:16:3e:08:8e:12", "network": {"id": "255979eb-ff62-4b24-9a5a-06bc3b6da2c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1439583801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f43c42-9d", "ovs_interfaceid": "94f43c42-9d4d-4625-b558-4be918b78ffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converting VIF {"id": "94f43c42-9d4d-4625-b558-4be918b78ffb", "address": "fa:16:3e:08:8e:12", "network": {"id": "255979eb-ff62-4b24-9a5a-06bc3b6da2c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1439583801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f43c42-9d", "ovs_interfaceid": "94f43c42-9d4d-4625-b558-4be918b78ffb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:8e:12,bridge_name='br-int',has_traffic_filtering=True,id=94f43c42-9d4d-4625-b558-4be918b78ffb,network=Network(255979eb-ff62-4b24-9a5a-06bc3b6da2c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94f43c42-9d') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG os_vif [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:8e:12,bridge_name='br-int',has_traffic_filtering=True,id=94f43c42-9d4d-4625-b558-4be918b78ffb,network=Network(255979eb-ff62-4b24-9a5a-06bc3b6da2c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94f43c42-9d') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG os_brick.utils [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94f43c42-9d, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap94f43c42-9d, col_values=(('external_ids', {'iface-id': '94f43c42-9d4d-4625-b558-4be918b78ffb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:8e:12', 'vm-uuid': '81cb942b-5bd6-47c4-8130-f5a4d17f10fa'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc9f854-3c2c-4747-a0e0-17a28f13fda6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:03 user nova-compute[71321]: INFO os_vif [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:8e:12,bridge_name='br-int',has_traffic_filtering=True,id=94f43c42-9d4d-4625-b558-4be918b78ffb,network=Network(255979eb-ff62-4b24-9a5a-06bc3b6da2c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94f43c42-9d')
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:33:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-256759259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-256759259',id=19,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxNMexTFhDz2xFUAc4wGA58bVNqR+Fa59qGoEiKr99V0q4IOgnoQTzSr7XTI3nk5SwdCrf8QdfX2WZWlW4pIaFx6quZwUHVtAENs6MteuKUONpmPxi7z1AGiMPLRGF49A==',key_name='tempest-keypair-2067665587',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f89f1f2dba8e4325b550ad91403e60ad',ramdisk_id='',reservation_id='r-mobcfx4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-602948185',owner_user_name='tempest-TaggedBootDevicesTest_v242-602948185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:33:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e17bc9d4cf743c19f9493d30b62fc16',uuid=81cb942b-5bd6-47c4-8130-f5a4d17f10fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76450ca6-4f7a-4e03-9269-feaacfced76a", "address": "fa:16:3e:73:82:20", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76450ca6-4f", "ovs_interfaceid": "76450ca6-4f7a-4e03-9269-feaacfced76a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converting VIF {"id": "76450ca6-4f7a-4e03-9269-feaacfced76a", "address": "fa:16:3e:73:82:20", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76450ca6-4f", "ovs_interfaceid": "76450ca6-4f7a-4e03-9269-feaacfced76a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:82:20,bridge_name='br-int',has_traffic_filtering=True,id=76450ca6-4f7a-4e03-9269-feaacfced76a,network=Network(cdff297b-c932-49f5-8f91-31b7a475af78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap76450ca6-4f') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG os_vif [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:82:20,bridge_name='br-int',has_traffic_filtering=True,id=76450ca6-4f7a-4e03-9269-feaacfced76a,network=Network(cdff297b-c932-49f5-8f91-31b7a475af78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap76450ca6-4f') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76450ca6-4f, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap76450ca6-4f, col_values=(('external_ids', {'iface-id': '76450ca6-4f7a-4e03-9269-feaacfced76a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:82:20', 'vm-uuid': '81cb942b-5bd6-47c4-8130-f5a4d17f10fa'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3c2605-df39-4d54-82ca-4cbb4c23dc87]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:03 user nova-compute[71321]: INFO os_vif [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:82:20,bridge_name='br-int',has_traffic_filtering=True,id=76450ca6-4f7a-4e03-9269-feaacfced76a,network=Network(cdff297b-c932-49f5-8f91-31b7a475af78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap76450ca6-4f')
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:33:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-256759259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-256759259',id=19,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxNMexTFhDz2xFUAc4wGA58bVNqR+Fa59qGoEiKr99V0q4IOgnoQTzSr7XTI3nk5SwdCrf8QdfX2WZWlW4pIaFx6quZwUHVtAENs6MteuKUONpmPxi7z1AGiMPLRGF49A==',key_name='tempest-keypair-2067665587',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f89f1f2dba8e4325b550ad91403e60ad',ramdisk_id='',reservation_id='r-mobcfx4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-602948185',owner_user_name='tempest-TaggedBootDevicesTest_v242-602948185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:33:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e17bc9d4cf743c19f9493d30b62fc16',uuid=81cb942b-5bd6-47c4-8130-f5a4d17f10fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5dfbb175-cb83-461e-91da-d7cbde98c3e6", "address": "fa:16:3e:cf:39:d7", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dfbb175-cb", "ovs_interfaceid": "5dfbb175-cb83-461e-91da-d7cbde98c3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converting VIF {"id": "5dfbb175-cb83-461e-91da-d7cbde98c3e6", "address": "fa:16:3e:cf:39:d7", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dfbb175-cb", "ovs_interfaceid": "5dfbb175-cb83-461e-91da-d7cbde98c3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:39:d7,bridge_name='br-int',has_traffic_filtering=True,id=5dfbb175-cb83-461e-91da-d7cbde98c3e6,network=Network(cdff297b-c932-49f5-8f91-31b7a475af78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5dfbb175-cb') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG os_vif [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:39:d7,bridge_name='br-int',has_traffic_filtering=True,id=5dfbb175-cb83-461e-91da-d7cbde98c3e6,network=Network(cdff297b-c932-49f5-8f91-31b7a475af78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5dfbb175-cb') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[173ea55c-f52e-4796-bd71-4f7d90fd6c8b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5ab0c8-7cc1-42b0-bdd6-ed3afb56d1f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5dfbb175-cb, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5dfbb175-cb, col_values=(('external_ids', {'iface-id': '5dfbb175-cb83-461e-91da-d7cbde98c3e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:39:d7', 'vm-uuid': '81cb942b-5bd6-47c4-8130-f5a4d17f10fa'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:34:03 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:34:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[39366a7b-7402-4baf-b65c-75a60f3d689c]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG os_brick.utils [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Updating existing volume attachment record: fe17e0da-fe9f-4cb3-b60a-3a6b0bfa28bf {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:03 user nova-compute[71321]: INFO os_vif [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:39:d7,bridge_name='br-int',has_traffic_filtering=True,id=5dfbb175-cb83-461e-91da-d7cbde98c3e6,network=Network(cdff297b-c932-49f5-8f91-31b7a475af78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5dfbb175-cb')
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:33:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-256759259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-256759259',id=19,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxNMexTFhDz2xFUAc4wGA58bVNqR+Fa59qGoEiKr99V0q4IOgnoQTzSr7XTI3nk5SwdCrf8QdfX2WZWlW4pIaFx6quZwUHVtAENs6MteuKUONpmPxi7z1AGiMPLRGF49A==',key_name='tempest-keypair-2067665587',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f89f1f2dba8e4325b550ad91403e60ad',ramdisk_id='',reservation_id='r-mobcfx4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-602948185',owner_user_name='tempest-TaggedBootDevicesTest_v242-602948185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:33:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e17bc9d4cf743c19f9493d30b62fc16',uuid=81cb942b-5bd6-47c4-8130-f5a4d17f10fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a995fb4-7c9a-443c-a66a-47c04d7862ea", "address": "fa:16:3e:24:fd:5a", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a995fb4-7c", "ovs_interfaceid": "4a995fb4-7c9a-443c-a66a-47c04d7862ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converting VIF {"id": "4a995fb4-7c9a-443c-a66a-47c04d7862ea", "address": "fa:16:3e:24:fd:5a", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a995fb4-7c", "ovs_interfaceid": "4a995fb4-7c9a-443c-a66a-47c04d7862ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:fd:5a,bridge_name='br-int',has_traffic_filtering=True,id=4a995fb4-7c9a-443c-a66a-47c04d7862ea,network=Network(cdff297b-c932-49f5-8f91-31b7a475af78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a995fb4-7c') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG os_vif [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:fd:5a,bridge_name='br-int',has_traffic_filtering=True,id=4a995fb4-7c9a-443c-a66a-47c04d7862ea,network=Network(cdff297b-c932-49f5-8f91-31b7a475af78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a995fb4-7c') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a995fb4-7c, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4a995fb4-7c, col_values=(('external_ids', {'iface-id': '4a995fb4-7c9a-443c-a66a-47c04d7862ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:fd:5a', 'vm-uuid': '81cb942b-5bd6-47c4-8130-f5a4d17f10fa'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:03 user nova-compute[71321]: INFO os_vif [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:fd:5a,bridge_name='br-int',has_traffic_filtering=True,id=4a995fb4-7c9a-443c-a66a-47c04d7862ea,network=Network(cdff297b-c932-49f5-8f91-31b7a475af78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a995fb4-7c')
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:33:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-256759259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-256759259',id=19,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxNMexTFhDz2xFUAc4wGA58bVNqR+Fa59qGoEiKr99V0q4IOgnoQTzSr7XTI3nk5SwdCrf8QdfX2WZWlW4pIaFx6quZwUHVtAENs6MteuKUONpmPxi7z1AGiMPLRGF49A==',key_name='tempest-keypair-2067665587',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f89f1f2dba8e4325b550ad91403e60ad',ramdisk_id='',reservation_id='r-mobcfx4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-602948185',owner_user_name='tempest-TaggedBootDevicesTest_v242-602948185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:33:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e17bc9d4cf743c19f9493d30b62fc16',uuid=81cb942b-5bd6-47c4-8130-f5a4d17f10fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "501229b8-6d04-45a8-97df-927b8ec14ca3", "address": "fa:16:3e:b5:8f:dc", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap501229b8-6d", "ovs_interfaceid": "501229b8-6d04-45a8-97df-927b8ec14ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converting VIF {"id": "501229b8-6d04-45a8-97df-927b8ec14ca3", "address": "fa:16:3e:b5:8f:dc", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap501229b8-6d", "ovs_interfaceid": "501229b8-6d04-45a8-97df-927b8ec14ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:8f:dc,bridge_name='br-int',has_traffic_filtering=True,id=501229b8-6d04-45a8-97df-927b8ec14ca3,network=Network(cdff297b-c932-49f5-8f91-31b7a475af78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap501229b8-6d') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG os_vif [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:8f:dc,bridge_name='br-int',has_traffic_filtering=True,id=501229b8-6d04-45a8-97df-927b8ec14ca3,network=Network(cdff297b-c932-49f5-8f91-31b7a475af78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap501229b8-6d') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap501229b8-6d, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap501229b8-6d, col_values=(('external_ids', {'iface-id': '501229b8-6d04-45a8-97df-927b8ec14ca3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:8f:dc', 'vm-uuid': '81cb942b-5bd6-47c4-8130-f5a4d17f10fa'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:03 user nova-compute[71321]: INFO os_vif [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:8f:dc,bridge_name='br-int',has_traffic_filtering=True,id=501229b8-6d04-45a8-97df-927b8ec14ca3,network=Network(cdff297b-c932-49f5-8f91-31b7a475af78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap501229b8-6d')
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:33:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-256759259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-256759259',id=19,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxNMexTFhDz2xFUAc4wGA58bVNqR+Fa59qGoEiKr99V0q4IOgnoQTzSr7XTI3nk5SwdCrf8QdfX2WZWlW4pIaFx6quZwUHVtAENs6MteuKUONpmPxi7z1AGiMPLRGF49A==',key_name='tempest-keypair-2067665587',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f89f1f2dba8e4325b550ad91403e60ad',ramdisk_id='',reservation_id='r-mobcfx4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-602948185',owner_user_name='tempest-TaggedBootDevicesTest_v242-602948185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:33:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e17bc9d4cf743c19f9493d30b62fc16',uuid=81cb942b-5bd6-47c4-8130-f5a4d17f10fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e59fa8d8-7765-453d-a135-0abe5f1cae78", "address": "fa:16:3e:6c:6f:97", "network": {"id": "d2127306-286f-42cb-9dcf-1b4c2e4a9861", "bridge": "br-int", "label": "tempest-device-tagging-net2-1354193313", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape59fa8d8-77", "ovs_interfaceid": "e59fa8d8-7765-453d-a135-0abe5f1cae78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converting VIF {"id": "e59fa8d8-7765-453d-a135-0abe5f1cae78", "address": "fa:16:3e:6c:6f:97", "network": {"id": "d2127306-286f-42cb-9dcf-1b4c2e4a9861", "bridge": "br-int", "label": "tempest-device-tagging-net2-1354193313", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape59fa8d8-77", "ovs_interfaceid": "e59fa8d8-7765-453d-a135-0abe5f1cae78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:6f:97,bridge_name='br-int',has_traffic_filtering=True,id=e59fa8d8-7765-453d-a135-0abe5f1cae78,network=Network(d2127306-286f-42cb-9dcf-1b4c2e4a9861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape59fa8d8-77') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG os_vif [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:6f:97,bridge_name='br-int',has_traffic_filtering=True,id=e59fa8d8-7765-453d-a135-0abe5f1cae78,network=Network(d2127306-286f-42cb-9dcf-1b4c2e4a9861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape59fa8d8-77') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape59fa8d8-77, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape59fa8d8-77, col_values=(('external_ids', {'iface-id': 'e59fa8d8-7765-453d-a135-0abe5f1cae78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:6f:97', 'vm-uuid': '81cb942b-5bd6-47c4-8130-f5a4d17f10fa'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:03 user nova-compute[71321]: INFO os_vif [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:6f:97,bridge_name='br-int',has_traffic_filtering=True,id=e59fa8d8-7765-453d-a135-0abe5f1cae78,network=Network(d2127306-286f-42cb-9dcf-1b4c2e4a9861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape59fa8d8-77')
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:33:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-256759259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-256759259',id=19,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxNMexTFhDz2xFUAc4wGA58bVNqR+Fa59qGoEiKr99V0q4IOgnoQTzSr7XTI3nk5SwdCrf8QdfX2WZWlW4pIaFx6quZwUHVtAENs6MteuKUONpmPxi7z1AGiMPLRGF49A==',key_name='tempest-keypair-2067665587',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f89f1f2dba8e4325b550ad91403e60ad',ramdisk_id='',reservation_id='r-mobcfx4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-602948185',owner_user_name='tempest-TaggedBootDevicesTest_v242-602948185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:33:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e17bc9d4cf743c19f9493d30b62fc16',uuid=81cb942b-5bd6-47c4-8130-f5a4d17f10fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bad3a184-db6f-4d2d-ac53-f1155fcf0fe1", "address": "fa:16:3e:e0:e2:20", "network": {"id": "d2127306-286f-42cb-9dcf-1b4c2e4a9861", "bridge": "br-int", "label": "tempest-device-tagging-net2-1354193313", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad3a184-db", "ovs_interfaceid": "bad3a184-db6f-4d2d-ac53-f1155fcf0fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converting VIF {"id": "bad3a184-db6f-4d2d-ac53-f1155fcf0fe1", "address": "fa:16:3e:e0:e2:20", "network": {"id": "d2127306-286f-42cb-9dcf-1b4c2e4a9861", "bridge": "br-int", "label": "tempest-device-tagging-net2-1354193313", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad3a184-db", "ovs_interfaceid": "bad3a184-db6f-4d2d-ac53-f1155fcf0fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e2:20,bridge_name='br-int',has_traffic_filtering=True,id=bad3a184-db6f-4d2d-ac53-f1155fcf0fe1,network=Network(d2127306-286f-42cb-9dcf-1b4c2e4a9861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad3a184-db') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG os_vif [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e2:20,bridge_name='br-int',has_traffic_filtering=True,id=bad3a184-db6f-4d2d-ac53-f1155fcf0fe1,network=Network(d2127306-286f-42cb-9dcf-1b4c2e4a9861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad3a184-db') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbad3a184-db, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbad3a184-db, col_values=(('external_ids', {'iface-id': 'bad3a184-db6f-4d2d-ac53-f1155fcf0fe1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:e2:20', 'vm-uuid': '81cb942b-5bd6-47c4-8130-f5a4d17f10fa'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:03 user nova-compute[71321]: INFO os_vif [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e2:20,bridge_name='br-int',has_traffic_filtering=True,id=bad3a184-db6f-4d2d-ac53-f1155fcf0fe1,network=Network(d2127306-286f-42cb-9dcf-1b4c2e4a9861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad3a184-db')
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] No BDM found with device name hda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] No VIF found with MAC fa:16:3e:08:8e:12, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:34:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] No VIF found with MAC fa:16:3e:b5:8f:dc, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:34:03 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Using config drive
Apr 12 12:34:03 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Creating config drive at /opt/stack/data/nova/instances/81cb942b-5bd6-47c4-8130-f5a4d17f10fa/disk.config
Apr 12 12:34:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/81cb942b-5bd6-47c4-8130-f5a4d17f10fa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpofptuuxz {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/81cb942b-5bd6-47c4-8130-f5a4d17f10fa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpofptuuxz" returned: 0 in 0.066s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:05 user nova-compute[71321]: DEBUG nova.compute.manager [req-9d8ed324-c832-4df2-b649-1935c09b0827 req-c7975494-6169-4415-ac0d-e3351534d950 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-plugged-94f43c42-9d4d-4625-b558-4be918b78ffb {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:34:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9d8ed324-c832-4df2-b649-1935c09b0827 req-c7975494-6169-4415-ac0d-e3351534d950 service nova] Acquiring lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9d8ed324-c832-4df2-b649-1935c09b0827 req-c7975494-6169-4415-ac0d-e3351534d950 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9d8ed324-c832-4df2-b649-1935c09b0827 req-c7975494-6169-4415-ac0d-e3351534d950 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:05 user nova-compute[71321]: DEBUG nova.compute.manager [req-9d8ed324-c832-4df2-b649-1935c09b0827 req-c7975494-6169-4415-ac0d-e3351534d950 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] No waiting events found dispatching network-vif-plugged-94f43c42-9d4d-4625-b558-4be918b78ffb {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:34:05 user nova-compute[71321]: WARNING nova.compute.manager [req-9d8ed324-c832-4df2-b649-1935c09b0827 req-c7975494-6169-4415-ac0d-e3351534d950 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received unexpected event network-vif-plugged-94f43c42-9d4d-4625-b558-4be918b78ffb for instance with vm_state building and task_state spawning.
Apr 12 12:34:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG nova.compute.manager [req-5c517197-8147-44d3-8980-df53cfc92e49 req-606a7a4f-961b-46d7-ba73-bd352c64a662 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-plugged-501229b8-6d04-45a8-97df-927b8ec14ca3 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-5c517197-8147-44d3-8980-df53cfc92e49 req-606a7a4f-961b-46d7-ba73-bd352c64a662 service nova] Acquiring lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-5c517197-8147-44d3-8980-df53cfc92e49 req-606a7a4f-961b-46d7-ba73-bd352c64a662 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-5c517197-8147-44d3-8980-df53cfc92e49 req-606a7a4f-961b-46d7-ba73-bd352c64a662 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG nova.compute.manager [req-5c517197-8147-44d3-8980-df53cfc92e49 req-606a7a4f-961b-46d7-ba73-bd352c64a662 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] No waiting events found dispatching network-vif-plugged-501229b8-6d04-45a8-97df-927b8ec14ca3 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:34:07 user nova-compute[71321]: WARNING nova.compute.manager [req-5c517197-8147-44d3-8980-df53cfc92e49 req-606a7a4f-961b-46d7-ba73-bd352c64a662 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received unexpected event network-vif-plugged-501229b8-6d04-45a8-97df-927b8ec14ca3 for instance with vm_state building and task_state spawning.
Apr 12 12:34:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG nova.compute.manager [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-plugged-94f43c42-9d4d-4625-b558-4be918b78ffb {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Acquiring lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG nova.compute.manager [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] No waiting events found dispatching network-vif-plugged-94f43c42-9d4d-4625-b558-4be918b78ffb {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:34:07 user nova-compute[71321]: WARNING nova.compute.manager [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received unexpected event network-vif-plugged-94f43c42-9d4d-4625-b558-4be918b78ffb for instance with vm_state building and task_state spawning.
Apr 12 12:34:07 user nova-compute[71321]: DEBUG nova.compute.manager [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-plugged-76450ca6-4f7a-4e03-9269-feaacfced76a {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Acquiring lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG nova.compute.manager [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] No waiting events found dispatching network-vif-plugged-76450ca6-4f7a-4e03-9269-feaacfced76a {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:34:07 user nova-compute[71321]: WARNING nova.compute.manager [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received unexpected event network-vif-plugged-76450ca6-4f7a-4e03-9269-feaacfced76a for instance with vm_state building and task_state spawning.
Apr 12 12:34:07 user nova-compute[71321]: DEBUG nova.compute.manager [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-plugged-76450ca6-4f7a-4e03-9269-feaacfced76a {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Acquiring lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG nova.compute.manager [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] No waiting events found dispatching network-vif-plugged-76450ca6-4f7a-4e03-9269-feaacfced76a {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:34:07 user nova-compute[71321]: WARNING nova.compute.manager [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received unexpected event network-vif-plugged-76450ca6-4f7a-4e03-9269-feaacfced76a for instance with vm_state building and task_state spawning.
Apr 12 12:34:07 user nova-compute[71321]: DEBUG nova.compute.manager [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-plugged-5dfbb175-cb83-461e-91da-d7cbde98c3e6 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Acquiring lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG nova.compute.manager [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] No waiting events found dispatching network-vif-plugged-5dfbb175-cb83-461e-91da-d7cbde98c3e6 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:34:07 user nova-compute[71321]: WARNING nova.compute.manager [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received unexpected event network-vif-plugged-5dfbb175-cb83-461e-91da-d7cbde98c3e6 for instance with vm_state building and task_state spawning.
Apr 12 12:34:07 user nova-compute[71321]: DEBUG nova.compute.manager [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-plugged-5dfbb175-cb83-461e-91da-d7cbde98c3e6 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Acquiring lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG nova.compute.manager [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] No waiting events found dispatching network-vif-plugged-5dfbb175-cb83-461e-91da-d7cbde98c3e6 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:34:07 user nova-compute[71321]: WARNING nova.compute.manager [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received unexpected event network-vif-plugged-5dfbb175-cb83-461e-91da-d7cbde98c3e6 for instance with vm_state building and task_state spawning.
Apr 12 12:34:07 user nova-compute[71321]: DEBUG nova.compute.manager [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-plugged-4a995fb4-7c9a-443c-a66a-47c04d7862ea {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Acquiring lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG nova.compute.manager [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] No waiting events found dispatching network-vif-plugged-4a995fb4-7c9a-443c-a66a-47c04d7862ea {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:34:07 user nova-compute[71321]: WARNING nova.compute.manager [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received unexpected event network-vif-plugged-4a995fb4-7c9a-443c-a66a-47c04d7862ea for instance with vm_state building and task_state spawning.
Apr 12 12:34:07 user nova-compute[71321]: DEBUG nova.compute.manager [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-plugged-4a995fb4-7c9a-443c-a66a-47c04d7862ea {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Acquiring lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG nova.compute.manager [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] No waiting events found dispatching network-vif-plugged-4a995fb4-7c9a-443c-a66a-47c04d7862ea {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:34:07 user nova-compute[71321]: WARNING nova.compute.manager [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received unexpected event network-vif-plugged-4a995fb4-7c9a-443c-a66a-47c04d7862ea for instance with vm_state building and task_state spawning.
Apr 12 12:34:07 user nova-compute[71321]: DEBUG nova.compute.manager [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-plugged-bad3a184-db6f-4d2d-ac53-f1155fcf0fe1 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Acquiring lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG nova.compute.manager [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] No waiting events found dispatching network-vif-plugged-bad3a184-db6f-4d2d-ac53-f1155fcf0fe1 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:34:07 user nova-compute[71321]: WARNING nova.compute.manager [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received unexpected event network-vif-plugged-bad3a184-db6f-4d2d-ac53-f1155fcf0fe1 for instance with vm_state building and task_state spawning.
Apr 12 12:34:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:34:08 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Creating image(s)
Apr 12 12:34:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Did not create local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Ensure instance console log exists: /opt/stack/data/nova/instances/239b22bb-d381-4bd3-9b73-642f174d7664/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Start _get_guest_xml network_info=[{"id": "593b7bab-955d-417a-88c5-6016acf5efe6", "address": "fa:16:3e:38:0a:d9", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593b7bab-95", "ovs_interfaceid": "593b7bab-955d-417a-88c5-6016acf5efe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-12T12:33:54Z,direct_url=<?>,disk_format='qcow2',id=5bf323e0-2e87-46b7-99e8-e588b4d03a87,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-286937470',owner='5ada441da2124adda751365952320e81',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-12T12:33:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'fe17e0da-fe9f-4cb3-b60a-3a6b0bfa28bf', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WfqtkwTJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '239b22bb-d381-4bd3-9b73-642f174d7664', 'attached_at': '', 'detached_at': '', 'volume_id': '3dd6fd89-7d2a-450d-8c3e-b643393e19e0', 'serial': '3dd6fd89-7d2a-450d-8c3e-b643393e19e0'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:34:08 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:34:08 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:34:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-12T12:33:54Z,direct_url=<?>,disk_format='qcow2',id=5bf323e0-2e87-46b7-99e8-e588b4d03a87,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-286937470',owner='5ada441da2124adda751365952320e81',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-12T12:33:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WfqtkwTJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:34:08 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:34:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:34:08 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:34:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:34:08 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb57c6bf-4740-4ec7-a7e7-1d9b41c80834]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:34:08 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[689bf60c-ea0c-474c-80bf-989cdd334569]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0] added
Apr 12 12:34:08 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d7ecd6-4b78-43d8-8042-7eab7bf7068d]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b87359-54e7-4ea7-b958-819f09154f08]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WfqtkwTJ {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WfqtkwTJ" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[11231683-a9bf-4c42-ac3f-0e2e886b0b4b]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WfqtkwTJ'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[599d89fd-afab-48ff-ad4d-dbebf8f05817]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff94e19b-0b9f-4eb8-ace3-4b6441dbf2e6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:34:08 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:34:08 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:34:08 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:34:08 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:34:08 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:34:08 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:34:08 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:34:08 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:34:08 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:34:08 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:34:08 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:34:08 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71321) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[31207c6d-2843-4e2a-82cc-4dfbaf493d7e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0, portal: 172.16.0.220,3260]
Apr 12 12:34:08 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0, portal: 172.16.0.220,3260] successful.
Apr 12 12:34:08 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f3d495-52b4-4d60-841b-dbc0247db848]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[425cf105-2d13-4204-9d6e-619882719660]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:34:08 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:34:08 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:34:08 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:34:08 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:34:08 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:34:08 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:34:08 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:34:08 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:34:08 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:34:08 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:34:08 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:34:08 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:34:08 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:34:08 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] HCTL ('39', '-', '-', 0) found on session 22 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed7ed86-8293-4dfd-b10e-ebcd12af47b9]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Searching for a device in session 22 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WfqtkwTJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.compute.manager [req-a36c70fe-abc4-42c7-a20f-19b8c666f459 req-dbac4b21-54e5-4909-b00b-6aae380023d0 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-plugged-501229b8-6d04-45a8-97df-927b8ec14ca3 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a36c70fe-abc4-42c7-a20f-19b8c666f459 req-dbac4b21-54e5-4909-b00b-6aae380023d0 service nova] Acquiring lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a36c70fe-abc4-42c7-a20f-19b8c666f459 req-dbac4b21-54e5-4909-b00b-6aae380023d0 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a36c70fe-abc4-42c7-a20f-19b8c666f459 req-dbac4b21-54e5-4909-b00b-6aae380023d0 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.compute.manager [req-a36c70fe-abc4-42c7-a20f-19b8c666f459 req-dbac4b21-54e5-4909-b00b-6aae380023d0 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] No waiting events found dispatching network-vif-plugged-501229b8-6d04-45a8-97df-927b8ec14ca3 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:34:09 user nova-compute[71321]: WARNING nova.compute.manager [req-a36c70fe-abc4-42c7-a20f-19b8c666f459 req-dbac4b21-54e5-4909-b00b-6aae380023d0 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received unexpected event network-vif-plugged-501229b8-6d04-45a8-97df-927b8ec14ca3 for instance with vm_state building and task_state spawning.
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.compute.manager [req-a36c70fe-abc4-42c7-a20f-19b8c666f459 req-dbac4b21-54e5-4909-b00b-6aae380023d0 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-plugged-e59fa8d8-7765-453d-a135-0abe5f1cae78 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a36c70fe-abc4-42c7-a20f-19b8c666f459 req-dbac4b21-54e5-4909-b00b-6aae380023d0 service nova] Acquiring lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a36c70fe-abc4-42c7-a20f-19b8c666f459 req-dbac4b21-54e5-4909-b00b-6aae380023d0 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a36c70fe-abc4-42c7-a20f-19b8c666f459 req-dbac4b21-54e5-4909-b00b-6aae380023d0 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.compute.manager [req-a36c70fe-abc4-42c7-a20f-19b8c666f459 req-dbac4b21-54e5-4909-b00b-6aae380023d0 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] No waiting events found dispatching network-vif-plugged-e59fa8d8-7765-453d-a135-0abe5f1cae78 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:34:09 user nova-compute[71321]: WARNING nova.compute.manager [req-a36c70fe-abc4-42c7-a20f-19b8c666f459 req-dbac4b21-54e5-4909-b00b-6aae380023d0 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received unexpected event network-vif-plugged-e59fa8d8-7765-453d-a135-0abe5f1cae78 for instance with vm_state building and task_state spawning.
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.compute.manager [req-a36c70fe-abc4-42c7-a20f-19b8c666f459 req-dbac4b21-54e5-4909-b00b-6aae380023d0 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-plugged-e59fa8d8-7765-453d-a135-0abe5f1cae78 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a36c70fe-abc4-42c7-a20f-19b8c666f459 req-dbac4b21-54e5-4909-b00b-6aae380023d0 service nova] Acquiring lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a36c70fe-abc4-42c7-a20f-19b8c666f459 req-dbac4b21-54e5-4909-b00b-6aae380023d0 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a36c70fe-abc4-42c7-a20f-19b8c666f459 req-dbac4b21-54e5-4909-b00b-6aae380023d0 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.compute.manager [req-a36c70fe-abc4-42c7-a20f-19b8c666f459 req-dbac4b21-54e5-4909-b00b-6aae380023d0 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] No waiting events found dispatching network-vif-plugged-e59fa8d8-7765-453d-a135-0abe5f1cae78 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:34:09 user nova-compute[71321]: WARNING nova.compute.manager [req-a36c70fe-abc4-42c7-a20f-19b8c666f459 req-dbac4b21-54e5-4909-b00b-6aae380023d0 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received unexpected event network-vif-plugged-e59fa8d8-7765-453d-a135-0abe5f1cae78 for instance with vm_state building and task_state spawning.
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302849.5691042, 81cb942b-5bd6-47c4-8130-f5a4d17f10fa => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:34:09 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] VM Resumed (Lifecycle Event)
Apr 12 12:34:09 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23361316566346261', 'path': '/dev/sdh'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361316566346261', 'path': '/dev/sdh'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.compute.manager [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:34:09 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Instance spawned successfully.
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:33:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-17042605',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-17042605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-17042605',id=20,image_ref='5bf323e0-2e87-46b7-99e8-e588b4d03a87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ada441da2124adda751365952320e81',ramdisk_id='',reservation_id='r-xamkmvqc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-310589135',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-310589135-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-310589135',owner_user_name='tempest-TestVolumeBootPattern-310589135-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:33:57Z,user_data=None,user_id='076e65b43f664765ad1d48be6e814f40',uuid=239b22bb-d381-4bd3-9b73-642f174d7664,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "593b7bab-955d-417a-88c5-6016acf5efe6", "address": "fa:16:3e:38:0a:d9", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593b7bab-95", "ovs_interfaceid": "593b7bab-955d-417a-88c5-6016acf5efe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converting VIF {"id": "593b7bab-955d-417a-88c5-6016acf5efe6", "address": "fa:16:3e:38:0a:d9", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593b7bab-95", "ovs_interfaceid": "593b7bab-955d-417a-88c5-6016acf5efe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:0a:d9,bridge_name='br-int',has_traffic_filtering=True,id=593b7bab-955d-417a-88c5-6016acf5efe6,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap593b7bab-95') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.objects.instance [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lazy-loading 'pci_devices' on Instance uuid 239b22bb-d381-4bd3-9b73-642f174d7664 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:34:09 user nova-compute[71321]:   <uuid>239b22bb-d381-4bd3-9b73-642f174d7664</uuid>
Apr 12 12:34:09 user nova-compute[71321]:   <name>instance-00000014</name>
Apr 12 12:34:09 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:34:09 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:34:09 user nova-compute[71321]:   <metadata>
Apr 12 12:34:09 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:34:09 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:34:09 user nova-compute[71321]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-17042605</nova:name>
Apr 12 12:34:09 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:34:08</nova:creationTime>
Apr 12 12:34:09 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:34:09 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:34:09 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:34:09 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:34:09 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:34:09 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:34:09 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:34:09 user nova-compute[71321]:       <nova:owner>
Apr 12 12:34:09 user nova-compute[71321]:         <nova:user uuid="076e65b43f664765ad1d48be6e814f40">tempest-TestVolumeBootPattern-310589135-project-member</nova:user>
Apr 12 12:34:09 user nova-compute[71321]:         <nova:project uuid="5ada441da2124adda751365952320e81">tempest-TestVolumeBootPattern-310589135</nova:project>
Apr 12 12:34:09 user nova-compute[71321]:       </nova:owner>
Apr 12 12:34:09 user nova-compute[71321]:       <nova:root type="image" uuid="5bf323e0-2e87-46b7-99e8-e588b4d03a87"/>
Apr 12 12:34:09 user nova-compute[71321]:       <nova:ports>
Apr 12 12:34:09 user nova-compute[71321]:         <nova:port uuid="593b7bab-955d-417a-88c5-6016acf5efe6">
Apr 12 12:34:09 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 12:34:09 user nova-compute[71321]:         </nova:port>
Apr 12 12:34:09 user nova-compute[71321]:       </nova:ports>
Apr 12 12:34:09 user nova-compute[71321]:     </nova:instance>
Apr 12 12:34:09 user nova-compute[71321]:   </metadata>
Apr 12 12:34:09 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:34:09 user nova-compute[71321]:     <system>
Apr 12 12:34:09 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:34:09 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:34:09 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:34:09 user nova-compute[71321]:       <entry name="serial">239b22bb-d381-4bd3-9b73-642f174d7664</entry>
Apr 12 12:34:09 user nova-compute[71321]:       <entry name="uuid">239b22bb-d381-4bd3-9b73-642f174d7664</entry>
Apr 12 12:34:09 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:34:09 user nova-compute[71321]:     </system>
Apr 12 12:34:09 user nova-compute[71321]:   </sysinfo>
Apr 12 12:34:09 user nova-compute[71321]:   <os>
Apr 12 12:34:09 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:34:09 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:34:09 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:34:09 user nova-compute[71321]:   </os>
Apr 12 12:34:09 user nova-compute[71321]:   <features>
Apr 12 12:34:09 user nova-compute[71321]:     <acpi/>
Apr 12 12:34:09 user nova-compute[71321]:     <apic/>
Apr 12 12:34:09 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:34:09 user nova-compute[71321]:   </features>
Apr 12 12:34:09 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:34:09 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:34:09 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:34:09 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:34:09 user nova-compute[71321]:   </clock>
Apr 12 12:34:09 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:34:09 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:34:09 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:34:09 user nova-compute[71321]:   </cpu>
Apr 12 12:34:09 user nova-compute[71321]:   <devices>
Apr 12 12:34:09 user nova-compute[71321]:     <disk type="block" device="disk">
Apr 12 12:34:09 user nova-compute[71321]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:34:09 user nova-compute[71321]:       <source dev="/dev/sdh"/>
Apr 12 12:34:09 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:34:09 user nova-compute[71321]:       <serial>3dd6fd89-7d2a-450d-8c3e-b643393e19e0</serial>
Apr 12 12:34:09 user nova-compute[71321]:     </disk>
Apr 12 12:34:09 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:34:09 user nova-compute[71321]:       <mac address="fa:16:3e:38:0a:d9"/>
Apr 12 12:34:09 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:34:09 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:34:09 user nova-compute[71321]:       <target dev="tap593b7bab-95"/>
Apr 12 12:34:09 user nova-compute[71321]:     </interface>
Apr 12 12:34:09 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:34:09 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/239b22bb-d381-4bd3-9b73-642f174d7664/console.log" append="off"/>
Apr 12 12:34:09 user nova-compute[71321]:     </serial>
Apr 12 12:34:09 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:34:09 user nova-compute[71321]:     <video>
Apr 12 12:34:09 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:34:09 user nova-compute[71321]:     </video>
Apr 12 12:34:09 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:34:09 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:34:09 user nova-compute[71321]:     </rng>
Apr 12 12:34:09 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:34:09 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:34:09 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:34:09 user nova-compute[71321]:     </memballoon>
Apr 12 12:34:09 user nova-compute[71321]:   </devices>
Apr 12 12:34:09 user nova-compute[71321]: </domain>
Apr 12 12:34:09 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:33:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-17042605',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-17042605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-17042605',id=20,image_ref='5bf323e0-2e87-46b7-99e8-e588b4d03a87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ada441da2124adda751365952320e81',ramdisk_id='',reservation_id='r-xamkmvqc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-310589135',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-310589135-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-310589135',owner_user_name='tempest-TestVolumeBootPattern-310589135-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:33:57Z,user_data=None,user_id='076e65b43f664765ad1d48be6e814f40',uuid=239b22bb-d381-4bd3-9b73-642f174d7664,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "593b7bab-955d-417a-88c5-6016acf5efe6", "address": "fa:16:3e:38:0a:d9", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593b7bab-95", "ovs_interfaceid": "593b7bab-955d-417a-88c5-6016acf5efe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converting VIF {"id": "593b7bab-955d-417a-88c5-6016acf5efe6", "address": "fa:16:3e:38:0a:d9", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593b7bab-95", "ovs_interfaceid": "593b7bab-955d-417a-88c5-6016acf5efe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:0a:d9,bridge_name='br-int',has_traffic_filtering=True,id=593b7bab-955d-417a-88c5-6016acf5efe6,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap593b7bab-95') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG os_vif [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:0a:d9,bridge_name='br-int',has_traffic_filtering=True,id=593b7bab-955d-417a-88c5-6016acf5efe6,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap593b7bab-95') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:34:09 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302849.5704002, 81cb942b-5bd6-47c4-8130-f5a4d17f10fa => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:34:09 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] VM Started (Lifecycle Event)
Apr 12 12:34:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap593b7bab-95, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap593b7bab-95, col_values=(('external_ids', {'iface-id': '593b7bab-955d-417a-88c5-6016acf5efe6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:0a:d9', 'vm-uuid': '239b22bb-d381-4bd3-9b73-642f174d7664'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:34:09 user nova-compute[71321]: INFO os_vif [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:0a:d9,bridge_name='br-int',has_traffic_filtering=True,id=593b7bab-955d-417a-88c5-6016acf5efe6,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap593b7bab-95')
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:34:09 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] No VIF found with MAC fa:16:3e:38:0a:d9, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:34:09 user nova-compute[71321]: INFO nova.compute.manager [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Took 10.67 seconds to spawn the instance on the hypervisor.
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.compute.manager [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:09 user nova-compute[71321]: INFO nova.compute.manager [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Took 25.53 seconds to build instance.
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.compute.manager [req-67fd7646-d4ae-4c45-bdd7-6106d02ddd0b req-8b14fa59-c284-4cdb-b6aa-cdb0d3a13963 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-plugged-bad3a184-db6f-4d2d-ac53-f1155fcf0fe1 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-67fd7646-d4ae-4c45-bdd7-6106d02ddd0b req-8b14fa59-c284-4cdb-b6aa-cdb0d3a13963 service nova] Acquiring lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-67fd7646-d4ae-4c45-bdd7-6106d02ddd0b req-8b14fa59-c284-4cdb-b6aa-cdb0d3a13963 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-67fd7646-d4ae-4c45-bdd7-6106d02ddd0b req-8b14fa59-c284-4cdb-b6aa-cdb0d3a13963 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:09 user nova-compute[71321]: DEBUG nova.compute.manager [req-67fd7646-d4ae-4c45-bdd7-6106d02ddd0b req-8b14fa59-c284-4cdb-b6aa-cdb0d3a13963 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] No waiting events found dispatching network-vif-plugged-bad3a184-db6f-4d2d-ac53-f1155fcf0fe1 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:34:09 user nova-compute[71321]: WARNING nova.compute.manager [req-67fd7646-d4ae-4c45-bdd7-6106d02ddd0b req-8b14fa59-c284-4cdb-b6aa-cdb0d3a13963 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received unexpected event network-vif-plugged-bad3a184-db6f-4d2d-ac53-f1155fcf0fe1 for instance with vm_state active and task_state None.
Apr 12 12:34:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.627s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:11 user nova-compute[71321]: DEBUG nova.compute.manager [req-4cb32a2a-d153-4f51-b3ad-cc033fc747d2 req-f2ccd392-8fa8-4b3f-9041-3f0ed87925cc service nova] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Received event network-vif-plugged-593b7bab-955d-417a-88c5-6016acf5efe6 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:34:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4cb32a2a-d153-4f51-b3ad-cc033fc747d2 req-f2ccd392-8fa8-4b3f-9041-3f0ed87925cc service nova] Acquiring lock "239b22bb-d381-4bd3-9b73-642f174d7664-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4cb32a2a-d153-4f51-b3ad-cc033fc747d2 req-f2ccd392-8fa8-4b3f-9041-3f0ed87925cc service nova] Lock "239b22bb-d381-4bd3-9b73-642f174d7664-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4cb32a2a-d153-4f51-b3ad-cc033fc747d2 req-f2ccd392-8fa8-4b3f-9041-3f0ed87925cc service nova] Lock "239b22bb-d381-4bd3-9b73-642f174d7664-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:11 user nova-compute[71321]: DEBUG nova.compute.manager [req-4cb32a2a-d153-4f51-b3ad-cc033fc747d2 req-f2ccd392-8fa8-4b3f-9041-3f0ed87925cc service nova] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] No waiting events found dispatching network-vif-plugged-593b7bab-955d-417a-88c5-6016acf5efe6 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:34:11 user nova-compute[71321]: WARNING nova.compute.manager [req-4cb32a2a-d153-4f51-b3ad-cc033fc747d2 req-f2ccd392-8fa8-4b3f-9041-3f0ed87925cc service nova] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Received unexpected event network-vif-plugged-593b7bab-955d-417a-88c5-6016acf5efe6 for instance with vm_state building and task_state spawning.
Apr 12 12:34:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "c5b9b1bb-a3d9-4073-8d49-70360dae6f29" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "c5b9b1bb-a3d9-4073-8d49-70360dae6f29" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:11 user nova-compute[71321]: DEBUG nova.objects.instance [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lazy-loading 'flavor' on Instance uuid c5b9b1bb-a3d9-4073-8d49-70360dae6f29 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:34:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "c5b9b1bb-a3d9-4073-8d49-70360dae6f29" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:11 user nova-compute[71321]: DEBUG nova.compute.manager [req-2d3de974-2a24-4c97-b270-2fd4c28cb771 req-3ef66b1e-7b2f-4f31-ba3f-07147a9c9a67 service nova] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Received event network-changed-33441356-cd95-4247-86bb-3f49f00d8e81 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:34:11 user nova-compute[71321]: DEBUG nova.compute.manager [req-2d3de974-2a24-4c97-b270-2fd4c28cb771 req-3ef66b1e-7b2f-4f31-ba3f-07147a9c9a67 service nova] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Refreshing instance network info cache due to event network-changed-33441356-cd95-4247-86bb-3f49f00d8e81. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:34:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2d3de974-2a24-4c97-b270-2fd4c28cb771 req-3ef66b1e-7b2f-4f31-ba3f-07147a9c9a67 service nova] Acquiring lock "refresh_cache-c5b9b1bb-a3d9-4073-8d49-70360dae6f29" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:34:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2d3de974-2a24-4c97-b270-2fd4c28cb771 req-3ef66b1e-7b2f-4f31-ba3f-07147a9c9a67 service nova] Acquired lock "refresh_cache-c5b9b1bb-a3d9-4073-8d49-70360dae6f29" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:34:11 user nova-compute[71321]: DEBUG nova.network.neutron [req-2d3de974-2a24-4c97-b270-2fd4c28cb771 req-3ef66b1e-7b2f-4f31-ba3f-07147a9c9a67 service nova] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Refreshing network info cache for port 33441356-cd95-4247-86bb-3f49f00d8e81 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:34:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "c5b9b1bb-a3d9-4073-8d49-70360dae6f29" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "c5b9b1bb-a3d9-4073-8d49-70360dae6f29" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:12 user nova-compute[71321]: INFO nova.compute.manager [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Attaching volume 5afd002d-aa40-4787-a5c9-1abf9c0aac40 to /dev/vdb
Apr 12 12:34:12 user nova-compute[71321]: DEBUG os_brick.utils [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:34:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:12 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f03c00-3984-4588-acfb-b4deb37861c3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:12 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b876dfc-c3bb-4847-b697-82f332979514]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:12 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcda39f6-71b1-497d-b95a-dbb3f34b79ea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:12 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ece016-81a7-479e-b25f-68c46b2fc71e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:34:12 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:34:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:34:12 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:34:12 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b025dcd8-5267-4720-9faf-02cbe4f7100c]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:12 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:34:12 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:34:12 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:34:12 user nova-compute[71321]: DEBUG os_brick.utils [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:34:12 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Updating existing volume attachment record: 787ae2cf-acb8-4e84-9548-98bf0dc9da3c {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:34:12 user nova-compute[71321]: DEBUG nova.network.neutron [req-2d3de974-2a24-4c97-b270-2fd4c28cb771 req-3ef66b1e-7b2f-4f31-ba3f-07147a9c9a67 service nova] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Updated VIF entry in instance network info cache for port 33441356-cd95-4247-86bb-3f49f00d8e81. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:34:12 user nova-compute[71321]: DEBUG nova.network.neutron [req-2d3de974-2a24-4c97-b270-2fd4c28cb771 req-3ef66b1e-7b2f-4f31-ba3f-07147a9c9a67 service nova] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Updating instance_info_cache with network_info: [{"id": "33441356-cd95-4247-86bb-3f49f00d8e81", "address": "fa:16:3e:9a:89:f9", "network": {"id": "6e43ca53-1563-43b0-84cc-d3f759c61c37", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-908305790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d607e0aed1f47129540181261c6ebc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33441356-cd", "ovs_interfaceid": "33441356-cd95-4247-86bb-3f49f00d8e81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:34:12 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:34:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2d3de974-2a24-4c97-b270-2fd4c28cb771 req-3ef66b1e-7b2f-4f31-ba3f-07147a9c9a67 service nova] Releasing lock "refresh_cache-c5b9b1bb-a3d9-4073-8d49-70360dae6f29" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:34:13 user nova-compute[71321]: DEBUG nova.compute.manager [req-05baada1-3ef7-4fa5-949c-d7c9b6625c0b req-f97f485a-08f2-4766-8824-1954e4eefe75 service nova] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Received event network-vif-plugged-593b7bab-955d-417a-88c5-6016acf5efe6 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:34:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-05baada1-3ef7-4fa5-949c-d7c9b6625c0b req-f97f485a-08f2-4766-8824-1954e4eefe75 service nova] Acquiring lock "239b22bb-d381-4bd3-9b73-642f174d7664-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-05baada1-3ef7-4fa5-949c-d7c9b6625c0b req-f97f485a-08f2-4766-8824-1954e4eefe75 service nova] Lock "239b22bb-d381-4bd3-9b73-642f174d7664-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-05baada1-3ef7-4fa5-949c-d7c9b6625c0b req-f97f485a-08f2-4766-8824-1954e4eefe75 service nova] Lock "239b22bb-d381-4bd3-9b73-642f174d7664-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:13 user nova-compute[71321]: DEBUG nova.compute.manager [req-05baada1-3ef7-4fa5-949c-d7c9b6625c0b req-f97f485a-08f2-4766-8824-1954e4eefe75 service nova] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] No waiting events found dispatching network-vif-plugged-593b7bab-955d-417a-88c5-6016acf5efe6 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:34:13 user nova-compute[71321]: WARNING nova.compute.manager [req-05baada1-3ef7-4fa5-949c-d7c9b6625c0b req-f97f485a-08f2-4766-8824-1954e4eefe75 service nova] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Received unexpected event network-vif-plugged-593b7bab-955d-417a-88c5-6016acf5efe6 for instance with vm_state building and task_state spawning.
Apr 12 12:34:13 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:34:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:34:13 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302853.3801658, 239b22bb-d381-4bd3-9b73-642f174d7664 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:34:13 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] VM Resumed (Lifecycle Event)
Apr 12 12:34:13 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Instance spawned successfully.
Apr 12 12:34:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:34:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:34:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:34:13 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:34:13 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:34:13 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:34:13 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302853.3846636, 239b22bb-d381-4bd3-9b73-642f174d7664 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:34:13 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] VM Started (Lifecycle Event)
Apr 12 12:34:13 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:34:13 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:34:13 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:34:13 user nova-compute[71321]: INFO nova.compute.manager [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Took 5.36 seconds to spawn the instance on the hypervisor.
Apr 12 12:34:13 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:34:13 user nova-compute[71321]: INFO nova.compute.manager [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Took 16.88 seconds to build instance.
Apr 12 12:34:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "239b22bb-d381-4bd3-9b73-642f174d7664" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.979s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:15 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:34:15 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:34:15 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Rebuilding the list of instances to heal {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 12:34:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-10116da0-785c-41cf-96bb-95721af863db" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:34:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-10116da0-785c-41cf-96bb-95721af863db" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:34:15 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 12:34:15 user nova-compute[71321]: DEBUG nova.objects.instance [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lazy-loading 'info_cache' on Instance uuid 10116da0-785c-41cf-96bb-95721af863db {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:34:16 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] Updating instance_info_cache with network_info: [{"id": "cbb69638-6a5f-4d12-8737-45850145fa0e", "address": "fa:16:3e:57:7c:99", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb69638-6a", "ovs_interfaceid": "cbb69638-6a5f-4d12-8737-45850145fa0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:34:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-10116da0-785c-41cf-96bb-95721af863db" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:34:16 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 12:34:16 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:34:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:16 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:34:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b597d03-8252-4e26-a5a9-651117bf78d1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b597d03-8252-4e26-a5a9-651117bf78d1/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b597d03-8252-4e26-a5a9-651117bf78d1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b597d03-8252-4e26-a5a9-651117bf78d1/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vdKpNxTc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:34:17 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:34:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:34:17 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:34:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:34:17 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c026cfc1-1f71-4c8b-b320-fd0fc618ca73]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:34:17 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9edae2c-1045-4eaa-a3b7-ede915bd84f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40] added
Apr 12 12:34:17 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12710e0-a223-4a62-925e-f61278ee9a40]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f960795-7cad-4859-a8b4-4308ad0b381f]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vdKpNxTc {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vdKpNxTc" returned: 0 in 0.030s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[705544f9-c145-4af7-983a-a106a998db69]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vdKpNxTc'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c0ebc9-1b60-4e72-bb80-389a03f18391]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[806d7c2b-9f40-4838-a63d-a959b27b2d4a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:34:17 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:34:17 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:34:17 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:34:17 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:34:17 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:34:17 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:34:17 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:34:17 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:34:17 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:34:17 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:34:17 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:34:17 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:34:17 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:34:17 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8bf31d-8d69-4b56-8278-37486a797cc8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40, portal: 172.16.0.220,3260]
Apr 12 12:34:17 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40, portal: 172.16.0.220,3260] successful.
Apr 12 12:34:17 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5dc56f1-819d-43a1-9ed7-b72822365d3b]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26fb85d-7f74-407c-85c9-f533f25806b2]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:34:17 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:34:17 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:34:17 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:34:17 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:34:17 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:34:17 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:34:17 user nova-compute[71321]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40 (non-flash)
Apr 12 12:34:17 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:34:17 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:34:17 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:34:17 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:34:17 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:34:17 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:34:17 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:34:17 user nova-compute[71321]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40 (non-flash)
Apr 12 12:34:17 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.394s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] HCTL ('40', '-', '-', 0) found on session 23 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c39f99-62b4-4893-98fd-3489d3a94a23]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Searching for a device in session 23 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vdKpNxTc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG nova.objects.instance [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lazy-loading 'flavor' on Instance uuid d584edf2-12e3-48d1-947f-fdfb0c9c7377 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:18 user nova-compute[71321]: INFO nova.compute.manager [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Attaching volume 6b088551-bc20-40c9-92ea-610d0fa94bae to /dev/vdb
Apr 12 12:34:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG os_brick.utils [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[62de4e06-96ee-4780-9cdc-a04dd83f3bd9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97c8ca5-b6ac-48b2-8674-6c68a2f2877b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.438s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] <== connect_volume: return (1441ms) {'type': 'block', 'scsi_wwn': '23034313861656435', 'path': '/dev/sdi'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034313861656435', 'path': '/dev/sdi'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG nova.objects.instance [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lazy-loading 'flavor' on Instance uuid c5b9b1bb-a3d9-4073-8d49-70360dae6f29 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[024a3b05-b2ab-49d6-be2f-f960dafca139]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b924565-ca04-4065-9553-4bc05a930076]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 12:34:18 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:34:18 user nova-compute[71321]:   <source dev="/dev/sdi"/>
Apr 12 12:34:18 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:34:18 user nova-compute[71321]:   <serial>5afd002d-aa40-4787-a5c9-1abf9c0aac40</serial>
Apr 12 12:34:18 user nova-compute[71321]: </disk>
Apr 12 12:34:18 user nova-compute[71321]:  {{(pid=71321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:34:18 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:34:18 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e146569f-5aa0-47be-8308-887a33f82ef2]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG os_brick.utils [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Updating existing volume attachment record: 5f80b660-7395-4b0c-aed2-4d85039d8f83 {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:34:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:19 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:34:19 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:34:19 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] No VIF found with MAC fa:16:3e:9a:89:f9, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:34:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "c5b9b1bb-a3d9-4073-8d49-70360dae6f29" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.481s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:19 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:34:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:19 user nova-compute[71321]: INFO nova.compute.manager [None req-ad136e8e-e29e-4d55-bb97-7f28ddafca08 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Unrescuing
Apr 12 12:34:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ad136e8e-e29e-4d55-bb97-7f28ddafca08 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "refresh_cache-839e85a2-f7af-482d-a5e6-09195888300e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:34:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ad136e8e-e29e-4d55-bb97-7f28ddafca08 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquired lock "refresh_cache-839e85a2-f7af-482d-a5e6-09195888300e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:34:19 user nova-compute[71321]: DEBUG nova.network.neutron [None req-ad136e8e-e29e-4d55-bb97-7f28ddafca08 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:34:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:34:20 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:34:20 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:34:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=7251MB free_disk=26.40381622314453GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:34:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "c5b9b1bb-a3d9-4073-8d49-70360dae6f29" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "c5b9b1bb-a3d9-4073-8d49-70360dae6f29" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:20 user nova-compute[71321]: INFO nova.compute.manager [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Detaching volume 5afd002d-aa40-4787-a5c9-1abf9c0aac40
Apr 12 12:34:20 user nova-compute[71321]: INFO nova.virt.block_device [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Attempting to driver detach volume 5afd002d-aa40-4787-a5c9-1abf9c0aac40 from mountpoint /dev/vdb
Apr 12 12:34:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Attempting to detach device vdb from instance c5b9b1bb-a3d9-4073-8d49-70360dae6f29 from the persistent domain config. {{(pid=71321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 12:34:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:34:20 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:34:20 user nova-compute[71321]:   <source dev="/dev/sdi"/>
Apr 12 12:34:20 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:34:20 user nova-compute[71321]:   <serial>5afd002d-aa40-4787-a5c9-1abf9c0aac40</serial>
Apr 12 12:34:20 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 12:34:20 user nova-compute[71321]: </disk>
Apr 12 12:34:20 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:34:20 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Successfully detached device vdb from instance c5b9b1bb-a3d9-4073-8d49-70360dae6f29 from the persistent domain config.
Apr 12 12:34:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c5b9b1bb-a3d9-4073-8d49-70360dae6f29 from the live domain config. {{(pid=71321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 12:34:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:34:20 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:34:20 user nova-compute[71321]:   <source dev="/dev/sdi"/>
Apr 12 12:34:20 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:34:20 user nova-compute[71321]:   <serial>5afd002d-aa40-4787-a5c9-1abf9c0aac40</serial>
Apr 12 12:34:20 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 12:34:20 user nova-compute[71321]: </disk>
Apr 12 12:34:20 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:34:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 10116da0-785c-41cf-96bb-95721af863db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:34:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance a4107f2d-88e4-4846-9ece-cb16ad7ecd02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:34:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:34:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 839e85a2-f7af-482d-a5e6-09195888300e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:34:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:34:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance cda12475-d730-4c07-af54-a3a64482fc94 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:34:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance c5b9b1bb-a3d9-4073-8d49-70360dae6f29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:34:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 9439468d-7a45-443b-87ce-106907761a56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:34:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 4b597d03-8252-4e26-a5a9-651117bf78d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:34:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 8403a098-a141-4feb-9eed-3731e2c7c152 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:34:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:34:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 239b22bb-d381-4bd3-9b73-642f174d7664 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:34:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:34:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG nova.compute.manager [req-2b34eb81-3eec-4e37-b671-3e2b100c63d5 req-9c4dc83e-3ba9-4ff1-bb06-84bca561f37f service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Received event network-changed-b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG nova.compute.manager [req-2b34eb81-3eec-4e37-b671-3e2b100c63d5 req-9c4dc83e-3ba9-4ff1-bb06-84bca561f37f service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Refreshing instance network info cache due to event network-changed-b5f18af0-544d-4978-b20e-85da7e880834. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2b34eb81-3eec-4e37-b671-3e2b100c63d5 req-9c4dc83e-3ba9-4ff1-bb06-84bca561f37f service nova] Acquiring lock "refresh_cache-839e85a2-f7af-482d-a5e6-09195888300e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG nova.network.neutron [None req-ad136e8e-e29e-4d55-bb97-7f28ddafca08 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Updating instance_info_cache with network_info: [{"id": "b5f18af0-544d-4978-b20e-85da7e880834", "address": "fa:16:3e:f7:93:c8", "network": {"id": "b6e89fad-c9f7-473e-ab76-3f005281cc95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-175129642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1faa529d424800900e10a7ceaa63d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f18af0-54", "ovs_interfaceid": "b5f18af0-544d-4978-b20e-85da7e880834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ad136e8e-e29e-4d55-bb97-7f28ddafca08 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Releasing lock "refresh_cache-839e85a2-f7af-482d-a5e6-09195888300e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG nova.objects.instance [None req-ad136e8e-e29e-4d55-bb97-7f28ddafca08 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lazy-loading 'flavor' on Instance uuid 839e85a2-f7af-482d-a5e6-09195888300e {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2b34eb81-3eec-4e37-b671-3e2b100c63d5 req-9c4dc83e-3ba9-4ff1-bb06-84bca561f37f service nova] Acquired lock "refresh_cache-839e85a2-f7af-482d-a5e6-09195888300e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG nova.network.neutron [req-2b34eb81-3eec-4e37-b671-3e2b100c63d5 req-9c4dc83e-3ba9-4ff1-bb06-84bca561f37f service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Refreshing network info cache for port b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Received event <DeviceRemovedEvent: 1681302861.356509, c5b9b1bb-a3d9-4073-8d49-70360dae6f29 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c5b9b1bb-a3d9-4073-8d49-70360dae6f29 {{(pid=71321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 12:34:21 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Successfully detached device vdb from instance c5b9b1bb-a3d9-4073-8d49-70360dae6f29 from the live domain config.
Apr 12 12:34:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vdKpNxTc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:34:21 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:34:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[099f595a-8779-4038-a11a-d42f7452bd3b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:34:21 user nova-compute[71321]: No targets found.
Apr 12 12:34:21 user nova-compute[71321]: iSNS:
Apr 12 12:34:21 user nova-compute[71321]: No targets found.
Apr 12 12:34:21 user nova-compute[71321]: STATIC:
Apr 12 12:34:21 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d
Apr 12 12:34:21 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:21 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:21 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0
Apr 12 12:34:21 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:21 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:21 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54
Apr 12 12:34:21 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:21 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:21 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936
Apr 12 12:34:21 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:21 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:21 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40
Apr 12 12:34:21 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:21 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:21 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f
Apr 12 12:34:21 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:21 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:21 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f
Apr 12 12:34:21 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:21 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:21 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8
Apr 12 12:34:21 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:21 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:21 user nova-compute[71321]: FIRMWARE:
Apr 12 12:34:21 user nova-compute[71321]: No targets found.
Apr 12 12:34:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:34:21 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:34:21 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.033s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[723de910-8169-4b00-a938-1724dd299a5b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.707s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Cleaning up deleted instances {{(pid=71321) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.054s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a65faf-0f9e-4cf8-9dbd-ac4beccaf66e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:34:21 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:34:21 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:34:21 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:34:21 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:34:21 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:34:21 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:34:21 user nova-compute[71321]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40 (non-flash)
Apr 12 12:34:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:34:21 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:34:21 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:34:21 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:34:21 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:34:21 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:34:21 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:34:21 user nova-compute[71321]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40 (non-flash)
Apr 12 12:34:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef44689ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40'): ({'sdi'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Removing single pathed devices sdi {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] There are 0 instances to clean {{(pid=71321) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b510b19-5254-445d-b820-94d5b338227c]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.027s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[50269976-708e-4810-8c71-608a92898376]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Flushing IO for device /dev/sdi {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16cfe52-68c3-42fc-9135-7eab4fb8a0e3]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.070s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b06537-073d-481b-9a22-f99af65b91d3]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] SCSI volumes sdi have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9735bf-d1c1-4761-b94b-1bf26915cbba]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc161d00-0a0c-45af-8eae-44ca9cadbefb]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40, portal: 172.16.0.220,3260]
Apr 12 12:34:21 user nova-compute[71321]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40, portal: 172.16.0.220,3260] successful.
Apr 12 12:34:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG nova.network.neutron [req-2b34eb81-3eec-4e37-b671-3e2b100c63d5 req-9c4dc83e-3ba9-4ff1-bb06-84bca561f37f service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Updated VIF entry in instance network info cache for port b5f18af0-544d-4978-b20e-85da7e880834. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG nova.network.neutron [req-2b34eb81-3eec-4e37-b671-3e2b100c63d5 req-9c4dc83e-3ba9-4ff1-bb06-84bca561f37f service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Updating instance_info_cache with network_info: [{"id": "b5f18af0-544d-4978-b20e-85da7e880834", "address": "fa:16:3e:f7:93:c8", "network": {"id": "b6e89fad-c9f7-473e-ab76-3f005281cc95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-175129642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1faa529d424800900e10a7ceaa63d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f18af0-54", "ovs_interfaceid": "b5f18af0-544d-4978-b20e-85da7e880834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5afd002d-aa40-4787-a5c9-1abf9c0aac40 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb40061e-e987-4041-b098-faf3ad6520ea]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.486s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] <== disconnect_volume: return (488ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:34:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2b34eb81-3eec-4e37-b671-3e2b100c63d5 req-9c4dc83e-3ba9-4ff1-bb06-84bca561f37f service nova] Releasing lock "refresh_cache-839e85a2-f7af-482d-a5e6-09195888300e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:34:22 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Instance destroyed successfully.
Apr 12 12:34:22 user nova-compute[71321]: DEBUG nova.objects.instance [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lazy-loading 'flavor' on Instance uuid c5b9b1bb-a3d9-4073-8d49-70360dae6f29 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:34:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "c5b9b1bb-a3d9-4073-8d49-70360dae6f29" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.022s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:22 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:34:22 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:34:22 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:34:22 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:34:22 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:34:22 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:34:22 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:34:22 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:34:23 user nova-compute[71321]: DEBUG nova.compute.manager [req-859f01fd-e198-4623-b53b-2ce27f78532e req-77e91627-c66f-4991-93b2-23a573270724 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Received event network-changed-b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:34:23 user nova-compute[71321]: DEBUG nova.compute.manager [req-859f01fd-e198-4623-b53b-2ce27f78532e req-77e91627-c66f-4991-93b2-23a573270724 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Refreshing instance network info cache due to event network-changed-b5f18af0-544d-4978-b20e-85da7e880834. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:34:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-859f01fd-e198-4623-b53b-2ce27f78532e req-77e91627-c66f-4991-93b2-23a573270724 service nova] Acquiring lock "refresh_cache-839e85a2-f7af-482d-a5e6-09195888300e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:34:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-859f01fd-e198-4623-b53b-2ce27f78532e req-77e91627-c66f-4991-93b2-23a573270724 service nova] Acquired lock "refresh_cache-839e85a2-f7af-482d-a5e6-09195888300e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:34:23 user nova-compute[71321]: DEBUG nova.network.neutron [req-859f01fd-e198-4623-b53b-2ce27f78532e req-77e91627-c66f-4991-93b2-23a573270724 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Refreshing network info cache for port b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:34:23 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:23 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:23 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:23 user nova-compute[71321]: DEBUG nova.network.neutron [req-859f01fd-e198-4623-b53b-2ce27f78532e req-77e91627-c66f-4991-93b2-23a573270724 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Updated VIF entry in instance network info cache for port b5f18af0-544d-4978-b20e-85da7e880834. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:34:23 user nova-compute[71321]: DEBUG nova.network.neutron [req-859f01fd-e198-4623-b53b-2ce27f78532e req-77e91627-c66f-4991-93b2-23a573270724 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Updating instance_info_cache with network_info: [{"id": "b5f18af0-544d-4978-b20e-85da7e880834", "address": "fa:16:3e:f7:93:c8", "network": {"id": "b6e89fad-c9f7-473e-ab76-3f005281cc95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-175129642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1faa529d424800900e10a7ceaa63d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f18af0-54", "ovs_interfaceid": "b5f18af0-544d-4978-b20e-85da7e880834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:34:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-859f01fd-e198-4623-b53b-2ce27f78532e req-77e91627-c66f-4991-93b2-23a573270724 service nova] Releasing lock "refresh_cache-839e85a2-f7af-482d-a5e6-09195888300e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:34:23 user nova-compute[71321]: DEBUG nova.compute.manager [req-859f01fd-e198-4623-b53b-2ce27f78532e req-77e91627-c66f-4991-93b2-23a573270724 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Received event network-vif-unplugged-b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:34:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-859f01fd-e198-4623-b53b-2ce27f78532e req-77e91627-c66f-4991-93b2-23a573270724 service nova] Acquiring lock "839e85a2-f7af-482d-a5e6-09195888300e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-859f01fd-e198-4623-b53b-2ce27f78532e req-77e91627-c66f-4991-93b2-23a573270724 service nova] Lock "839e85a2-f7af-482d-a5e6-09195888300e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-859f01fd-e198-4623-b53b-2ce27f78532e req-77e91627-c66f-4991-93b2-23a573270724 service nova] Lock "839e85a2-f7af-482d-a5e6-09195888300e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:23 user nova-compute[71321]: DEBUG nova.compute.manager [req-859f01fd-e198-4623-b53b-2ce27f78532e req-77e91627-c66f-4991-93b2-23a573270724 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] No waiting events found dispatching network-vif-unplugged-b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:34:23 user nova-compute[71321]: WARNING nova.compute.manager [req-859f01fd-e198-4623-b53b-2ce27f78532e req-77e91627-c66f-4991-93b2-23a573270724 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Received unexpected event network-vif-unplugged-b5f18af0-544d-4978-b20e-85da7e880834 for instance with vm_state rescued and task_state unrescuing.
Apr 12 12:34:23 user nova-compute[71321]: DEBUG nova.compute.manager [req-859f01fd-e198-4623-b53b-2ce27f78532e req-77e91627-c66f-4991-93b2-23a573270724 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Received event network-vif-plugged-b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:34:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-859f01fd-e198-4623-b53b-2ce27f78532e req-77e91627-c66f-4991-93b2-23a573270724 service nova] Acquiring lock "839e85a2-f7af-482d-a5e6-09195888300e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-859f01fd-e198-4623-b53b-2ce27f78532e req-77e91627-c66f-4991-93b2-23a573270724 service nova] Lock "839e85a2-f7af-482d-a5e6-09195888300e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-859f01fd-e198-4623-b53b-2ce27f78532e req-77e91627-c66f-4991-93b2-23a573270724 service nova] Lock "839e85a2-f7af-482d-a5e6-09195888300e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:23 user nova-compute[71321]: DEBUG nova.compute.manager [req-859f01fd-e198-4623-b53b-2ce27f78532e req-77e91627-c66f-4991-93b2-23a573270724 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] No waiting events found dispatching network-vif-plugged-b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:34:23 user nova-compute[71321]: WARNING nova.compute.manager [req-859f01fd-e198-4623-b53b-2ce27f78532e req-77e91627-c66f-4991-93b2-23a573270724 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Received unexpected event network-vif-plugged-b5f18af0-544d-4978-b20e-85da7e880834 for instance with vm_state rescued and task_state unrescuing.
Apr 12 12:34:24 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaxwIhMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:34:24 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:34:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:34:24 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:34:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:34:24 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:34:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a0f5e4-892a-4a98-a3ad-413dca99098d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:34:24 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b910ec-195a-43fa-816e-085387bcb4b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae] added
Apr 12 12:34:24 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0009031-d719-43ea-a391-de19d7b900c8]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0f8d64-9211-47b5-a0e6-7e9fb73a799d]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NaxwIhMq {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NaxwIhMq" returned: 0 in 0.027s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc268917-e940-407a-9f56-1d384a439e02]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NaxwIhMq'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdb91bb-8afa-4e30-b706-49fa54cd2b5d]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7501bfe0-471d-49de-8967-fcba892d68fe]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:34:24 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:34:24 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:34:24 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:34:24 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:34:24 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:34:24 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:34:24 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:34:24 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:34:24 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:34:24 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:34:24 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:34:24 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:34:24 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:34:24 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:24 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:25 user nova-compute[71321]: DEBUG nova.compute.manager [req-c30d4bfe-b0d2-470f-bc6b-4315c55ccd2b req-c71004ae-557c-4b04-a16c-8abda89b88bf service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Received event network-vif-plugged-b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:34:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c30d4bfe-b0d2-470f-bc6b-4315c55ccd2b req-c71004ae-557c-4b04-a16c-8abda89b88bf service nova] Acquiring lock "839e85a2-f7af-482d-a5e6-09195888300e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c30d4bfe-b0d2-470f-bc6b-4315c55ccd2b req-c71004ae-557c-4b04-a16c-8abda89b88bf service nova] Lock "839e85a2-f7af-482d-a5e6-09195888300e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c30d4bfe-b0d2-470f-bc6b-4315c55ccd2b req-c71004ae-557c-4b04-a16c-8abda89b88bf service nova] Lock "839e85a2-f7af-482d-a5e6-09195888300e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:25 user nova-compute[71321]: DEBUG nova.compute.manager [req-c30d4bfe-b0d2-470f-bc6b-4315c55ccd2b req-c71004ae-557c-4b04-a16c-8abda89b88bf service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] No waiting events found dispatching network-vif-plugged-b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:34:25 user nova-compute[71321]: WARNING nova.compute.manager [req-c30d4bfe-b0d2-470f-bc6b-4315c55ccd2b req-c71004ae-557c-4b04-a16c-8abda89b88bf service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Received unexpected event network-vif-plugged-b5f18af0-544d-4978-b20e-85da7e880834 for instance with vm_state rescued and task_state unrescuing.
Apr 12 12:34:25 user nova-compute[71321]: DEBUG nova.compute.manager [req-c30d4bfe-b0d2-470f-bc6b-4315c55ccd2b req-c71004ae-557c-4b04-a16c-8abda89b88bf service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Received event network-vif-plugged-b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:34:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c30d4bfe-b0d2-470f-bc6b-4315c55ccd2b req-c71004ae-557c-4b04-a16c-8abda89b88bf service nova] Acquiring lock "839e85a2-f7af-482d-a5e6-09195888300e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c30d4bfe-b0d2-470f-bc6b-4315c55ccd2b req-c71004ae-557c-4b04-a16c-8abda89b88bf service nova] Lock "839e85a2-f7af-482d-a5e6-09195888300e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c30d4bfe-b0d2-470f-bc6b-4315c55ccd2b req-c71004ae-557c-4b04-a16c-8abda89b88bf service nova] Lock "839e85a2-f7af-482d-a5e6-09195888300e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:25 user nova-compute[71321]: DEBUG nova.compute.manager [req-c30d4bfe-b0d2-470f-bc6b-4315c55ccd2b req-c71004ae-557c-4b04-a16c-8abda89b88bf service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] No waiting events found dispatching network-vif-plugged-b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:34:25 user nova-compute[71321]: WARNING nova.compute.manager [req-c30d4bfe-b0d2-470f-bc6b-4315c55ccd2b req-c71004ae-557c-4b04-a16c-8abda89b88bf service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Received unexpected event network-vif-plugged-b5f18af0-544d-4978-b20e-85da7e880834 for instance with vm_state rescued and task_state unrescuing.
Apr 12 12:34:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae -p 172.16.0.220:3260 --login" returned: 0 in 1.346s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:25 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0710e963-63e6-43d4-8ea9-1225e048780e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae, portal: 172.16.0.220,3260]
Apr 12 12:34:25 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae, portal: 172.16.0.220,3260] successful.
Apr 12 12:34:25 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:25 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[88017edb-9c05-4fee-ab21-6b53793b8f8c]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:25 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7499b4d-ef21-4757-ad81-b49c045fe257]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:34:25 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:34:25 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:34:25 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:34:25 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:34:25 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:34:25 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:34:25 user nova-compute[71321]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae (non-flash)
Apr 12 12:34:25 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:34:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:34:25 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:34:25 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:34:25 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:34:25 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:34:25 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:34:25 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:34:25 user nova-compute[71321]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae (non-flash)
Apr 12 12:34:25 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:34:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.656s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:34:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:34:25 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] HCTL ('40', '-', '-', 0) found on session 24 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:34:25 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:34:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.030s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:25 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a246d256-cb82-4967-ba61-8df1cb735581]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:25 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Searching for a device in session 24 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:34:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaxwIhMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:34:26 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Removed pending event for 839e85a2-f7af-482d-a5e6-09195888300e due to event {{(pid=71321) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 12:34:26 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302866.0663514, 839e85a2-f7af-482d-a5e6-09195888300e => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:34:26 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] VM Resumed (Lifecycle Event)
Apr 12 12:34:26 user nova-compute[71321]: DEBUG nova.compute.manager [None req-ad136e8e-e29e-4d55-bb97-7f28ddafca08 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:34:26 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:34:26 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:34:26 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 12:34:26 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302866.068396, 839e85a2-f7af-482d-a5e6-09195888300e => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:34:26 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] VM Started (Lifecycle Event)
Apr 12 12:34:26 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:34:26 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:34:26 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.717s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:34:26 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] <== connect_volume: return (2719ms) {'type': 'block', 'scsi_wwn': '23637656230393537', 'path': '/dev/sdi'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:34:26 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637656230393537', 'path': '/dev/sdi'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:34:26 user nova-compute[71321]: DEBUG nova.objects.instance [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lazy-loading 'flavor' on Instance uuid d584edf2-12e3-48d1-947f-fdfb0c9c7377 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:34:26 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 12:34:26 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:34:26 user nova-compute[71321]:   <source dev="/dev/sdi"/>
Apr 12 12:34:26 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:34:26 user nova-compute[71321]:   <serial>6b088551-bc20-40c9-92ea-610d0fa94bae</serial>
Apr 12 12:34:26 user nova-compute[71321]: </disk>
Apr 12 12:34:26 user nova-compute[71321]:  {{(pid=71321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 12:34:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:34:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:34:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] No VIF found with MAC fa:16:3e:eb:10:b5, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:34:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.906s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:29 user nova-compute[71321]: INFO nova.compute.manager [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Detaching volume 6b088551-bc20-40c9-92ea-610d0fa94bae
Apr 12 12:34:29 user nova-compute[71321]: INFO nova.virt.block_device [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Attempting to driver detach volume 6b088551-bc20-40c9-92ea-610d0fa94bae from mountpoint /dev/vdb
Apr 12 12:34:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Attempting to detach device vdb from instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 from the persistent domain config. {{(pid=71321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:34:29 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:34:29 user nova-compute[71321]:   <source dev="/dev/sdi"/>
Apr 12 12:34:29 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:34:29 user nova-compute[71321]:   <serial>6b088551-bc20-40c9-92ea-610d0fa94bae</serial>
Apr 12 12:34:29 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 12:34:29 user nova-compute[71321]: </disk>
Apr 12 12:34:29 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:34:29 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Successfully detached device vdb from instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 from the persistent domain config.
Apr 12 12:34:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 from the live domain config. {{(pid=71321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:34:29 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:34:29 user nova-compute[71321]:   <source dev="/dev/sdi"/>
Apr 12 12:34:29 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:34:29 user nova-compute[71321]:   <serial>6b088551-bc20-40c9-92ea-610d0fa94bae</serial>
Apr 12 12:34:29 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 12:34:29 user nova-compute[71321]: </disk>
Apr 12 12:34:29 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Received event <DeviceRemovedEvent: 1681302869.7083693, d584edf2-12e3-48d1-947f-fdfb0c9c7377 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 {{(pid=71321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 12:34:29 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Successfully detached device vdb from instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 from the live domain config.
Apr 12 12:34:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaxwIhMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:34:29 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:34:29 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c08284-eb65-43e2-a318-b305e10c9156]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:34:29 user nova-compute[71321]: No targets found.
Apr 12 12:34:29 user nova-compute[71321]: iSNS:
Apr 12 12:34:29 user nova-compute[71321]: No targets found.
Apr 12 12:34:29 user nova-compute[71321]: STATIC:
Apr 12 12:34:29 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d
Apr 12 12:34:29 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:29 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:29 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0
Apr 12 12:34:29 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:29 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:29 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54
Apr 12 12:34:29 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:29 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:29 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae
Apr 12 12:34:29 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:29 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:29 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936
Apr 12 12:34:29 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:29 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:29 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f
Apr 12 12:34:29 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:29 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:29 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f
Apr 12 12:34:29 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:29 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:29 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8
Apr 12 12:34:29 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:29 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:29 user nova-compute[71321]: FIRMWARE:
Apr 12 12:34:29 user nova-compute[71321]: No targets found.
Apr 12 12:34:29 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:34:29 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:34:29 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b8ca21-3900-418d-a143-e43bc2e79430]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[38caa717-1b20-4be9-8cad-1b30e591d89e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:34:29 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:34:29 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:34:29 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:34:29 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:34:29 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:34:29 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:34:29 user nova-compute[71321]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae (non-flash)
Apr 12 12:34:29 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:34:29 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:34:29 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:34:29 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:34:29 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:34:29 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:34:29 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:34:29 user nova-compute[71321]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae (non-flash)
Apr 12 12:34:29 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef4468b5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae'): ({'sdi'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Removing single pathed devices sdi {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ff34cb-75f0-49d7-a574-7b04287c865f]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c28e26-a57e-4d82-91eb-273afde29aa8]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Flushing IO for device /dev/sdi {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[caab554b-fa41-42aa-aaf4-18b2aab7c9a2]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.042s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a16f4a6-fd17-4127-b3ce-133140ab88a1]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] SCSI volumes sdi have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14b5746-f230-4bbe-a824-476536439c51]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:30 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d9b511-4b5f-45a7-bec7-59b57ceec9c6]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae, portal: 172.16.0.220,3260]
Apr 12 12:34:30 user nova-compute[71321]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae, portal: 172.16.0.220,3260] successful.
Apr 12 12:34:30 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b088551-bc20-40c9-92ea-610d0fa94bae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:30 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0adb861-c67b-4768-a2e8-92699b837026]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:34:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] <== disconnect_volume: return (385ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:34:30 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:34:30 user nova-compute[71321]: DEBUG nova.objects.instance [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lazy-loading 'flavor' on Instance uuid d584edf2-12e3-48d1-947f-fdfb0c9c7377 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:34:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.853s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Triggering sync for uuid 10116da0-785c-41cf-96bb-95721af863db {{(pid=71321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Triggering sync for uuid a4107f2d-88e4-4846-9ece-cb16ad7ecd02 {{(pid=71321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Triggering sync for uuid 546c0c08-35f1-4043-ac30-56d49bc86af1 {{(pid=71321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Triggering sync for uuid 839e85a2-f7af-482d-a5e6-09195888300e {{(pid=71321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Triggering sync for uuid d584edf2-12e3-48d1-947f-fdfb0c9c7377 {{(pid=71321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Triggering sync for uuid cda12475-d730-4c07-af54-a3a64482fc94 {{(pid=71321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Triggering sync for uuid c5b9b1bb-a3d9-4073-8d49-70360dae6f29 {{(pid=71321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Triggering sync for uuid 9439468d-7a45-443b-87ce-106907761a56 {{(pid=71321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Triggering sync for uuid 4b597d03-8252-4e26-a5a9-651117bf78d1 {{(pid=71321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Triggering sync for uuid 8403a098-a141-4feb-9eed-3731e2c7c152 {{(pid=71321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Triggering sync for uuid 81cb942b-5bd6-47c4-8130-f5a4d17f10fa {{(pid=71321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Triggering sync for uuid 239b22bb-d381-4bd3-9b73-642f174d7664 {{(pid=71321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "10116da0-785c-41cf-96bb-95721af863db" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "10116da0-785c-41cf-96bb-95721af863db" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "546c0c08-35f1-4043-ac30-56d49bc86af1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "839e85a2-f7af-482d-a5e6-09195888300e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "839e85a2-f7af-482d-a5e6-09195888300e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "cda12475-d730-4c07-af54-a3a64482fc94" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "cda12475-d730-4c07-af54-a3a64482fc94" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "c5b9b1bb-a3d9-4073-8d49-70360dae6f29" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "c5b9b1bb-a3d9-4073-8d49-70360dae6f29" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "9439468d-7a45-443b-87ce-106907761a56" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "9439468d-7a45-443b-87ce-106907761a56" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "4b597d03-8252-4e26-a5a9-651117bf78d1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "4b597d03-8252-4e26-a5a9-651117bf78d1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "8403a098-a141-4feb-9eed-3731e2c7c152" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "8403a098-a141-4feb-9eed-3731e2c7c152" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "239b22bb-d381-4bd3-9b73-642f174d7664" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "239b22bb-d381-4bd3-9b73-642f174d7664" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:32 user nova-compute[71321]: WARNING oslo_messaging._drivers.amqpdriver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "839e85a2-f7af-482d-a5e6-09195888300e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "10116da0-785c-41cf-96bb-95721af863db" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "c5b9b1bb-a3d9-4073-8d49-70360dae6f29" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "9439468d-7a45-443b-87ce-106907761a56" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "cda12475-d730-4c07-af54-a3a64482fc94" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "8403a098-a141-4feb-9eed-3731e2c7c152" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "239b22bb-d381-4bd3-9b73-642f174d7664" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "4b597d03-8252-4e26-a5a9-651117bf78d1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:34 user nova-compute[71321]: DEBUG nova.compute.manager [req-74db3fba-9d09-42fc-92ed-c81c6cee5579 req-bc8eba87-8dae-4a73-bb2c-5baf35769f00 service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Received event network-changed-67b56c74-fc25-4bc8-875e-8a134830124b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:34:34 user nova-compute[71321]: DEBUG nova.compute.manager [req-74db3fba-9d09-42fc-92ed-c81c6cee5579 req-bc8eba87-8dae-4a73-bb2c-5baf35769f00 service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Refreshing instance network info cache due to event network-changed-67b56c74-fc25-4bc8-875e-8a134830124b. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:34:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-74db3fba-9d09-42fc-92ed-c81c6cee5579 req-bc8eba87-8dae-4a73-bb2c-5baf35769f00 service nova] Acquiring lock "refresh_cache-9439468d-7a45-443b-87ce-106907761a56" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:34:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-74db3fba-9d09-42fc-92ed-c81c6cee5579 req-bc8eba87-8dae-4a73-bb2c-5baf35769f00 service nova] Acquired lock "refresh_cache-9439468d-7a45-443b-87ce-106907761a56" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:34:34 user nova-compute[71321]: DEBUG nova.network.neutron [req-74db3fba-9d09-42fc-92ed-c81c6cee5579 req-bc8eba87-8dae-4a73-bb2c-5baf35769f00 service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Refreshing network info cache for port 67b56c74-fc25-4bc8-875e-8a134830124b {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:34:35 user nova-compute[71321]: DEBUG nova.network.neutron [req-74db3fba-9d09-42fc-92ed-c81c6cee5579 req-bc8eba87-8dae-4a73-bb2c-5baf35769f00 service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Updated VIF entry in instance network info cache for port 67b56c74-fc25-4bc8-875e-8a134830124b. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:34:35 user nova-compute[71321]: DEBUG nova.network.neutron [req-74db3fba-9d09-42fc-92ed-c81c6cee5579 req-bc8eba87-8dae-4a73-bb2c-5baf35769f00 service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Updating instance_info_cache with network_info: [{"id": "67b56c74-fc25-4bc8-875e-8a134830124b", "address": "fa:16:3e:14:ba:2c", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b56c74-fc", "ovs_interfaceid": "67b56c74-fc25-4bc8-875e-8a134830124b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:34:35 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-74db3fba-9d09-42fc-92ed-c81c6cee5579 req-bc8eba87-8dae-4a73-bb2c-5baf35769f00 service nova] Releasing lock "refresh_cache-9439468d-7a45-443b-87ce-106907761a56" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:34:35 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "4b597d03-8252-4e26-a5a9-651117bf78d1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:35 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "4b597d03-8252-4e26-a5a9-651117bf78d1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:35 user nova-compute[71321]: DEBUG nova.objects.instance [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lazy-loading 'flavor' on Instance uuid 4b597d03-8252-4e26-a5a9-651117bf78d1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:34:35 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Ignoring supplied device name: /dev/vdb
Apr 12 12:34:35 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "4b597d03-8252-4e26-a5a9-651117bf78d1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "4b597d03-8252-4e26-a5a9-651117bf78d1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "4b597d03-8252-4e26-a5a9-651117bf78d1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:36 user nova-compute[71321]: INFO nova.compute.manager [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Attaching volume 46234755-00e8-4256-9acd-7daa3980a5f4 to /dev/vdb
Apr 12 12:34:36 user nova-compute[71321]: DEBUG os_brick.utils [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:34:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:36 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e62925a-af11-4d0b-87e5-89aa82073676]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:36 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c825b8f-eef5-4f44-8513-155e5bb76dc2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:36 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[46aa653f-2936-4a3d-b82a-babadb83b1ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:36 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7c9545-020b-4989-a49a-251d87ef9609]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:34:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:34:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:34:36 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:34:36 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a524755-26ad-44f0-a7c0-2a41a4d07c43]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:34:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:34:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:34:36 user nova-compute[71321]: DEBUG os_brick.utils [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:34:36 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Updating existing volume attachment record: 9e4ef09f-035b-49aa-b13e-6f0db95d87a2 {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:34:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "9439468d-7a45-443b-87ce-106907761a56" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "9439468d-7a45-443b-87ce-106907761a56" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:37 user nova-compute[71321]: INFO nova.compute.manager [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Shelving
Apr 12 12:34:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:37 user nova-compute[71321]: DEBUG nova.compute.manager [req-a58ca6c4-94bf-432c-84c5-993451995fee req-ea41313d-b9e9-423d-8a6c-dd6da258923b service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Received event network-vif-unplugged-67b56c74-fc25-4bc8-875e-8a134830124b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:34:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a58ca6c4-94bf-432c-84c5-993451995fee req-ea41313d-b9e9-423d-8a6c-dd6da258923b service nova] Acquiring lock "9439468d-7a45-443b-87ce-106907761a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a58ca6c4-94bf-432c-84c5-993451995fee req-ea41313d-b9e9-423d-8a6c-dd6da258923b service nova] Lock "9439468d-7a45-443b-87ce-106907761a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a58ca6c4-94bf-432c-84c5-993451995fee req-ea41313d-b9e9-423d-8a6c-dd6da258923b service nova] Lock "9439468d-7a45-443b-87ce-106907761a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:37 user nova-compute[71321]: DEBUG nova.compute.manager [req-a58ca6c4-94bf-432c-84c5-993451995fee req-ea41313d-b9e9-423d-8a6c-dd6da258923b service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] No waiting events found dispatching network-vif-unplugged-67b56c74-fc25-4bc8-875e-8a134830124b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:34:37 user nova-compute[71321]: WARNING nova.compute.manager [req-a58ca6c4-94bf-432c-84c5-993451995fee req-ea41313d-b9e9-423d-8a6c-dd6da258923b service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Received unexpected event network-vif-unplugged-67b56c74-fc25-4bc8-875e-8a134830124b for instance with vm_state active and task_state shelving.
Apr 12 12:34:38 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 9439468d-7a45-443b-87ce-106907761a56] Instance destroyed successfully.
Apr 12 12:34:38 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Beginning cold snapshot process
Apr 12 12:34:38 user nova-compute[71321]: DEBUG nova.privsep.utils [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 12:34:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk /opt/stack/data/nova/instances/snapshots/tmpbudmfrhd/0f88a47835d84ef981aa9a3978e131d2 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk /opt/stack/data/nova/instances/snapshots/tmpbudmfrhd/0f88a47835d84ef981aa9a3978e131d2" returned: 0 in 0.546s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:39 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Snapshot extracted, beginning image upload
Apr 12 12:34:39 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:39 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-40ee7c00-7a68-4b5e-a94a-6409c7b0230a req-32bcc0ba-ec07-4949-89c7-9920f1609146 service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Received event network-vif-plugged-67b56c74-fc25-4bc8-875e-8a134830124b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:34:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-40ee7c00-7a68-4b5e-a94a-6409c7b0230a req-32bcc0ba-ec07-4949-89c7-9920f1609146 service nova] Acquiring lock "9439468d-7a45-443b-87ce-106907761a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-40ee7c00-7a68-4b5e-a94a-6409c7b0230a req-32bcc0ba-ec07-4949-89c7-9920f1609146 service nova] Lock "9439468d-7a45-443b-87ce-106907761a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-40ee7c00-7a68-4b5e-a94a-6409c7b0230a req-32bcc0ba-ec07-4949-89c7-9920f1609146 service nova] Lock "9439468d-7a45-443b-87ce-106907761a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-40ee7c00-7a68-4b5e-a94a-6409c7b0230a req-32bcc0ba-ec07-4949-89c7-9920f1609146 service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] No waiting events found dispatching network-vif-plugged-67b56c74-fc25-4bc8-875e-8a134830124b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:34:39 user nova-compute[71321]: WARNING nova.compute.manager [req-40ee7c00-7a68-4b5e-a94a-6409c7b0230a req-32bcc0ba-ec07-4949-89c7-9920f1609146 service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Received unexpected event network-vif-plugged-67b56c74-fc25-4bc8-875e-8a134830124b for instance with vm_state active and task_state shelving_image_uploading.
Apr 12 12:34:40 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:34:40 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bkMnELmD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:34:40 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:34:40 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:34:40 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:34:40 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:34:40 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:34:40 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:34:40 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:34:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:40 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddedcd51-7af3-4775-beb5-e9c6f35d537c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:40 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:34:40 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:40 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[46749829-27d2-40e9-b317-dff627f4090e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:40 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4] added
Apr 12 12:34:40 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:40 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4179083a-732c-4820-aa58-7eb40fe95287]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:40 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.039s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:40 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e224489-12e4-4226-974b-b12cec77878f]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:40 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bkMnELmD {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bkMnELmD" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:40 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd86a4a4-c3b6-43ca-8adb-5ee1b77ef794]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:40 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bkMnELmD'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:40 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e5effa-f1b6-4cc0-a94f-074421352468]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:40 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:41 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d606e0b-ce66-4a58-8de0-520c6ab76606]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:34:41 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:34:41 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:34:41 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:34:41 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:34:41 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:34:41 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:34:41 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:34:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:34:41 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:34:41 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:34:41 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:34:41 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:34:41 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:34:41 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:34:41 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:34:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:41 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f244713-fd52-4a26-a60b-1a010480e4d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4, portal: 172.16.0.220,3260]
Apr 12 12:34:41 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4, portal: 172.16.0.220,3260] successful.
Apr 12 12:34:41 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:41 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb0da70-4e5a-4f82-b83c-c2add60a0dad]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:41 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[261607e7-29cc-46cf-b3ec-898391b271e7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:34:41 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:34:41 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:34:41 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:34:41 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:34:41 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:34:41 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:34:41 user nova-compute[71321]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4 (non-flash)
Apr 12 12:34:41 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:34:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:34:41 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:34:41 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:34:41 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:34:41 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:34:41 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:34:41 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:34:41 user nova-compute[71321]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4 (non-flash)
Apr 12 12:34:41 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:34:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:34:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:34:41 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] HCTL ('40', '-', '-', 0) found on session 25 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:34:41 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:34:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:41 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4e8b47-3934-489f-a7ae-4c9bdfb61760]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:41 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Searching for a device in session 25 and hctl ['40', '*', '*', 0] yield: None {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:34:41 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Snapshot image upload complete
Apr 12 12:34:41 user nova-compute[71321]: DEBUG nova.compute.manager [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:34:41 user nova-compute[71321]: INFO nova.compute.manager [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Shelve offloading
Apr 12 12:34:41 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 9439468d-7a45-443b-87ce-106907761a56] Instance destroyed successfully.
Apr 12 12:34:41 user nova-compute[71321]: DEBUG nova.compute.manager [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:34:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "refresh_cache-9439468d-7a45-443b-87ce-106907761a56" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:34:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquired lock "refresh_cache-9439468d-7a45-443b-87ce-106907761a56" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:34:41 user nova-compute[71321]: DEBUG nova.network.neutron [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:34:42 user nova-compute[71321]: DEBUG nova.network.neutron [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Updating instance_info_cache with network_info: [{"id": "67b56c74-fc25-4bc8-875e-8a134830124b", "address": "fa:16:3e:14:ba:2c", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b56c74-fc", "ovs_interfaceid": "67b56c74-fc25-4bc8-875e-8a134830124b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:34:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Releasing lock "refresh_cache-9439468d-7a45-443b-87ce-106907761a56" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:34:42 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Searching for a device in session 25 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:34:42 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bkMnELmD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:34:42 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:34:42 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '23638663466363362', 'path': '/dev/sdi'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:34:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638663466363362', 'path': '/dev/sdi'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:34:42 user nova-compute[71321]: DEBUG nova.objects.instance [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lazy-loading 'flavor' on Instance uuid 4b597d03-8252-4e26-a5a9-651117bf78d1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:34:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 12:34:42 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:34:42 user nova-compute[71321]:   <source dev="/dev/sdi"/>
Apr 12 12:34:42 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:34:42 user nova-compute[71321]:   <serial>46234755-00e8-4256-9acd-7daa3980a5f4</serial>
Apr 12 12:34:42 user nova-compute[71321]: </disk>
Apr 12 12:34:42 user nova-compute[71321]:  {{(pid=71321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 12:34:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:34:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:34:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] No VIF found with MAC fa:16:3e:ff:04:04, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:34:42 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 9439468d-7a45-443b-87ce-106907761a56] Instance destroyed successfully.
Apr 12 12:34:42 user nova-compute[71321]: DEBUG nova.objects.instance [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lazy-loading 'resources' on Instance uuid 9439468d-7a45-443b-87ce-106907761a56 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:34:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:32:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-806455308',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-806455308',id=16,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1ZrjP9KAJCgyaL5zcIDkfonF0SjjghGFN4rxSk+Gs/fi7zbEzghBorK6ScclR6/kTKn5pVT08v7lhEUGdgEMCcBQsph3fKqP0aQS3e3cPR0dYvUMVDLU1ho++DwuWEcA==',key_name='tempest-keypair-250399543',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:32:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5fec0c6dc7ab46b0b6b0a580252f40e3',ramdisk_id='',reservation_id='r-d9g2es3z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2036744628',owner_user_name='tempest-AttachVolumeShelveTestJSON-2036744628-project-member',shelved_at='2023-04-12T12:34:41.596118',shelved_host='user',shelved_image_id='3b243368-b9ac-481a-9051-c0bd3cadb017'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:34:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e4935eed324b868477f8e88918364a',uuid=9439468d-7a45-443b-87ce-106907761a56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "67b56c74-fc25-4bc8-875e-8a134830124b", "address": "fa:16:3e:14:ba:2c", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b56c74-fc", "ovs_interfaceid": "67b56c74-fc25-4bc8-875e-8a134830124b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:34:42 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Converting VIF {"id": "67b56c74-fc25-4bc8-875e-8a134830124b", "address": "fa:16:3e:14:ba:2c", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b56c74-fc", "ovs_interfaceid": "67b56c74-fc25-4bc8-875e-8a134830124b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:34:42 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:ba:2c,bridge_name='br-int',has_traffic_filtering=True,id=67b56c74-fc25-4bc8-875e-8a134830124b,network=Network(4ba97279-e122-4c2b-b931-dde33e1d71df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b56c74-fc') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:34:42 user nova-compute[71321]: DEBUG os_vif [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:ba:2c,bridge_name='br-int',has_traffic_filtering=True,id=67b56c74-fc25-4bc8-875e-8a134830124b,network=Network(4ba97279-e122-4c2b-b931-dde33e1d71df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b56c74-fc') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:34:42 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:42 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67b56c74-fc, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:34:42 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:42 user nova-compute[71321]: DEBUG nova.compute.manager [req-359aad4f-85ce-40f3-8cfe-c4f19ffc9249 req-4f22755d-ad8c-48d0-a127-addf302d7209 service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Received event network-changed-67b56c74-fc25-4bc8-875e-8a134830124b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:34:42 user nova-compute[71321]: DEBUG nova.compute.manager [req-359aad4f-85ce-40f3-8cfe-c4f19ffc9249 req-4f22755d-ad8c-48d0-a127-addf302d7209 service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Refreshing instance network info cache due to event network-changed-67b56c74-fc25-4bc8-875e-8a134830124b. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:34:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-359aad4f-85ce-40f3-8cfe-c4f19ffc9249 req-4f22755d-ad8c-48d0-a127-addf302d7209 service nova] Acquiring lock "refresh_cache-9439468d-7a45-443b-87ce-106907761a56" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:34:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-359aad4f-85ce-40f3-8cfe-c4f19ffc9249 req-4f22755d-ad8c-48d0-a127-addf302d7209 service nova] Acquired lock "refresh_cache-9439468d-7a45-443b-87ce-106907761a56" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:34:42 user nova-compute[71321]: DEBUG nova.network.neutron [req-359aad4f-85ce-40f3-8cfe-c4f19ffc9249 req-4f22755d-ad8c-48d0-a127-addf302d7209 service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Refreshing network info cache for port 67b56c74-fc25-4bc8-875e-8a134830124b {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:34:42 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:34:42 user nova-compute[71321]: INFO os_vif [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:ba:2c,bridge_name='br-int',has_traffic_filtering=True,id=67b56c74-fc25-4bc8-875e-8a134830124b,network=Network(4ba97279-e122-4c2b-b931-dde33e1d71df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b56c74-fc')
Apr 12 12:34:42 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Deleting instance files /opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56_del
Apr 12 12:34:42 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Deletion of /opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56_del complete
Apr 12 12:34:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "4b597d03-8252-4e26-a5a9-651117bf78d1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.848s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:43 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Deleted allocations for instance 9439468d-7a45-443b-87ce-106907761a56
Apr 12 12:34:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:43 user nova-compute[71321]: DEBUG nova.objects.instance [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lazy-loading 'numa_topology' on Instance uuid 9439468d-7a45-443b-87ce-106907761a56 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:34:43 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Refreshing inventories for resource provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 12:34:43 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Updating ProviderTree inventory for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 12:34:43 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Updating inventory in ProviderTree for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 12:34:43 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Refreshing aggregate associations for resource provider 7ca624fd-d5cc-42af-93e3-9d62256fa231, aggregates: None {{(pid=71321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 12:34:43 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Refreshing trait associations for resource provider 7ca624fd-d5cc-42af-93e3-9d62256fa231, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=71321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 12:34:43 user nova-compute[71321]: DEBUG nova.network.neutron [req-359aad4f-85ce-40f3-8cfe-c4f19ffc9249 req-4f22755d-ad8c-48d0-a127-addf302d7209 service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Updated VIF entry in instance network info cache for port 67b56c74-fc25-4bc8-875e-8a134830124b. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:34:43 user nova-compute[71321]: DEBUG nova.network.neutron [req-359aad4f-85ce-40f3-8cfe-c4f19ffc9249 req-4f22755d-ad8c-48d0-a127-addf302d7209 service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Updating instance_info_cache with network_info: [{"id": "67b56c74-fc25-4bc8-875e-8a134830124b", "address": "fa:16:3e:14:ba:2c", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap67b56c74-fc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:34:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-359aad4f-85ce-40f3-8cfe-c4f19ffc9249 req-4f22755d-ad8c-48d0-a127-addf302d7209 service nova] Releasing lock "refresh_cache-9439468d-7a45-443b-87ce-106907761a56" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:34:43 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:34:43 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:34:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.505s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "9439468d-7a45-443b-87ce-106907761a56" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.208s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:51 user nova-compute[71321]: INFO nova.compute.manager [None req-7354fce0-e94e-4edc-a555-762fabf5512a tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Unrescuing
Apr 12 12:34:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7354fce0-e94e-4edc-a555-762fabf5512a tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "refresh_cache-10116da0-785c-41cf-96bb-95721af863db" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:34:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7354fce0-e94e-4edc-a555-762fabf5512a tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquired lock "refresh_cache-10116da0-785c-41cf-96bb-95721af863db" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:34:51 user nova-compute[71321]: DEBUG nova.network.neutron [None req-7354fce0-e94e-4edc-a555-762fabf5512a tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:34:51 user nova-compute[71321]: DEBUG nova.network.neutron [None req-7354fce0-e94e-4edc-a555-762fabf5512a tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Updating instance_info_cache with network_info: [{"id": "cbb69638-6a5f-4d12-8737-45850145fa0e", "address": "fa:16:3e:57:7c:99", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb69638-6a", "ovs_interfaceid": "cbb69638-6a5f-4d12-8737-45850145fa0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:34:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7354fce0-e94e-4edc-a555-762fabf5512a tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Releasing lock "refresh_cache-10116da0-785c-41cf-96bb-95721af863db" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:34:51 user nova-compute[71321]: DEBUG nova.objects.instance [None req-7354fce0-e94e-4edc-a555-762fabf5512a tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'flavor' on Instance uuid 10116da0-785c-41cf-96bb-95721af863db {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:34:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:52 user nova-compute[71321]: DEBUG nova.compute.manager [req-f834a4f7-4499-48c7-80ab-c2a1db383cd4 req-7e657606-39a1-4dc9-b0ad-bd1b06853966 service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] Received event network-vif-unplugged-cbb69638-6a5f-4d12-8737-45850145fa0e {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:34:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f834a4f7-4499-48c7-80ab-c2a1db383cd4 req-7e657606-39a1-4dc9-b0ad-bd1b06853966 service nova] Acquiring lock "10116da0-785c-41cf-96bb-95721af863db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f834a4f7-4499-48c7-80ab-c2a1db383cd4 req-7e657606-39a1-4dc9-b0ad-bd1b06853966 service nova] Lock "10116da0-785c-41cf-96bb-95721af863db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f834a4f7-4499-48c7-80ab-c2a1db383cd4 req-7e657606-39a1-4dc9-b0ad-bd1b06853966 service nova] Lock "10116da0-785c-41cf-96bb-95721af863db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:52 user nova-compute[71321]: DEBUG nova.compute.manager [req-f834a4f7-4499-48c7-80ab-c2a1db383cd4 req-7e657606-39a1-4dc9-b0ad-bd1b06853966 service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] No waiting events found dispatching network-vif-unplugged-cbb69638-6a5f-4d12-8737-45850145fa0e {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:34:52 user nova-compute[71321]: WARNING nova.compute.manager [req-f834a4f7-4499-48c7-80ab-c2a1db383cd4 req-7e657606-39a1-4dc9-b0ad-bd1b06853966 service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] Received unexpected event network-vif-unplugged-cbb69638-6a5f-4d12-8737-45850145fa0e for instance with vm_state rescued and task_state unrescuing.
Apr 12 12:34:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:52 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 10116da0-785c-41cf-96bb-95721af863db] Instance destroyed successfully.
Apr 12 12:34:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:53 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681302878.2587066, 9439468d-7a45-443b-87ce-106907761a56 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:34:53 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 9439468d-7a45-443b-87ce-106907761a56] VM Stopped (Lifecycle Event)
Apr 12 12:34:53 user nova-compute[71321]: DEBUG nova.compute.manager [None req-8220fc54-c72b-44b1-8331-2e6f5ad19999 None None] [instance: 9439468d-7a45-443b-87ce-106907761a56] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "839e85a2-f7af-482d-a5e6-09195888300e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "839e85a2-f7af-482d-a5e6-09195888300e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:54 user nova-compute[71321]: INFO nova.compute.manager [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Detaching volume e2586924-e0c3-4908-8f2c-7375bf258d7f
Apr 12 12:34:54 user nova-compute[71321]: DEBUG nova.compute.manager [req-1659c23f-0755-4863-a7d0-d6140c0c597c req-fd605534-04a5-4714-99cc-2f6bc44443be service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] Received event network-vif-plugged-cbb69638-6a5f-4d12-8737-45850145fa0e {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-1659c23f-0755-4863-a7d0-d6140c0c597c req-fd605534-04a5-4714-99cc-2f6bc44443be service nova] Acquiring lock "10116da0-785c-41cf-96bb-95721af863db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-1659c23f-0755-4863-a7d0-d6140c0c597c req-fd605534-04a5-4714-99cc-2f6bc44443be service nova] Lock "10116da0-785c-41cf-96bb-95721af863db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-1659c23f-0755-4863-a7d0-d6140c0c597c req-fd605534-04a5-4714-99cc-2f6bc44443be service nova] Lock "10116da0-785c-41cf-96bb-95721af863db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG nova.compute.manager [req-1659c23f-0755-4863-a7d0-d6140c0c597c req-fd605534-04a5-4714-99cc-2f6bc44443be service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] No waiting events found dispatching network-vif-plugged-cbb69638-6a5f-4d12-8737-45850145fa0e {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:34:54 user nova-compute[71321]: WARNING nova.compute.manager [req-1659c23f-0755-4863-a7d0-d6140c0c597c req-fd605534-04a5-4714-99cc-2f6bc44443be service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] Received unexpected event network-vif-plugged-cbb69638-6a5f-4d12-8737-45850145fa0e for instance with vm_state rescued and task_state unrescuing.
Apr 12 12:34:54 user nova-compute[71321]: INFO nova.virt.block_device [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Attempting to driver detach volume e2586924-e0c3-4908-8f2c-7375bf258d7f from mountpoint /dev/vdb
Apr 12 12:34:54 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Attempting to detach device vdb from instance 839e85a2-f7af-482d-a5e6-09195888300e from the persistent domain config. {{(pid=71321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:34:54 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:34:54 user nova-compute[71321]:   <source dev="/dev/sdc"/>
Apr 12 12:34:54 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:34:54 user nova-compute[71321]:   <serial>e2586924-e0c3-4908-8f2c-7375bf258d7f</serial>
Apr 12 12:34:54 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 12:34:54 user nova-compute[71321]: </disk>
Apr 12 12:34:54 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:34:54 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Successfully detached device vdb from instance 839e85a2-f7af-482d-a5e6-09195888300e from the persistent domain config.
Apr 12 12:34:54 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 839e85a2-f7af-482d-a5e6-09195888300e from the live domain config. {{(pid=71321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:34:54 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:34:54 user nova-compute[71321]:   <source dev="/dev/sdc"/>
Apr 12 12:34:54 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:34:54 user nova-compute[71321]:   <serial>e2586924-e0c3-4908-8f2c-7375bf258d7f</serial>
Apr 12 12:34:54 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 12:34:54 user nova-compute[71321]: </disk>
Apr 12 12:34:54 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Received event <DeviceRemovedEvent: 1681302894.8654487, 839e85a2-f7af-482d-a5e6-09195888300e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 839e85a2-f7af-482d-a5e6-09195888300e {{(pid=71321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 12:34:54 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Successfully detached device vdb from instance 839e85a2-f7af-482d-a5e6-09195888300e from the live domain config.
Apr 12 12:34:54 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQumsNbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:34:54 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:34:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "4b597d03-8252-4e26-a5a9-651117bf78d1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "4b597d03-8252-4e26-a5a9-651117bf78d1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:54 user nova-compute[71321]: INFO nova.compute.manager [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Detaching volume 46234755-00e8-4256-9acd-7daa3980a5f4
Apr 12 12:34:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de280fb-3231-4812-ba71-bd478f9580cd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:34:54 user nova-compute[71321]: No targets found.
Apr 12 12:34:54 user nova-compute[71321]: iSNS:
Apr 12 12:34:54 user nova-compute[71321]: No targets found.
Apr 12 12:34:54 user nova-compute[71321]: STATIC:
Apr 12 12:34:54 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d
Apr 12 12:34:54 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:54 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:54 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0
Apr 12 12:34:54 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:54 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:54 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54
Apr 12 12:34:54 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:54 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:54 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936
Apr 12 12:34:54 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:54 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:54 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4
Apr 12 12:34:54 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:54 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:54 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f
Apr 12 12:34:54 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:54 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:54 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f
Apr 12 12:34:54 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:54 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:54 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8
Apr 12 12:34:54 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:54 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:54 user nova-compute[71321]: FIRMWARE:
Apr 12 12:34:54 user nova-compute[71321]: No targets found.
Apr 12 12:34:54 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:34:54 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:34:54 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6712f8b5-c461-4598-948f-10ca717df60c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:54 user nova-compute[71321]: INFO nova.virt.block_device [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Attempting to driver detach volume 46234755-00e8-4256-9acd-7daa3980a5f4 from mountpoint /dev/vdb
Apr 12 12:34:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[278dfc31-484a-42ab-8d46-a22727b6315b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:34:54 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:34:54 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:34:54 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:34:54 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:34:54 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:34:54 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:34:54 user nova-compute[71321]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4 (non-flash)
Apr 12 12:34:54 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:34:54 user nova-compute[71321]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f (non-flash)
Apr 12 12:34:54 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:34:54 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:34:54 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:34:54 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:34:54 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:34:54 user nova-compute[71321]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4 (non-flash)
Apr 12 12:34:54 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef8a00b640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f'): ({'sdc'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Removing single pathed devices sdc {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:34:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Attempting to detach device vdb from instance 4b597d03-8252-4e26-a5a9-651117bf78d1 from the persistent domain config. {{(pid=71321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:34:55 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:34:55 user nova-compute[71321]:   <source dev="/dev/sdi"/>
Apr 12 12:34:55 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:34:55 user nova-compute[71321]:   <serial>46234755-00e8-4256-9acd-7daa3980a5f4</serial>
Apr 12 12:34:55 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 12:34:55 user nova-compute[71321]: </disk>
Apr 12 12:34:55 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5c4a91-cd86-42fc-a72d-6c26d403cd4d]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:55 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Successfully detached device vdb from instance 4b597d03-8252-4e26-a5a9-651117bf78d1 from the persistent domain config.
Apr 12 12:34:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4b597d03-8252-4e26-a5a9-651117bf78d1 from the live domain config. {{(pid=71321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:34:55 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:34:55 user nova-compute[71321]:   <source dev="/dev/sdi"/>
Apr 12 12:34:55 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:34:55 user nova-compute[71321]:   <serial>46234755-00e8-4256-9acd-7daa3980a5f4</serial>
Apr 12 12:34:55 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 12:34:55 user nova-compute[71321]: </disk>
Apr 12 12:34:55 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "4b597d03-8252-4e26-a5a9-651117bf78d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb233c6-89b2-4c4e-85a3-9ef7a0c02a32]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Flushing IO for device /dev/sdc {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a09afe5-c39d-45f1-99db-9bc7be7856d8]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3130a426-6777-4f29-8de9-caadaff89d73]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] SCSI volumes sdc have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3742215-1324-4468-b221-b514041def74]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c21230-854d-491e-b9ad-88eb6e007dfd]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f, portal: 172.16.0.220,3260]
Apr 12 12:34:55 user nova-compute[71321]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f, portal: 172.16.0.220,3260] successful.
Apr 12 12:34:55 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2586924-e0c3-4908-8f2c-7375bf258d7f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ac32e1-a1ee-471a-b2d7-dd97e055dd2e]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] <== disconnect_volume: return (399ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Received event <DeviceRemovedEvent: 1681302895.5131037, 4b597d03-8252-4e26-a5a9-651117bf78d1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4b597d03-8252-4e26-a5a9-651117bf78d1 {{(pid=71321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 12:34:55 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Successfully detached device vdb from instance 4b597d03-8252-4e26-a5a9-651117bf78d1 from the live domain config.
Apr 12 12:34:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bkMnELmD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:34:55 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:34:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e42bcb-ca17-4cb4-9e06-6158c8ce9b29]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:34:55 user nova-compute[71321]: No targets found.
Apr 12 12:34:55 user nova-compute[71321]: iSNS:
Apr 12 12:34:55 user nova-compute[71321]: No targets found.
Apr 12 12:34:55 user nova-compute[71321]: STATIC:
Apr 12 12:34:55 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d
Apr 12 12:34:55 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:55 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:55 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0
Apr 12 12:34:55 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:55 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:55 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54
Apr 12 12:34:55 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:55 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:55 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936
Apr 12 12:34:55 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:55 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:55 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4
Apr 12 12:34:55 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:55 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:55 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f
Apr 12 12:34:55 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:55 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:55 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8
Apr 12 12:34:55 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:55 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:55 user nova-compute[71321]: FIRMWARE:
Apr 12 12:34:55 user nova-compute[71321]: No targets found.
Apr 12 12:34:55 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:34:55 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:34:55 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ed4775-739a-4971-a832-3ffa099c58e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3000ad6-2992-4279-a5bd-5d755bd0ae36]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:34:55 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:34:55 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:34:55 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:34:55 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:34:55 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:34:55 user nova-compute[71321]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4 (non-flash)
Apr 12 12:34:55 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:34:55 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:34:55 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:34:55 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:34:55 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:34:55 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:34:55 user nova-compute[71321]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4 (non-flash)
Apr 12 12:34:55 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef6410f1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4'): ({'sdi'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Removing single pathed devices sdi {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d7e41b-011b-4a58-8c1f-74c8af947195]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[438b4ccd-c7b3-480a-94f5-255ea13c6454]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Flushing IO for device /dev/sdi {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb1a551-fb72-4780-aa61-ae0f74c7f738]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.045s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[330dc203-6229-40b4-a25a-0580bb52d092]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] SCSI volumes sdi have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda041e1-8674-4ada-9fc4-7201e2bb06ca]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2274629-2f84-4ab9-ab55-5987e5e37517]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4, portal: 172.16.0.220,3260]
Apr 12 12:34:55 user nova-compute[71321]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4, portal: 172.16.0.220,3260] successful.
Apr 12 12:34:55 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc5e4bf-6b03-4afc-9f73-9a65f3d09c85]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] <== disconnect_volume: return (361ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:34:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:34:56 user nova-compute[71321]: DEBUG nova.objects.instance [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lazy-loading 'flavor' on Instance uuid 839e85a2-f7af-482d-a5e6-09195888300e {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:34:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "839e85a2-f7af-482d-a5e6-09195888300e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.871s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:56 user nova-compute[71321]: DEBUG nova.compute.manager [req-02344277-b25b-4829-b856-bb7da2e16870 req-220c910c-763e-468d-977b-d0127270040d service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] Received event network-vif-plugged-cbb69638-6a5f-4d12-8737-45850145fa0e {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:34:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-02344277-b25b-4829-b856-bb7da2e16870 req-220c910c-763e-468d-977b-d0127270040d service nova] Acquiring lock "10116da0-785c-41cf-96bb-95721af863db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-02344277-b25b-4829-b856-bb7da2e16870 req-220c910c-763e-468d-977b-d0127270040d service nova] Lock "10116da0-785c-41cf-96bb-95721af863db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-02344277-b25b-4829-b856-bb7da2e16870 req-220c910c-763e-468d-977b-d0127270040d service nova] Lock "10116da0-785c-41cf-96bb-95721af863db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:56 user nova-compute[71321]: DEBUG nova.compute.manager [req-02344277-b25b-4829-b856-bb7da2e16870 req-220c910c-763e-468d-977b-d0127270040d service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] No waiting events found dispatching network-vif-plugged-cbb69638-6a5f-4d12-8737-45850145fa0e {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:34:56 user nova-compute[71321]: WARNING nova.compute.manager [req-02344277-b25b-4829-b856-bb7da2e16870 req-220c910c-763e-468d-977b-d0127270040d service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] Received unexpected event network-vif-plugged-cbb69638-6a5f-4d12-8737-45850145fa0e for instance with vm_state rescued and task_state unrescuing.
Apr 12 12:34:56 user nova-compute[71321]: DEBUG nova.compute.manager [req-02344277-b25b-4829-b856-bb7da2e16870 req-220c910c-763e-468d-977b-d0127270040d service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] Received event network-vif-plugged-cbb69638-6a5f-4d12-8737-45850145fa0e {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:34:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-02344277-b25b-4829-b856-bb7da2e16870 req-220c910c-763e-468d-977b-d0127270040d service nova] Acquiring lock "10116da0-785c-41cf-96bb-95721af863db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-02344277-b25b-4829-b856-bb7da2e16870 req-220c910c-763e-468d-977b-d0127270040d service nova] Lock "10116da0-785c-41cf-96bb-95721af863db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-02344277-b25b-4829-b856-bb7da2e16870 req-220c910c-763e-468d-977b-d0127270040d service nova] Lock "10116da0-785c-41cf-96bb-95721af863db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:56 user nova-compute[71321]: DEBUG nova.compute.manager [req-02344277-b25b-4829-b856-bb7da2e16870 req-220c910c-763e-468d-977b-d0127270040d service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] No waiting events found dispatching network-vif-plugged-cbb69638-6a5f-4d12-8737-45850145fa0e {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:34:56 user nova-compute[71321]: WARNING nova.compute.manager [req-02344277-b25b-4829-b856-bb7da2e16870 req-220c910c-763e-468d-977b-d0127270040d service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] Received unexpected event network-vif-plugged-cbb69638-6a5f-4d12-8737-45850145fa0e for instance with vm_state rescued and task_state unrescuing.
Apr 12 12:34:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Removed pending event for 10116da0-785c-41cf-96bb-95721af863db due to event {{(pid=71321) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 12:34:56 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302896.7696605, 10116da0-785c-41cf-96bb-95721af863db => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:34:56 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] VM Resumed (Lifecycle Event)
Apr 12 12:34:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7354fce0-e94e-4edc-a555-762fabf5512a tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:34:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:34:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:34:56 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 12:34:56 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302896.773689, 10116da0-785c-41cf-96bb-95721af863db => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:34:56 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] VM Started (Lifecycle Event)
Apr 12 12:34:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:34:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:34:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "fe72c043-e035-4926-8f7f-455285f0dbe8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "fe72c043-e035-4926-8f7f-455285f0dbe8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:57 user nova-compute[71321]: DEBUG nova.compute.manager [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:34:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:57 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:34:57 user nova-compute[71321]: INFO nova.compute.claims [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Claim successful on node user
Apr 12 12:34:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG nova.objects.instance [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lazy-loading 'flavor' on Instance uuid 4b597d03-8252-4e26-a5a9-651117bf78d1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "4b597d03-8252-4e26-a5a9-651117bf78d1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.254s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "4b597d03-8252-4e26-a5a9-651117bf78d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 3.110s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "4b597d03-8252-4e26-a5a9-651117bf78d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "4b597d03-8252-4e26-a5a9-651117bf78d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "4b597d03-8252-4e26-a5a9-651117bf78d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:58 user nova-compute[71321]: INFO nova.compute.manager [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Terminating instance
Apr 12 12:34:58 user nova-compute[71321]: DEBUG nova.compute.manager [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG nova.compute.manager [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG nova.compute.manager [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG nova.network.neutron [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:34:58 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:34:58 user nova-compute[71321]: DEBUG nova.compute.manager [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG nova.policy [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc42504b7aab4fedb136acd998adeddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab04e4f968f4c07af43f3fe6651713a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG nova.compute.manager [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:34:58 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Creating image(s)
Apr 12 12:34:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe72c043-e035-4926-8f7f-455285f0dbe8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "/opt/stack/data/nova/instances/fe72c043-e035-4926-8f7f-455285f0dbe8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "/opt/stack/data/nova/instances/fe72c043-e035-4926-8f7f-455285f0dbe8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG nova.compute.manager [req-6bc6a786-b2ca-40d0-b43e-162c3bce6979 req-1f2c9964-3a3f-4652-a461-49fe149bc39a service nova] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Received event network-vif-unplugged-77d477e8-bd8b-4918-af70-09d64ecf39d5 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-6bc6a786-b2ca-40d0-b43e-162c3bce6979 req-1f2c9964-3a3f-4652-a461-49fe149bc39a service nova] Acquiring lock "4b597d03-8252-4e26-a5a9-651117bf78d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-6bc6a786-b2ca-40d0-b43e-162c3bce6979 req-1f2c9964-3a3f-4652-a461-49fe149bc39a service nova] Lock "4b597d03-8252-4e26-a5a9-651117bf78d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-6bc6a786-b2ca-40d0-b43e-162c3bce6979 req-1f2c9964-3a3f-4652-a461-49fe149bc39a service nova] Lock "4b597d03-8252-4e26-a5a9-651117bf78d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG nova.compute.manager [req-6bc6a786-b2ca-40d0-b43e-162c3bce6979 req-1f2c9964-3a3f-4652-a461-49fe149bc39a service nova] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] No waiting events found dispatching network-vif-unplugged-77d477e8-bd8b-4918-af70-09d64ecf39d5 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG nova.compute.manager [req-6bc6a786-b2ca-40d0-b43e-162c3bce6979 req-1f2c9964-3a3f-4652-a461-49fe149bc39a service nova] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Received event network-vif-unplugged-77d477e8-bd8b-4918-af70-09d64ecf39d5 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.207s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.153s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/fe72c043-e035-4926-8f7f-455285f0dbe8/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/fe72c043-e035-4926-8f7f-455285f0dbe8/disk 1073741824" returned: 0 in 0.066s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:58 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Instance destroyed successfully.
Apr 12 12:34:58 user nova-compute[71321]: DEBUG nova.objects.instance [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lazy-loading 'resources' on Instance uuid 4b597d03-8252-4e26-a5a9-651117bf78d1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:32:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1237193295',display_name='tempest-VolumesSnapshotTestJSON-instance-1237193295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1237193295',id=17,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:32:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='466d2a494cf64002a98588909bdcd197',ramdisk_id='',reservation_id='r-fmq4y5ha',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-760244133',owner_user_name='tempest-VolumesSnapshotTestJSON-760244133-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:32:54Z,user_data=None,user_id='35727e3b48da4494808015e2b630a3f9',uuid=4b597d03-8252-4e26-a5a9-651117bf78d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77d477e8-bd8b-4918-af70-09d64ecf39d5", "address": "fa:16:3e:ff:04:04", "network": {"id": "0fcb9046-707e-462c-937c-3ba5aebe64e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-529948515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "466d2a494cf64002a98588909bdcd197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d477e8-bd", "ovs_interfaceid": "77d477e8-bd8b-4918-af70-09d64ecf39d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Converting VIF {"id": "77d477e8-bd8b-4918-af70-09d64ecf39d5", "address": "fa:16:3e:ff:04:04", "network": {"id": "0fcb9046-707e-462c-937c-3ba5aebe64e8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-529948515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "466d2a494cf64002a98588909bdcd197", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d477e8-bd", "ovs_interfaceid": "77d477e8-bd8b-4918-af70-09d64ecf39d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:04:04,bridge_name='br-int',has_traffic_filtering=True,id=77d477e8-bd8b-4918-af70-09d64ecf39d5,network=Network(0fcb9046-707e-462c-937c-3ba5aebe64e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77d477e8-bd') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:34:58 user nova-compute[71321]: DEBUG os_vif [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:04:04,bridge_name='br-int',has_traffic_filtering=True,id=77d477e8-bd8b-4918-af70-09d64ecf39d5,network=Network(0fcb9046-707e-462c-937c-3ba5aebe64e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77d477e8-bd') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77d477e8-bd, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:34:59 user nova-compute[71321]: INFO os_vif [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:04:04,bridge_name='br-int',has_traffic_filtering=True,id=77d477e8-bd8b-4918-af70-09d64ecf39d5,network=Network(0fcb9046-707e-462c-937c-3ba5aebe64e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77d477e8-bd')
Apr 12 12:34:59 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bkMnELmD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:34:59 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:34:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.152s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fe72c043-e035-4926-8f7f-455285f0dbe8/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe72c043-e035-4926-8f7f-455285f0dbe8/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3051a4e-f3be-4475-9691-4bc6fd4f03e7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG nova.network.neutron [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Successfully created port: 2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:34:59 user nova-compute[71321]: No targets found.
Apr 12 12:34:59 user nova-compute[71321]: iSNS:
Apr 12 12:34:59 user nova-compute[71321]: No targets found.
Apr 12 12:34:59 user nova-compute[71321]: STATIC:
Apr 12 12:34:59 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d
Apr 12 12:34:59 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:59 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:59 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0
Apr 12 12:34:59 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:59 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:59 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54
Apr 12 12:34:59 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:59 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:59 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936
Apr 12 12:34:59 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:59 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:59 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f
Apr 12 12:34:59 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:59 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:59 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8
Apr 12 12:34:59 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:34:59 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:34:59 user nova-compute[71321]: FIRMWARE:
Apr 12 12:34:59 user nova-compute[71321]: No targets found.
Apr 12 12:34:59 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:34:59 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:34:59 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46234755-00e8-4256-9acd-7daa3980a5f4', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a70d99-4868-4e4e-8485-a096e54c1f92]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[010ef30a-618d-44dc-a287-309c174da9e1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:34:59 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:34:59 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:34:59 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:34:59 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:34:59 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:34:59 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:34:59 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:34:59 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:34:59 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:34:59 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:34:59 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:34:59 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef446c4af0>, {}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Disconnecting from: [] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.132s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] <== disconnect_volume: return (135ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:34:59 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Deleting instance files /opt/stack/data/nova/instances/4b597d03-8252-4e26-a5a9-651117bf78d1_del
Apr 12 12:34:59 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Deletion of /opt/stack/data/nova/instances/4b597d03-8252-4e26-a5a9-651117bf78d1_del complete
Apr 12 12:34:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe72c043-e035-4926-8f7f-455285f0dbe8/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Cannot resize image /opt/stack/data/nova/instances/fe72c043-e035-4926-8f7f-455285f0dbe8/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG nova.objects.instance [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lazy-loading 'migration_context' on Instance uuid fe72c043-e035-4926-8f7f-455285f0dbe8 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Ensure instance console log exists: /opt/stack/data/nova/instances/fe72c043-e035-4926-8f7f-455285f0dbe8/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:34:59 user nova-compute[71321]: INFO nova.compute.manager [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Took 1.11 seconds to destroy the instance on the hypervisor.
Apr 12 12:34:59 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:34:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:35:00 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Took 0.86 seconds to deallocate network for instance.
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.compute.manager [req-3f16dca4-7b4f-4ff1-866d-cce1a6fd394b req-d7a74b85-6c70-4fb5-a1b0-8d814021be36 service nova] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Received event network-vif-deleted-77d477e8-bd8b-4918-af70-09d64ecf39d5 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:00 user nova-compute[71321]: INFO nova.compute.manager [req-3f16dca4-7b4f-4ff1-866d-cce1a6fd394b req-d7a74b85-6c70-4fb5-a1b0-8d814021be36 service nova] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Neutron deleted interface 77d477e8-bd8b-4918-af70-09d64ecf39d5; detaching it from the instance and deleting it from the info cache
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.network.neutron [req-3f16dca4-7b4f-4ff1-866d-cce1a6fd394b req-d7a74b85-6c70-4fb5-a1b0-8d814021be36 service nova] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:35:00 user nova-compute[71321]: WARNING nova.volume.cinder [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Attachment 9e4ef09f-035b-49aa-b13e-6f0db95d87a2 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 9e4ef09f-035b-49aa-b13e-6f0db95d87a2. (HTTP 404) (Request-ID: req-578b8a78-7719-4f20-9803-7b598e523057)
Apr 12 12:35:00 user nova-compute[71321]: INFO nova.compute.manager [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Took 0.04 seconds to detach 1 volumes for instance.
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.compute.manager [req-3f16dca4-7b4f-4ff1-866d-cce1a6fd394b req-d7a74b85-6c70-4fb5-a1b0-8d814021be36 service nova] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Detach interface failed, port_id=77d477e8-bd8b-4918-af70-09d64ecf39d5, reason: Instance 4b597d03-8252-4e26-a5a9-651117bf78d1 could not be found. {{(pid=71321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "fa011231-049f-40c3-89c0-53447a35752f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "fa011231-049f-40c3-89c0-53447a35752f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.network.neutron [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Successfully updated port: 2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "refresh_cache-fe72c043-e035-4926-8f7f-455285f0dbe8" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquired lock "refresh_cache-fe72c043-e035-4926-8f7f-455285f0dbe8" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.network.neutron [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.network.neutron [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.compute.manager [req-44f3e320-cf23-43ed-be4a-77a4a85bfc8f req-82e3760a-c9b1-4438-87af-319df35de670 service nova] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Received event network-vif-plugged-77d477e8-bd8b-4918-af70-09d64ecf39d5 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-44f3e320-cf23-43ed-be4a-77a4a85bfc8f req-82e3760a-c9b1-4438-87af-319df35de670 service nova] Acquiring lock "4b597d03-8252-4e26-a5a9-651117bf78d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-44f3e320-cf23-43ed-be4a-77a4a85bfc8f req-82e3760a-c9b1-4438-87af-319df35de670 service nova] Lock "4b597d03-8252-4e26-a5a9-651117bf78d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-44f3e320-cf23-43ed-be4a-77a4a85bfc8f req-82e3760a-c9b1-4438-87af-319df35de670 service nova] Lock "4b597d03-8252-4e26-a5a9-651117bf78d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.compute.manager [req-44f3e320-cf23-43ed-be4a-77a4a85bfc8f req-82e3760a-c9b1-4438-87af-319df35de670 service nova] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] No waiting events found dispatching network-vif-plugged-77d477e8-bd8b-4918-af70-09d64ecf39d5 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:35:00 user nova-compute[71321]: WARNING nova.compute.manager [req-44f3e320-cf23-43ed-be4a-77a4a85bfc8f req-82e3760a-c9b1-4438-87af-319df35de670 service nova] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Received unexpected event network-vif-plugged-77d477e8-bd8b-4918-af70-09d64ecf39d5 for instance with vm_state deleted and task_state None.
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.438s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.319s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:35:00 user nova-compute[71321]: INFO nova.compute.claims [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Claim successful on node user
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.network.neutron [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Updating instance_info_cache with network_info: [{"id": "2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd", "address": "fa:16:3e:97:e5:5f", "network": {"id": "963759e8-808d-494c-9dea-0efa9f78804a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-684057570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ab04e4f968f4c07af43f3fe6651713a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5696a6-8f", "ovs_interfaceid": "2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:35:00 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Deleted allocations for instance 4b597d03-8252-4e26-a5a9-651117bf78d1
Apr 12 12:35:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Releasing lock "refresh_cache-fe72c043-e035-4926-8f7f-455285f0dbe8" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.compute.manager [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Instance network_info: |[{"id": "2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd", "address": "fa:16:3e:97:e5:5f", "network": {"id": "963759e8-808d-494c-9dea-0efa9f78804a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-684057570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ab04e4f968f4c07af43f3fe6651713a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5696a6-8f", "ovs_interfaceid": "2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Start _get_guest_xml network_info=[{"id": "2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd", "address": "fa:16:3e:97:e5:5f", "network": {"id": "963759e8-808d-494c-9dea-0efa9f78804a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-684057570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ab04e4f968f4c07af43f3fe6651713a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5696a6-8f", "ovs_interfaceid": "2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:35:00 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:35:00 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:34:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1900654939',display_name='tempest-ServersNegativeTestJSON-server-1900654939',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1900654939',id=21,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ab04e4f968f4c07af43f3fe6651713a',ramdisk_id='',reservation_id='r-7qqrkhco',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1331801987',owner_user_name='tempest-ServersNegativeTestJSON-1331801987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:34:58Z,user_data=None,user_id='bc42504b7aab4fedb136acd998adeddb',uuid=fe72c043-e035-4926-8f7f-455285f0dbe8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd", "address": "fa:16:3e:97:e5:5f", "network": {"id": "963759e8-808d-494c-9dea-0efa9f78804a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-684057570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ab04e4f968f4c07af43f3fe6651713a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5696a6-8f", "ovs_interfaceid": "2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Converting VIF {"id": "2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd", "address": "fa:16:3e:97:e5:5f", "network": {"id": "963759e8-808d-494c-9dea-0efa9f78804a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-684057570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ab04e4f968f4c07af43f3fe6651713a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5696a6-8f", "ovs_interfaceid": "2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:e5:5f,bridge_name='br-int',has_traffic_filtering=True,id=2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd,network=Network(963759e8-808d-494c-9dea-0efa9f78804a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a5696a6-8f') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.objects.instance [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lazy-loading 'pci_devices' on Instance uuid fe72c043-e035-4926-8f7f-455285f0dbe8 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:35:00 user nova-compute[71321]:   <uuid>fe72c043-e035-4926-8f7f-455285f0dbe8</uuid>
Apr 12 12:35:00 user nova-compute[71321]:   <name>instance-00000015</name>
Apr 12 12:35:00 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:35:00 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:35:00 user nova-compute[71321]:   <metadata>
Apr 12 12:35:00 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:35:00 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:35:00 user nova-compute[71321]:       <nova:name>tempest-ServersNegativeTestJSON-server-1900654939</nova:name>
Apr 12 12:35:00 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:35:00</nova:creationTime>
Apr 12 12:35:00 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:35:00 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:35:00 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:35:00 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:35:00 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:35:00 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:35:00 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:35:00 user nova-compute[71321]:       <nova:owner>
Apr 12 12:35:00 user nova-compute[71321]:         <nova:user uuid="bc42504b7aab4fedb136acd998adeddb">tempest-ServersNegativeTestJSON-1331801987-project-member</nova:user>
Apr 12 12:35:00 user nova-compute[71321]:         <nova:project uuid="7ab04e4f968f4c07af43f3fe6651713a">tempest-ServersNegativeTestJSON-1331801987</nova:project>
Apr 12 12:35:00 user nova-compute[71321]:       </nova:owner>
Apr 12 12:35:00 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:35:00 user nova-compute[71321]:       <nova:ports>
Apr 12 12:35:00 user nova-compute[71321]:         <nova:port uuid="2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd">
Apr 12 12:35:00 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 12:35:00 user nova-compute[71321]:         </nova:port>
Apr 12 12:35:00 user nova-compute[71321]:       </nova:ports>
Apr 12 12:35:00 user nova-compute[71321]:     </nova:instance>
Apr 12 12:35:00 user nova-compute[71321]:   </metadata>
Apr 12 12:35:00 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:35:00 user nova-compute[71321]:     <system>
Apr 12 12:35:00 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:35:00 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:35:00 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:35:00 user nova-compute[71321]:       <entry name="serial">fe72c043-e035-4926-8f7f-455285f0dbe8</entry>
Apr 12 12:35:00 user nova-compute[71321]:       <entry name="uuid">fe72c043-e035-4926-8f7f-455285f0dbe8</entry>
Apr 12 12:35:00 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:35:00 user nova-compute[71321]:     </system>
Apr 12 12:35:00 user nova-compute[71321]:   </sysinfo>
Apr 12 12:35:00 user nova-compute[71321]:   <os>
Apr 12 12:35:00 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:35:00 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:35:00 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:35:00 user nova-compute[71321]:   </os>
Apr 12 12:35:00 user nova-compute[71321]:   <features>
Apr 12 12:35:00 user nova-compute[71321]:     <acpi/>
Apr 12 12:35:00 user nova-compute[71321]:     <apic/>
Apr 12 12:35:00 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:35:00 user nova-compute[71321]:   </features>
Apr 12 12:35:00 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:35:00 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:35:00 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:35:00 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:35:00 user nova-compute[71321]:   </clock>
Apr 12 12:35:00 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:35:00 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:35:00 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:35:00 user nova-compute[71321]:   </cpu>
Apr 12 12:35:00 user nova-compute[71321]:   <devices>
Apr 12 12:35:00 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:35:00 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:35:00 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/fe72c043-e035-4926-8f7f-455285f0dbe8/disk"/>
Apr 12 12:35:00 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:35:00 user nova-compute[71321]:     </disk>
Apr 12 12:35:00 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:35:00 user nova-compute[71321]:       <mac address="fa:16:3e:97:e5:5f"/>
Apr 12 12:35:00 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:35:00 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:35:00 user nova-compute[71321]:       <target dev="tap2a5696a6-8f"/>
Apr 12 12:35:00 user nova-compute[71321]:     </interface>
Apr 12 12:35:00 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:35:00 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/fe72c043-e035-4926-8f7f-455285f0dbe8/console.log" append="off"/>
Apr 12 12:35:00 user nova-compute[71321]:     </serial>
Apr 12 12:35:00 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:35:00 user nova-compute[71321]:     <video>
Apr 12 12:35:00 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:35:00 user nova-compute[71321]:     </video>
Apr 12 12:35:00 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:35:00 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:35:00 user nova-compute[71321]:     </rng>
Apr 12 12:35:00 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:35:00 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:35:00 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:35:00 user nova-compute[71321]:     </memballoon>
Apr 12 12:35:00 user nova-compute[71321]:   </devices>
Apr 12 12:35:00 user nova-compute[71321]: </domain>
Apr 12 12:35:00 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:34:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1900654939',display_name='tempest-ServersNegativeTestJSON-server-1900654939',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1900654939',id=21,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ab04e4f968f4c07af43f3fe6651713a',ramdisk_id='',reservation_id='r-7qqrkhco',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1331801987',owner_user_name='tempest-ServersNegativeTestJSON-1331801987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:34:58Z,user_data=None,user_id='bc42504b7aab4fedb136acd998adeddb',uuid=fe72c043-e035-4926-8f7f-455285f0dbe8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd", "address": "fa:16:3e:97:e5:5f", "network": {"id": "963759e8-808d-494c-9dea-0efa9f78804a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-684057570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ab04e4f968f4c07af43f3fe6651713a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5696a6-8f", "ovs_interfaceid": "2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Converting VIF {"id": "2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd", "address": "fa:16:3e:97:e5:5f", "network": {"id": "963759e8-808d-494c-9dea-0efa9f78804a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-684057570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ab04e4f968f4c07af43f3fe6651713a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5696a6-8f", "ovs_interfaceid": "2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:e5:5f,bridge_name='br-int',has_traffic_filtering=True,id=2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd,network=Network(963759e8-808d-494c-9dea-0efa9f78804a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a5696a6-8f') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG os_vif [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:e5:5f,bridge_name='br-int',has_traffic_filtering=True,id=2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd,network=Network(963759e8-808d-494c-9dea-0efa9f78804a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a5696a6-8f') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a5696a6-8f, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2a5696a6-8f, col_values=(('external_ids', {'iface-id': '2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:e5:5f', 'vm-uuid': 'fe72c043-e035-4926-8f7f-455285f0dbe8'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:00 user nova-compute[71321]: INFO os_vif [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:e5:5f,bridge_name='br-int',has_traffic_filtering=True,id=2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd,network=Network(963759e8-808d-494c-9dea-0efa9f78804a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a5696a6-8f')
Apr 12 12:35:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "4b597d03-8252-4e26-a5a9-651117bf78d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.746s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:35:00 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] No VIF found with MAC fa:16:3e:97:e5:5f, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:35:01 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:35:01 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:35:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.547s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:01 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:35:01 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:35:01 user nova-compute[71321]: DEBUG nova.network.neutron [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:35:01 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:35:01 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:35:01 user nova-compute[71321]: INFO nova.virt.block_device [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Booting with volume 5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 at /dev/vda
Apr 12 12:35:01 user nova-compute[71321]: DEBUG nova.policy [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b4b62db7ef8e4ae4bc11ff520c6afcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a894beccbd45af9d4486772fccb949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:35:01 user nova-compute[71321]: DEBUG os_brick.utils [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:35:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:01 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d615cd25-966d-4942-b7ae-a3df7b14c4bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:01 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af867b8-edc7-4bb7-84b8-9d407b3b9396]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:01 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffb544f-ce7b-4ed7-ac24-57e617fa30c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:01 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbf09de-70bf-45d6-b0b7-fb0dfc50496d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:35:01 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:35:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:35:01 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:35:01 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b18b8c-5e1e-47a1-8f95-5803c9ef3303]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:01 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:35:01 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:35:01 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:35:01 user nova-compute[71321]: DEBUG os_brick.utils [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:35:01 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Updating existing volume attachment record: da153be3-e5ff-44e1-9fda-fa11cedc06bb {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:35:02 user nova-compute[71321]: DEBUG nova.network.neutron [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Successfully created port: 8243f136-fe60-498f-80e1-27a598c434a3 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:35:02 user nova-compute[71321]: DEBUG nova.compute.manager [req-332043c1-49ce-4142-93df-67f471689d45 req-c0448ba0-f81c-4b98-a2df-9fe0717b4f17 service nova] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Received event network-changed-2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:02 user nova-compute[71321]: DEBUG nova.compute.manager [req-332043c1-49ce-4142-93df-67f471689d45 req-c0448ba0-f81c-4b98-a2df-9fe0717b4f17 service nova] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Refreshing instance network info cache due to event network-changed-2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:35:02 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-332043c1-49ce-4142-93df-67f471689d45 req-c0448ba0-f81c-4b98-a2df-9fe0717b4f17 service nova] Acquiring lock "refresh_cache-fe72c043-e035-4926-8f7f-455285f0dbe8" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:35:02 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-332043c1-49ce-4142-93df-67f471689d45 req-c0448ba0-f81c-4b98-a2df-9fe0717b4f17 service nova] Acquired lock "refresh_cache-fe72c043-e035-4926-8f7f-455285f0dbe8" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:35:02 user nova-compute[71321]: DEBUG nova.network.neutron [req-332043c1-49ce-4142-93df-67f471689d45 req-c0448ba0-f81c-4b98-a2df-9fe0717b4f17 service nova] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Refreshing network info cache for port 2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:35:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:02 user nova-compute[71321]: DEBUG nova.compute.manager [req-c4e91db2-233d-4f85-9413-169db4cdd68b req-68259f01-150e-4698-ad98-d6171fc9d254 service nova] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Received event network-vif-plugged-2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:02 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c4e91db2-233d-4f85-9413-169db4cdd68b req-68259f01-150e-4698-ad98-d6171fc9d254 service nova] Acquiring lock "fe72c043-e035-4926-8f7f-455285f0dbe8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:02 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c4e91db2-233d-4f85-9413-169db4cdd68b req-68259f01-150e-4698-ad98-d6171fc9d254 service nova] Lock "fe72c043-e035-4926-8f7f-455285f0dbe8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:02 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c4e91db2-233d-4f85-9413-169db4cdd68b req-68259f01-150e-4698-ad98-d6171fc9d254 service nova] Lock "fe72c043-e035-4926-8f7f-455285f0dbe8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:02 user nova-compute[71321]: DEBUG nova.compute.manager [req-c4e91db2-233d-4f85-9413-169db4cdd68b req-68259f01-150e-4698-ad98-d6171fc9d254 service nova] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] No waiting events found dispatching network-vif-plugged-2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:35:02 user nova-compute[71321]: WARNING nova.compute.manager [req-c4e91db2-233d-4f85-9413-169db4cdd68b req-68259f01-150e-4698-ad98-d6171fc9d254 service nova] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Received unexpected event network-vif-plugged-2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd for instance with vm_state building and task_state spawning.
Apr 12 12:35:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:03 user nova-compute[71321]: DEBUG nova.network.neutron [req-332043c1-49ce-4142-93df-67f471689d45 req-c0448ba0-f81c-4b98-a2df-9fe0717b4f17 service nova] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Updated VIF entry in instance network info cache for port 2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:35:03 user nova-compute[71321]: DEBUG nova.network.neutron [req-332043c1-49ce-4142-93df-67f471689d45 req-c0448ba0-f81c-4b98-a2df-9fe0717b4f17 service nova] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Updating instance_info_cache with network_info: [{"id": "2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd", "address": "fa:16:3e:97:e5:5f", "network": {"id": "963759e8-808d-494c-9dea-0efa9f78804a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-684057570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ab04e4f968f4c07af43f3fe6651713a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5696a6-8f", "ovs_interfaceid": "2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:35:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-332043c1-49ce-4142-93df-67f471689d45 req-c0448ba0-f81c-4b98-a2df-9fe0717b4f17 service nova] Releasing lock "refresh_cache-fe72c043-e035-4926-8f7f-455285f0dbe8" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:35:03 user nova-compute[71321]: DEBUG nova.network.neutron [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Successfully updated port: 8243f136-fe60-498f-80e1-27a598c434a3 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:35:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "refresh_cache-fa011231-049f-40c3-89c0-53447a35752f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:35:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquired lock "refresh_cache-fa011231-049f-40c3-89c0-53447a35752f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:35:03 user nova-compute[71321]: DEBUG nova.network.neutron [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:35:03 user nova-compute[71321]: DEBUG nova.network.neutron [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:35:03 user nova-compute[71321]: DEBUG nova.network.neutron [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Updating instance_info_cache with network_info: [{"id": "8243f136-fe60-498f-80e1-27a598c434a3", "address": "fa:16:3e:2f:02:41", "network": {"id": "34ecf1c9-50ff-4168-8650-a5277102ccaa", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730184159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a894beccbd45af9d4486772fccb949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8243f136-fe", "ovs_interfaceid": "8243f136-fe60-498f-80e1-27a598c434a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:35:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Releasing lock "refresh_cache-fa011231-049f-40c3-89c0-53447a35752f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:35:03 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Instance network_info: |[{"id": "8243f136-fe60-498f-80e1-27a598c434a3", "address": "fa:16:3e:2f:02:41", "network": {"id": "34ecf1c9-50ff-4168-8650-a5277102ccaa", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730184159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a894beccbd45af9d4486772fccb949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8243f136-fe", "ovs_interfaceid": "8243f136-fe60-498f-80e1-27a598c434a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:35:04 user nova-compute[71321]: DEBUG nova.compute.manager [req-907eaa38-dab7-453b-a6a1-5907060b2ee4 req-3a9b7afc-55df-4ac0-9db3-cede63a4db64 service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Received event network-changed-8243f136-fe60-498f-80e1-27a598c434a3 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:04 user nova-compute[71321]: DEBUG nova.compute.manager [req-907eaa38-dab7-453b-a6a1-5907060b2ee4 req-3a9b7afc-55df-4ac0-9db3-cede63a4db64 service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Refreshing instance network info cache due to event network-changed-8243f136-fe60-498f-80e1-27a598c434a3. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:35:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-907eaa38-dab7-453b-a6a1-5907060b2ee4 req-3a9b7afc-55df-4ac0-9db3-cede63a4db64 service nova] Acquiring lock "refresh_cache-fa011231-049f-40c3-89c0-53447a35752f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:35:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-907eaa38-dab7-453b-a6a1-5907060b2ee4 req-3a9b7afc-55df-4ac0-9db3-cede63a4db64 service nova] Acquired lock "refresh_cache-fa011231-049f-40c3-89c0-53447a35752f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:35:04 user nova-compute[71321]: DEBUG nova.network.neutron [req-907eaa38-dab7-453b-a6a1-5907060b2ee4 req-3a9b7afc-55df-4ac0-9db3-cede63a4db64 service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Refreshing network info cache for port 8243f136-fe60-498f-80e1-27a598c434a3 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:35:04 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302904.4922092, fe72c043-e035-4926-8f7f-455285f0dbe8 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:35:04 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] VM Resumed (Lifecycle Event)
Apr 12 12:35:04 user nova-compute[71321]: DEBUG nova.compute.manager [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:35:04 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:35:04 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Instance spawned successfully.
Apr 12 12:35:04 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:35:04 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:35:04 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:35:04 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:35:04 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:35:04 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:35:04 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:35:04 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:35:04 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:35:04 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:35:04 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302904.4925542, fe72c043-e035-4926-8f7f-455285f0dbe8 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:35:04 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] VM Started (Lifecycle Event)
Apr 12 12:35:04 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:35:04 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:35:04 user nova-compute[71321]: DEBUG nova.compute.manager [req-058ea73e-f528-4faf-84ae-f440ea15d57f req-f725d268-a8d6-40eb-bb56-0a87764cd908 service nova] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Received event network-vif-plugged-2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-058ea73e-f528-4faf-84ae-f440ea15d57f req-f725d268-a8d6-40eb-bb56-0a87764cd908 service nova] Acquiring lock "fe72c043-e035-4926-8f7f-455285f0dbe8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-058ea73e-f528-4faf-84ae-f440ea15d57f req-f725d268-a8d6-40eb-bb56-0a87764cd908 service nova] Lock "fe72c043-e035-4926-8f7f-455285f0dbe8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-058ea73e-f528-4faf-84ae-f440ea15d57f req-f725d268-a8d6-40eb-bb56-0a87764cd908 service nova] Lock "fe72c043-e035-4926-8f7f-455285f0dbe8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:04 user nova-compute[71321]: DEBUG nova.compute.manager [req-058ea73e-f528-4faf-84ae-f440ea15d57f req-f725d268-a8d6-40eb-bb56-0a87764cd908 service nova] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] No waiting events found dispatching network-vif-plugged-2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:35:04 user nova-compute[71321]: WARNING nova.compute.manager [req-058ea73e-f528-4faf-84ae-f440ea15d57f req-f725d268-a8d6-40eb-bb56-0a87764cd908 service nova] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Received unexpected event network-vif-plugged-2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd for instance with vm_state building and task_state spawning.
Apr 12 12:35:04 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:35:04 user nova-compute[71321]: DEBUG nova.network.neutron [req-907eaa38-dab7-453b-a6a1-5907060b2ee4 req-3a9b7afc-55df-4ac0-9db3-cede63a4db64 service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Updated VIF entry in instance network info cache for port 8243f136-fe60-498f-80e1-27a598c434a3. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:35:04 user nova-compute[71321]: DEBUG nova.network.neutron [req-907eaa38-dab7-453b-a6a1-5907060b2ee4 req-3a9b7afc-55df-4ac0-9db3-cede63a4db64 service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Updating instance_info_cache with network_info: [{"id": "8243f136-fe60-498f-80e1-27a598c434a3", "address": "fa:16:3e:2f:02:41", "network": {"id": "34ecf1c9-50ff-4168-8650-a5277102ccaa", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730184159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a894beccbd45af9d4486772fccb949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8243f136-fe", "ovs_interfaceid": "8243f136-fe60-498f-80e1-27a598c434a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:35:04 user nova-compute[71321]: INFO nova.compute.manager [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Took 6.20 seconds to spawn the instance on the hypervisor.
Apr 12 12:35:04 user nova-compute[71321]: DEBUG nova.compute.manager [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:35:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-907eaa38-dab7-453b-a6a1-5907060b2ee4 req-3a9b7afc-55df-4ac0-9db3-cede63a4db64 service nova] Releasing lock "refresh_cache-fa011231-049f-40c3-89c0-53447a35752f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:35:04 user nova-compute[71321]: INFO nova.compute.manager [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Took 7.04 seconds to build instance.
Apr 12 12:35:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "fe72c043-e035-4926-8f7f-455285f0dbe8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.163s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:35:06 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Creating image(s)
Apr 12 12:35:06 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Did not create local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Ensure instance console log exists: /opt/stack/data/nova/instances/fa011231-049f-40c3-89c0-53447a35752f/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Start _get_guest_xml network_info=[{"id": "8243f136-fe60-498f-80e1-27a598c434a3", "address": "fa:16:3e:2f:02:41", "network": {"id": "34ecf1c9-50ff-4168-8650-a5277102ccaa", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730184159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a894beccbd45af9d4486772fccb949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8243f136-fe", "ovs_interfaceid": "8243f136-fe60-498f-80e1-27a598c434a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'da153be3-e5ff-44e1-9fda-fa11cedc06bb', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MJbBXUwj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fa011231-049f-40c3-89c0-53447a35752f', 'attached_at': '', 'detached_at': '', 'volume_id': '5edf56f8-c348-40e5-a9e0-d0b3a7fc7945', 'serial': '5edf56f8-c348-40e5-a9e0-d0b3a7fc7945'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:35:06 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:35:06 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:35:06 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MJbBXUwj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:35:06 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:35:06 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:35:06 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:35:06 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:35:06 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cec22c-588f-4f43-8a54-823a624d4868]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:35:06 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82c8f0e-2c9e-409c-9820-dec452299625]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945] added
Apr 12 12:35:06 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[815a0124-8ac1-4e09-8e58-f609af88360a]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d0917b-8180-43d3-b57e-864b715de0a8]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MJbBXUwj {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MJbBXUwj" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d2af23-1e8c-446d-857e-aa245acc5623]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MJbBXUwj'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[248687b5-36ca-4bae-a4b9-05552c49e092]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46b3f73-441c-4a31-a619-9ff246a5ad18]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:35:06 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:35:06 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:35:06 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:35:06 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:35:06 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:35:06 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:35:06 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:35:06 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:35:06 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:35:06 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:35:06 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:35:06 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf39f05c-4dd4-4b06-a6bd-b61f8c448ecf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945, portal: 172.16.0.220,3260]
Apr 12 12:35:06 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945, portal: 172.16.0.220,3260] successful.
Apr 12 12:35:06 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf19c2af-bcc8-4b8d-8d48-b14024f2056d]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bbd099-aeb1-4df0-96c0-aa7e52f1f8bf]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:35:06 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:35:06 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:35:06 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:35:06 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:35:06 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:35:06 user nova-compute[71321]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:35:06 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:35:06 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:35:06 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:35:06 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:35:06 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:35:06 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:35:06 user nova-compute[71321]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:35:06 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[679bd587-690d-45c2-8c84-2b6cad324a6c]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:35:06 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MJbBXUwj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:35:07 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:35:07 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23066653636626465', 'path': '/dev/sdc'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:35:07 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066653636626465', 'path': '/dev/sdc'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:35:07 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:34:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-224414802',display_name='tempest-TestShelveInstance-server-224414802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-224414802',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIXMDy37+J0z2zjXuZ61N5MrklsBTrLDHZ5WONUVRavY0GPTGKIiOPe6k/JrTv4Yj3TrMCnYedVgrFp1+M+iVBHHlbm5MUjkvlQ73cuxRdVBOG/e8rbEfvGvKpVaF3RRQ==',key_name='tempest-TestShelveInstance-568010420',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99a894beccbd45af9d4486772fccb949',ramdisk_id='',reservation_id='r-e0ge4cua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1585323339',owner_user_name='tempest-TestShelveInstance-1585323339-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:35:01Z,user_data=None,user_id='b4b62db7ef8e4ae4bc11ff520c6afcd8',uuid=fa011231-049f-40c3-89c0-53447a35752f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8243f136-fe60-498f-80e1-27a598c434a3", "address": "fa:16:3e:2f:02:41", "network": {"id": "34ecf1c9-50ff-4168-8650-a5277102ccaa", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730184159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a894beccbd45af9d4486772fccb949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8243f136-fe", "ovs_interfaceid": "8243f136-fe60-498f-80e1-27a598c434a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:35:07 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Converting VIF {"id": "8243f136-fe60-498f-80e1-27a598c434a3", "address": "fa:16:3e:2f:02:41", "network": {"id": "34ecf1c9-50ff-4168-8650-a5277102ccaa", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730184159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a894beccbd45af9d4486772fccb949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8243f136-fe", "ovs_interfaceid": "8243f136-fe60-498f-80e1-27a598c434a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:35:07 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:02:41,bridge_name='br-int',has_traffic_filtering=True,id=8243f136-fe60-498f-80e1-27a598c434a3,network=Network(34ecf1c9-50ff-4168-8650-a5277102ccaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8243f136-fe') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:35:07 user nova-compute[71321]: DEBUG nova.objects.instance [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lazy-loading 'pci_devices' on Instance uuid fa011231-049f-40c3-89c0-53447a35752f {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:35:07 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:35:07 user nova-compute[71321]:   <uuid>fa011231-049f-40c3-89c0-53447a35752f</uuid>
Apr 12 12:35:07 user nova-compute[71321]:   <name>instance-00000016</name>
Apr 12 12:35:07 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:35:07 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:35:07 user nova-compute[71321]:   <metadata>
Apr 12 12:35:07 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:35:07 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:35:07 user nova-compute[71321]:       <nova:name>tempest-TestShelveInstance-server-224414802</nova:name>
Apr 12 12:35:07 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:35:06</nova:creationTime>
Apr 12 12:35:07 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:35:07 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:35:07 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:35:07 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:35:07 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:35:07 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:35:07 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:35:07 user nova-compute[71321]:       <nova:owner>
Apr 12 12:35:07 user nova-compute[71321]:         <nova:user uuid="b4b62db7ef8e4ae4bc11ff520c6afcd8">tempest-TestShelveInstance-1585323339-project-member</nova:user>
Apr 12 12:35:07 user nova-compute[71321]:         <nova:project uuid="99a894beccbd45af9d4486772fccb949">tempest-TestShelveInstance-1585323339</nova:project>
Apr 12 12:35:07 user nova-compute[71321]:       </nova:owner>
Apr 12 12:35:07 user nova-compute[71321]:       <nova:ports>
Apr 12 12:35:07 user nova-compute[71321]:         <nova:port uuid="8243f136-fe60-498f-80e1-27a598c434a3">
Apr 12 12:35:07 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 12:35:07 user nova-compute[71321]:         </nova:port>
Apr 12 12:35:07 user nova-compute[71321]:       </nova:ports>
Apr 12 12:35:07 user nova-compute[71321]:     </nova:instance>
Apr 12 12:35:07 user nova-compute[71321]:   </metadata>
Apr 12 12:35:07 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:35:07 user nova-compute[71321]:     <system>
Apr 12 12:35:07 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:35:07 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:35:07 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:35:07 user nova-compute[71321]:       <entry name="serial">fa011231-049f-40c3-89c0-53447a35752f</entry>
Apr 12 12:35:07 user nova-compute[71321]:       <entry name="uuid">fa011231-049f-40c3-89c0-53447a35752f</entry>
Apr 12 12:35:07 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:35:07 user nova-compute[71321]:     </system>
Apr 12 12:35:07 user nova-compute[71321]:   </sysinfo>
Apr 12 12:35:07 user nova-compute[71321]:   <os>
Apr 12 12:35:07 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:35:07 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:35:07 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:35:07 user nova-compute[71321]:   </os>
Apr 12 12:35:07 user nova-compute[71321]:   <features>
Apr 12 12:35:07 user nova-compute[71321]:     <acpi/>
Apr 12 12:35:07 user nova-compute[71321]:     <apic/>
Apr 12 12:35:07 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:35:07 user nova-compute[71321]:   </features>
Apr 12 12:35:07 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:35:07 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:35:07 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:35:07 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:35:07 user nova-compute[71321]:   </clock>
Apr 12 12:35:07 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:35:07 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:35:07 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:35:07 user nova-compute[71321]:   </cpu>
Apr 12 12:35:07 user nova-compute[71321]:   <devices>
Apr 12 12:35:07 user nova-compute[71321]:     <disk type="block" device="disk">
Apr 12 12:35:07 user nova-compute[71321]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:35:07 user nova-compute[71321]:       <source dev="/dev/sdc"/>
Apr 12 12:35:07 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:35:07 user nova-compute[71321]:       <serial>5edf56f8-c348-40e5-a9e0-d0b3a7fc7945</serial>
Apr 12 12:35:07 user nova-compute[71321]:     </disk>
Apr 12 12:35:07 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:35:07 user nova-compute[71321]:       <mac address="fa:16:3e:2f:02:41"/>
Apr 12 12:35:07 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:35:07 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:35:07 user nova-compute[71321]:       <target dev="tap8243f136-fe"/>
Apr 12 12:35:07 user nova-compute[71321]:     </interface>
Apr 12 12:35:07 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:35:07 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/fa011231-049f-40c3-89c0-53447a35752f/console.log" append="off"/>
Apr 12 12:35:07 user nova-compute[71321]:     </serial>
Apr 12 12:35:07 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:35:07 user nova-compute[71321]:     <video>
Apr 12 12:35:07 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:35:07 user nova-compute[71321]:     </video>
Apr 12 12:35:07 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:35:07 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:35:07 user nova-compute[71321]:     </rng>
Apr 12 12:35:07 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:35:07 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:35:07 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:35:07 user nova-compute[71321]:     </memballoon>
Apr 12 12:35:07 user nova-compute[71321]:   </devices>
Apr 12 12:35:07 user nova-compute[71321]: </domain>
Apr 12 12:35:07 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:35:07 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:34:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-224414802',display_name='tempest-TestShelveInstance-server-224414802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-224414802',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIXMDy37+J0z2zjXuZ61N5MrklsBTrLDHZ5WONUVRavY0GPTGKIiOPe6k/JrTv4Yj3TrMCnYedVgrFp1+M+iVBHHlbm5MUjkvlQ73cuxRdVBOG/e8rbEfvGvKpVaF3RRQ==',key_name='tempest-TestShelveInstance-568010420',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99a894beccbd45af9d4486772fccb949',ramdisk_id='',reservation_id='r-e0ge4cua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1585323339',owner_user_name='tempest-TestShelveInstance-1585323339-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:35:01Z,user_data=None,user_id='b4b62db7ef8e4ae4bc11ff520c6afcd8',uuid=fa011231-049f-40c3-89c0-53447a35752f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8243f136-fe60-498f-80e1-27a598c434a3", "address": "fa:16:3e:2f:02:41", "network": {"id": "34ecf1c9-50ff-4168-8650-a5277102ccaa", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730184159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a894beccbd45af9d4486772fccb949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8243f136-fe", "ovs_interfaceid": "8243f136-fe60-498f-80e1-27a598c434a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:35:07 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Converting VIF {"id": "8243f136-fe60-498f-80e1-27a598c434a3", "address": "fa:16:3e:2f:02:41", "network": {"id": "34ecf1c9-50ff-4168-8650-a5277102ccaa", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730184159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a894beccbd45af9d4486772fccb949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8243f136-fe", "ovs_interfaceid": "8243f136-fe60-498f-80e1-27a598c434a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:35:07 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:02:41,bridge_name='br-int',has_traffic_filtering=True,id=8243f136-fe60-498f-80e1-27a598c434a3,network=Network(34ecf1c9-50ff-4168-8650-a5277102ccaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8243f136-fe') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:35:07 user nova-compute[71321]: DEBUG os_vif [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:02:41,bridge_name='br-int',has_traffic_filtering=True,id=8243f136-fe60-498f-80e1-27a598c434a3,network=Network(34ecf1c9-50ff-4168-8650-a5277102ccaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8243f136-fe') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:35:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:35:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:35:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8243f136-fe, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:35:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8243f136-fe, col_values=(('external_ids', {'iface-id': '8243f136-fe60-498f-80e1-27a598c434a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:02:41', 'vm-uuid': 'fa011231-049f-40c3-89c0-53447a35752f'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:35:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:35:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:07 user nova-compute[71321]: INFO os_vif [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:02:41,bridge_name='br-int',has_traffic_filtering=True,id=8243f136-fe60-498f-80e1-27a598c434a3,network=Network(34ecf1c9-50ff-4168-8650-a5277102ccaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8243f136-fe')
Apr 12 12:35:07 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:35:07 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] No VIF found with MAC fa:16:3e:2f:02:41, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:35:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:09 user nova-compute[71321]: DEBUG nova.compute.manager [req-4b4994d4-3473-48c8-b597-412af4935355 req-fb8ee419-dd8f-4f87-bd6e-6641f9b40013 service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Received event network-vif-plugged-8243f136-fe60-498f-80e1-27a598c434a3 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4b4994d4-3473-48c8-b597-412af4935355 req-fb8ee419-dd8f-4f87-bd6e-6641f9b40013 service nova] Acquiring lock "fa011231-049f-40c3-89c0-53447a35752f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4b4994d4-3473-48c8-b597-412af4935355 req-fb8ee419-dd8f-4f87-bd6e-6641f9b40013 service nova] Lock "fa011231-049f-40c3-89c0-53447a35752f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4b4994d4-3473-48c8-b597-412af4935355 req-fb8ee419-dd8f-4f87-bd6e-6641f9b40013 service nova] Lock "fa011231-049f-40c3-89c0-53447a35752f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:09 user nova-compute[71321]: DEBUG nova.compute.manager [req-4b4994d4-3473-48c8-b597-412af4935355 req-fb8ee419-dd8f-4f87-bd6e-6641f9b40013 service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] No waiting events found dispatching network-vif-plugged-8243f136-fe60-498f-80e1-27a598c434a3 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:35:09 user nova-compute[71321]: WARNING nova.compute.manager [req-4b4994d4-3473-48c8-b597-412af4935355 req-fb8ee419-dd8f-4f87-bd6e-6641f9b40013 service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Received unexpected event network-vif-plugged-8243f136-fe60-498f-80e1-27a598c434a3 for instance with vm_state building and task_state spawning.
Apr 12 12:35:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:11 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302911.31661, fa011231-049f-40c3-89c0-53447a35752f => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:35:11 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: fa011231-049f-40c3-89c0-53447a35752f] VM Resumed (Lifecycle Event)
Apr 12 12:35:11 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:35:11 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:35:11 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: fa011231-049f-40c3-89c0-53447a35752f] Instance spawned successfully.
Apr 12 12:35:11 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:35:11 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: fa011231-049f-40c3-89c0-53447a35752f] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:35:11 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: fa011231-049f-40c3-89c0-53447a35752f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:35:11 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:35:11 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:35:11 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:35:11 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:35:11 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:35:11 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:35:11 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: fa011231-049f-40c3-89c0-53447a35752f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:35:11 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302911.3182805, fa011231-049f-40c3-89c0-53447a35752f => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:35:11 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: fa011231-049f-40c3-89c0-53447a35752f] VM Started (Lifecycle Event)
Apr 12 12:35:11 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: fa011231-049f-40c3-89c0-53447a35752f] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:35:11 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: fa011231-049f-40c3-89c0-53447a35752f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:35:11 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: fa011231-049f-40c3-89c0-53447a35752f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:35:11 user nova-compute[71321]: DEBUG nova.compute.manager [req-f700298f-f187-44a8-a55e-d893465b5e6b req-e12bb539-a659-426c-a09e-849a134f791c service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Received event network-vif-plugged-8243f136-fe60-498f-80e1-27a598c434a3 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f700298f-f187-44a8-a55e-d893465b5e6b req-e12bb539-a659-426c-a09e-849a134f791c service nova] Acquiring lock "fa011231-049f-40c3-89c0-53447a35752f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f700298f-f187-44a8-a55e-d893465b5e6b req-e12bb539-a659-426c-a09e-849a134f791c service nova] Lock "fa011231-049f-40c3-89c0-53447a35752f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f700298f-f187-44a8-a55e-d893465b5e6b req-e12bb539-a659-426c-a09e-849a134f791c service nova] Lock "fa011231-049f-40c3-89c0-53447a35752f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:11 user nova-compute[71321]: DEBUG nova.compute.manager [req-f700298f-f187-44a8-a55e-d893465b5e6b req-e12bb539-a659-426c-a09e-849a134f791c service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] No waiting events found dispatching network-vif-plugged-8243f136-fe60-498f-80e1-27a598c434a3 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:35:11 user nova-compute[71321]: WARNING nova.compute.manager [req-f700298f-f187-44a8-a55e-d893465b5e6b req-e12bb539-a659-426c-a09e-849a134f791c service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Received unexpected event network-vif-plugged-8243f136-fe60-498f-80e1-27a598c434a3 for instance with vm_state building and task_state spawning.
Apr 12 12:35:11 user nova-compute[71321]: INFO nova.compute.manager [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Took 5.13 seconds to spawn the instance on the hypervisor.
Apr 12 12:35:11 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:35:11 user nova-compute[71321]: INFO nova.compute.manager [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Took 11.20 seconds to build instance.
Apr 12 12:35:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "fa011231-049f-40c3-89c0-53447a35752f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.304s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "c24566ee-48cd-4cc4-aaea-28b1eae34fad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "c24566ee-48cd-4cc4-aaea-28b1eae34fad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:11 user nova-compute[71321]: DEBUG nova.compute.manager [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:35:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:11 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:35:11 user nova-compute[71321]: INFO nova.compute.claims [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Claim successful on node user
Apr 12 12:35:12 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:35:12 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:35:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:12 user nova-compute[71321]: DEBUG nova.compute.manager [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:35:12 user nova-compute[71321]: DEBUG nova.compute.manager [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:35:12 user nova-compute[71321]: DEBUG nova.network.neutron [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:35:12 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:35:12 user nova-compute[71321]: DEBUG nova.compute.manager [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:35:12 user nova-compute[71321]: DEBUG nova.compute.manager [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:35:12 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:35:12 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Creating image(s)
Apr 12 12:35:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "/opt/stack/data/nova/instances/c24566ee-48cd-4cc4-aaea-28b1eae34fad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "/opt/stack/data/nova/instances/c24566ee-48cd-4cc4-aaea-28b1eae34fad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "/opt/stack/data/nova/instances/c24566ee-48cd-4cc4-aaea-28b1eae34fad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:12 user nova-compute[71321]: DEBUG nova.policy [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3a887c10bf74974a648e3ec048fcdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d607e0aed1f47129540181261c6ebc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:35:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:12 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:35:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.175s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.148s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/c24566ee-48cd-4cc4-aaea-28b1eae34fad/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:12 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/c24566ee-48cd-4cc4-aaea-28b1eae34fad/disk 1073741824" returned: 0 in 0.049s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.137s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:12 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c24566ee-48cd-4cc4-aaea-28b1eae34fad/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:35:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c24566ee-48cd-4cc4-aaea-28b1eae34fad/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:13 user nova-compute[71321]: DEBUG nova.network.neutron [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Successfully created port: 1df30b7e-ae74-466e-8076-8ba92f855cc8 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:35:13 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c24566ee-48cd-4cc4-aaea-28b1eae34fad/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:13 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Cannot resize image /opt/stack/data/nova/instances/c24566ee-48cd-4cc4-aaea-28b1eae34fad/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:35:13 user nova-compute[71321]: DEBUG nova.objects.instance [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lazy-loading 'migration_context' on Instance uuid c24566ee-48cd-4cc4-aaea-28b1eae34fad {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:35:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:35:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Ensure instance console log exists: /opt/stack/data/nova/instances/c24566ee-48cd-4cc4-aaea-28b1eae34fad/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:35:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:13 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681302898.9515033, 4b597d03-8252-4e26-a5a9-651117bf78d1 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:35:13 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] VM Stopped (Lifecycle Event)
Apr 12 12:35:13 user nova-compute[71321]: DEBUG nova.compute.manager [None req-200ae1d3-dc1b-42fd-acd5-6e9cfaeda173 None None] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG nova.network.neutron [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Successfully updated port: 1df30b7e-ae74-466e-8076-8ba92f855cc8 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "refresh_cache-c24566ee-48cd-4cc4-aaea-28b1eae34fad" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquired lock "refresh_cache-c24566ee-48cd-4cc4-aaea-28b1eae34fad" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG nova.network.neutron [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG nova.compute.manager [req-b4b7a161-a336-44b0-9083-a88446c0f334 req-cc8d6d64-9bff-4d75-9803-600c6ed919a6 service nova] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Received event network-changed-1df30b7e-ae74-466e-8076-8ba92f855cc8 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG nova.compute.manager [req-b4b7a161-a336-44b0-9083-a88446c0f334 req-cc8d6d64-9bff-4d75-9803-600c6ed919a6 service nova] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Refreshing instance network info cache due to event network-changed-1df30b7e-ae74-466e-8076-8ba92f855cc8. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b4b7a161-a336-44b0-9083-a88446c0f334 req-cc8d6d64-9bff-4d75-9803-600c6ed919a6 service nova] Acquiring lock "refresh_cache-c24566ee-48cd-4cc4-aaea-28b1eae34fad" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG nova.network.neutron [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG nova.network.neutron [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Updating instance_info_cache with network_info: [{"id": "1df30b7e-ae74-466e-8076-8ba92f855cc8", "address": "fa:16:3e:b4:55:22", "network": {"id": "6e43ca53-1563-43b0-84cc-d3f759c61c37", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-908305790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d607e0aed1f47129540181261c6ebc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1df30b7e-ae", "ovs_interfaceid": "1df30b7e-ae74-466e-8076-8ba92f855cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Releasing lock "refresh_cache-c24566ee-48cd-4cc4-aaea-28b1eae34fad" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG nova.compute.manager [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Instance network_info: |[{"id": "1df30b7e-ae74-466e-8076-8ba92f855cc8", "address": "fa:16:3e:b4:55:22", "network": {"id": "6e43ca53-1563-43b0-84cc-d3f759c61c37", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-908305790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d607e0aed1f47129540181261c6ebc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1df30b7e-ae", "ovs_interfaceid": "1df30b7e-ae74-466e-8076-8ba92f855cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b4b7a161-a336-44b0-9083-a88446c0f334 req-cc8d6d64-9bff-4d75-9803-600c6ed919a6 service nova] Acquired lock "refresh_cache-c24566ee-48cd-4cc4-aaea-28b1eae34fad" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG nova.network.neutron [req-b4b7a161-a336-44b0-9083-a88446c0f334 req-cc8d6d64-9bff-4d75-9803-600c6ed919a6 service nova] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Refreshing network info cache for port 1df30b7e-ae74-466e-8076-8ba92f855cc8 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Start _get_guest_xml network_info=[{"id": "1df30b7e-ae74-466e-8076-8ba92f855cc8", "address": "fa:16:3e:b4:55:22", "network": {"id": "6e43ca53-1563-43b0-84cc-d3f759c61c37", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-908305790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d607e0aed1f47129540181261c6ebc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1df30b7e-ae", "ovs_interfaceid": "1df30b7e-ae74-466e-8076-8ba92f855cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:35:14 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:35:14 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:35:14 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:35:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-844880205',display_name='tempest-VolumesAdminNegativeTest-server-844880205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-844880205',id=23,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d607e0aed1f47129540181261c6ebc7',ramdisk_id='',reservation_id='r-q4ly7tj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-714206228',owner_user_name='tempest-VolumesAdminNegativeTest-714206228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:35:12Z,user_data=None,user_id='b3a887c10bf74974a648e3ec048fcdd7',uuid=c24566ee-48cd-4cc4-aaea-28b1eae34fad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1df30b7e-ae74-466e-8076-8ba92f855cc8", "address": "fa:16:3e:b4:55:22", "network": {"id": "6e43ca53-1563-43b0-84cc-d3f759c61c37", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-908305790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d607e0aed1f47129540181261c6ebc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1df30b7e-ae", "ovs_interfaceid": "1df30b7e-ae74-466e-8076-8ba92f855cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Converting VIF {"id": "1df30b7e-ae74-466e-8076-8ba92f855cc8", "address": "fa:16:3e:b4:55:22", "network": {"id": "6e43ca53-1563-43b0-84cc-d3f759c61c37", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-908305790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d607e0aed1f47129540181261c6ebc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1df30b7e-ae", "ovs_interfaceid": "1df30b7e-ae74-466e-8076-8ba92f855cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:55:22,bridge_name='br-int',has_traffic_filtering=True,id=1df30b7e-ae74-466e-8076-8ba92f855cc8,network=Network(6e43ca53-1563-43b0-84cc-d3f759c61c37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1df30b7e-ae') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG nova.objects.instance [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lazy-loading 'pci_devices' on Instance uuid c24566ee-48cd-4cc4-aaea-28b1eae34fad {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:35:14 user nova-compute[71321]:   <uuid>c24566ee-48cd-4cc4-aaea-28b1eae34fad</uuid>
Apr 12 12:35:14 user nova-compute[71321]:   <name>instance-00000017</name>
Apr 12 12:35:14 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:35:14 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:35:14 user nova-compute[71321]:   <metadata>
Apr 12 12:35:14 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:35:14 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:35:14 user nova-compute[71321]:       <nova:name>tempest-VolumesAdminNegativeTest-server-844880205</nova:name>
Apr 12 12:35:14 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:35:14</nova:creationTime>
Apr 12 12:35:14 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:35:14 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:35:14 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:35:14 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:35:14 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:35:14 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:35:14 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:35:14 user nova-compute[71321]:       <nova:owner>
Apr 12 12:35:14 user nova-compute[71321]:         <nova:user uuid="b3a887c10bf74974a648e3ec048fcdd7">tempest-VolumesAdminNegativeTest-714206228-project-member</nova:user>
Apr 12 12:35:14 user nova-compute[71321]:         <nova:project uuid="7d607e0aed1f47129540181261c6ebc7">tempest-VolumesAdminNegativeTest-714206228</nova:project>
Apr 12 12:35:14 user nova-compute[71321]:       </nova:owner>
Apr 12 12:35:14 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:35:14 user nova-compute[71321]:       <nova:ports>
Apr 12 12:35:14 user nova-compute[71321]:         <nova:port uuid="1df30b7e-ae74-466e-8076-8ba92f855cc8">
Apr 12 12:35:14 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 12:35:14 user nova-compute[71321]:         </nova:port>
Apr 12 12:35:14 user nova-compute[71321]:       </nova:ports>
Apr 12 12:35:14 user nova-compute[71321]:     </nova:instance>
Apr 12 12:35:14 user nova-compute[71321]:   </metadata>
Apr 12 12:35:14 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:35:14 user nova-compute[71321]:     <system>
Apr 12 12:35:14 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:35:14 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:35:14 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:35:14 user nova-compute[71321]:       <entry name="serial">c24566ee-48cd-4cc4-aaea-28b1eae34fad</entry>
Apr 12 12:35:14 user nova-compute[71321]:       <entry name="uuid">c24566ee-48cd-4cc4-aaea-28b1eae34fad</entry>
Apr 12 12:35:14 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:35:14 user nova-compute[71321]:     </system>
Apr 12 12:35:14 user nova-compute[71321]:   </sysinfo>
Apr 12 12:35:14 user nova-compute[71321]:   <os>
Apr 12 12:35:14 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:35:14 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:35:14 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:35:14 user nova-compute[71321]:   </os>
Apr 12 12:35:14 user nova-compute[71321]:   <features>
Apr 12 12:35:14 user nova-compute[71321]:     <acpi/>
Apr 12 12:35:14 user nova-compute[71321]:     <apic/>
Apr 12 12:35:14 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:35:14 user nova-compute[71321]:   </features>
Apr 12 12:35:14 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:35:14 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:35:14 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:35:14 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:35:14 user nova-compute[71321]:   </clock>
Apr 12 12:35:14 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:35:14 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:35:14 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:35:14 user nova-compute[71321]:   </cpu>
Apr 12 12:35:14 user nova-compute[71321]:   <devices>
Apr 12 12:35:14 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:35:14 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:35:14 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/c24566ee-48cd-4cc4-aaea-28b1eae34fad/disk"/>
Apr 12 12:35:14 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:35:14 user nova-compute[71321]:     </disk>
Apr 12 12:35:14 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:35:14 user nova-compute[71321]:       <mac address="fa:16:3e:b4:55:22"/>
Apr 12 12:35:14 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:35:14 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:35:14 user nova-compute[71321]:       <target dev="tap1df30b7e-ae"/>
Apr 12 12:35:14 user nova-compute[71321]:     </interface>
Apr 12 12:35:14 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:35:14 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/c24566ee-48cd-4cc4-aaea-28b1eae34fad/console.log" append="off"/>
Apr 12 12:35:14 user nova-compute[71321]:     </serial>
Apr 12 12:35:14 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:35:14 user nova-compute[71321]:     <video>
Apr 12 12:35:14 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:35:14 user nova-compute[71321]:     </video>
Apr 12 12:35:14 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:35:14 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:35:14 user nova-compute[71321]:     </rng>
Apr 12 12:35:14 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:35:14 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:35:14 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:35:14 user nova-compute[71321]:     </memballoon>
Apr 12 12:35:14 user nova-compute[71321]:   </devices>
Apr 12 12:35:14 user nova-compute[71321]: </domain>
Apr 12 12:35:14 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:35:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-844880205',display_name='tempest-VolumesAdminNegativeTest-server-844880205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-844880205',id=23,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d607e0aed1f47129540181261c6ebc7',ramdisk_id='',reservation_id='r-q4ly7tj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-714206228',owner_user_name='tempest-VolumesAdminNegativeTest-714206228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:35:12Z,user_data=None,user_id='b3a887c10bf74974a648e3ec048fcdd7',uuid=c24566ee-48cd-4cc4-aaea-28b1eae34fad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1df30b7e-ae74-466e-8076-8ba92f855cc8", "address": "fa:16:3e:b4:55:22", "network": {"id": "6e43ca53-1563-43b0-84cc-d3f759c61c37", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-908305790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d607e0aed1f47129540181261c6ebc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1df30b7e-ae", "ovs_interfaceid": "1df30b7e-ae74-466e-8076-8ba92f855cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Converting VIF {"id": "1df30b7e-ae74-466e-8076-8ba92f855cc8", "address": "fa:16:3e:b4:55:22", "network": {"id": "6e43ca53-1563-43b0-84cc-d3f759c61c37", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-908305790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d607e0aed1f47129540181261c6ebc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1df30b7e-ae", "ovs_interfaceid": "1df30b7e-ae74-466e-8076-8ba92f855cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:55:22,bridge_name='br-int',has_traffic_filtering=True,id=1df30b7e-ae74-466e-8076-8ba92f855cc8,network=Network(6e43ca53-1563-43b0-84cc-d3f759c61c37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1df30b7e-ae') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG os_vif [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:55:22,bridge_name='br-int',has_traffic_filtering=True,id=1df30b7e-ae74-466e-8076-8ba92f855cc8,network=Network(6e43ca53-1563-43b0-84cc-d3f759c61c37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1df30b7e-ae') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1df30b7e-ae, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1df30b7e-ae, col_values=(('external_ids', {'iface-id': '1df30b7e-ae74-466e-8076-8ba92f855cc8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:55:22', 'vm-uuid': 'c24566ee-48cd-4cc4-aaea-28b1eae34fad'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:14 user nova-compute[71321]: INFO os_vif [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:55:22,bridge_name='br-int',has_traffic_filtering=True,id=1df30b7e-ae74-466e-8076-8ba92f855cc8,network=Network(6e43ca53-1563-43b0-84cc-d3f759c61c37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1df30b7e-ae')
Apr 12 12:35:14 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] No VIF found with MAC fa:16:3e:b4:55:22, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:35:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:15 user nova-compute[71321]: DEBUG nova.network.neutron [req-b4b7a161-a336-44b0-9083-a88446c0f334 req-cc8d6d64-9bff-4d75-9803-600c6ed919a6 service nova] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Updated VIF entry in instance network info cache for port 1df30b7e-ae74-466e-8076-8ba92f855cc8. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:35:15 user nova-compute[71321]: DEBUG nova.network.neutron [req-b4b7a161-a336-44b0-9083-a88446c0f334 req-cc8d6d64-9bff-4d75-9803-600c6ed919a6 service nova] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Updating instance_info_cache with network_info: [{"id": "1df30b7e-ae74-466e-8076-8ba92f855cc8", "address": "fa:16:3e:b4:55:22", "network": {"id": "6e43ca53-1563-43b0-84cc-d3f759c61c37", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-908305790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d607e0aed1f47129540181261c6ebc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1df30b7e-ae", "ovs_interfaceid": "1df30b7e-ae74-466e-8076-8ba92f855cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:35:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b4b7a161-a336-44b0-9083-a88446c0f334 req-cc8d6d64-9bff-4d75-9803-600c6ed919a6 service nova] Releasing lock "refresh_cache-c24566ee-48cd-4cc4-aaea-28b1eae34fad" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:35:15 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:35:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:15 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:35:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "546c0c08-35f1-4043-ac30-56d49bc86af1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:15 user nova-compute[71321]: INFO nova.compute.manager [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Detaching volume a2a363ad-a0a5-4076-9530-5488fad60936
Apr 12 12:35:15 user nova-compute[71321]: INFO nova.virt.block_device [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Attempting to driver detach volume a2a363ad-a0a5-4076-9530-5488fad60936 from mountpoint /dev/vdb
Apr 12 12:35:15 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Attempting to detach device vdb from instance 546c0c08-35f1-4043-ac30-56d49bc86af1 from the persistent domain config. {{(pid=71321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 12:35:15 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:35:15 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:35:15 user nova-compute[71321]:   <source dev="/dev/sdd"/>
Apr 12 12:35:15 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:35:15 user nova-compute[71321]:   <serial>a2a363ad-a0a5-4076-9530-5488fad60936</serial>
Apr 12 12:35:15 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 12:35:15 user nova-compute[71321]: </disk>
Apr 12 12:35:15 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:35:15 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Successfully detached device vdb from instance 546c0c08-35f1-4043-ac30-56d49bc86af1 from the persistent domain config.
Apr 12 12:35:15 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 546c0c08-35f1-4043-ac30-56d49bc86af1 from the live domain config. {{(pid=71321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 12:35:15 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:35:15 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:35:15 user nova-compute[71321]:   <source dev="/dev/sdd"/>
Apr 12 12:35:15 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:35:15 user nova-compute[71321]:   <serial>a2a363ad-a0a5-4076-9530-5488fad60936</serial>
Apr 12 12:35:15 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 12:35:15 user nova-compute[71321]: </disk>
Apr 12 12:35:15 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG nova.compute.manager [req-64d0909c-742d-4a19-a7a7-9fe7915b0226 req-5947feae-92f9-4656-ab03-f259f00caefe service nova] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Received event network-vif-plugged-1df30b7e-ae74-466e-8076-8ba92f855cc8 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-64d0909c-742d-4a19-a7a7-9fe7915b0226 req-5947feae-92f9-4656-ab03-f259f00caefe service nova] Acquiring lock "c24566ee-48cd-4cc4-aaea-28b1eae34fad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-64d0909c-742d-4a19-a7a7-9fe7915b0226 req-5947feae-92f9-4656-ab03-f259f00caefe service nova] Lock "c24566ee-48cd-4cc4-aaea-28b1eae34fad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-64d0909c-742d-4a19-a7a7-9fe7915b0226 req-5947feae-92f9-4656-ab03-f259f00caefe service nova] Lock "c24566ee-48cd-4cc4-aaea-28b1eae34fad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG nova.compute.manager [req-64d0909c-742d-4a19-a7a7-9fe7915b0226 req-5947feae-92f9-4656-ab03-f259f00caefe service nova] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] No waiting events found dispatching network-vif-plugged-1df30b7e-ae74-466e-8076-8ba92f855cc8 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:35:16 user nova-compute[71321]: WARNING nova.compute.manager [req-64d0909c-742d-4a19-a7a7-9fe7915b0226 req-5947feae-92f9-4656-ab03-f259f00caefe service nova] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Received unexpected event network-vif-plugged-1df30b7e-ae74-466e-8076-8ba92f855cc8 for instance with vm_state building and task_state spawning.
Apr 12 12:35:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Received event <DeviceRemovedEvent: 1681302916.3830118, 546c0c08-35f1-4043-ac30-56d49bc86af1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 546c0c08-35f1-4043-ac30-56d49bc86af1 {{(pid=71321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 12:35:16 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Successfully detached device vdb from instance 546c0c08-35f1-4043-ac30-56d49bc86af1 from the live domain config.
Apr 12 12:35:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVztbEhi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:35:16 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:35:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2f591e-4dc0-4cd1-a8ac-cf0587c82872]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:35:16 user nova-compute[71321]: No targets found.
Apr 12 12:35:16 user nova-compute[71321]: iSNS:
Apr 12 12:35:16 user nova-compute[71321]: No targets found.
Apr 12 12:35:16 user nova-compute[71321]: STATIC:
Apr 12 12:35:16 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d
Apr 12 12:35:16 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:35:16 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:35:16 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945
Apr 12 12:35:16 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:35:16 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:35:16 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0
Apr 12 12:35:16 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:35:16 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:35:16 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54
Apr 12 12:35:16 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:35:16 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:35:16 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936
Apr 12 12:35:16 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:35:16 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:35:16 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f
Apr 12 12:35:16 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:35:16 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:35:16 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8
Apr 12 12:35:16 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:35:16 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:35:16 user nova-compute[71321]: FIRMWARE:
Apr 12 12:35:16 user nova-compute[71321]: No targets found.
Apr 12 12:35:16 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:35:16 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:35:16 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b206969-3c7e-4255-98df-9bc62bb44a42]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8fb32c-febd-456c-a179-196748cdb3d9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:35:16 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:35:16 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:35:16 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:35:16 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:35:16 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:35:16 user nova-compute[71321]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:35:16 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:35:16 user nova-compute[71321]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 (non-flash)
Apr 12 12:35:16 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:35:16 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:35:16 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:35:16 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:35:16 user nova-compute[71321]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:35:16 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef8a00a3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936'): ({'sdd'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Removing single pathed devices sdd {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f48035-f998-400d-b840-dac0c6a46302]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d710f3-b7ed-4237-a2a2-95f37e6849e7]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Flushing IO for device /dev/sdd {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a81fec-b143-4bbf-b605-de1b00e09b91]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe039255-5c2e-4ab3-8582-d071aa21be9f]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] SCSI volumes sdd have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0d0284-df72-4df3-a868-b84f9b87ada6]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b00101-784a-4a6d-b9f2-1c0d8887c94d]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936, portal: 172.16.0.220,3260]
Apr 12 12:35:16 user nova-compute[71321]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936, portal: 172.16.0.220,3260] successful.
Apr 12 12:35:16 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2a363ad-a0a5-4076-9530-5488fad60936 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e796a26f-91ff-47f1-93ab-e5f076301d4d]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] <== disconnect_volume: return (382ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:35:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:35:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:17 user nova-compute[71321]: DEBUG nova.objects.instance [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lazy-loading 'flavor' on Instance uuid 546c0c08-35f1-4043-ac30-56d49bc86af1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:35:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.016s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:18 user nova-compute[71321]: DEBUG nova.compute.manager [req-c7341168-5c17-4754-b22b-0f875edfe16b req-7104e328-c123-4f6d-8ac7-cb6b835faf1c service nova] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Received event network-vif-plugged-1df30b7e-ae74-466e-8076-8ba92f855cc8 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c7341168-5c17-4754-b22b-0f875edfe16b req-7104e328-c123-4f6d-8ac7-cb6b835faf1c service nova] Acquiring lock "c24566ee-48cd-4cc4-aaea-28b1eae34fad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c7341168-5c17-4754-b22b-0f875edfe16b req-7104e328-c123-4f6d-8ac7-cb6b835faf1c service nova] Lock "c24566ee-48cd-4cc4-aaea-28b1eae34fad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c7341168-5c17-4754-b22b-0f875edfe16b req-7104e328-c123-4f6d-8ac7-cb6b835faf1c service nova] Lock "c24566ee-48cd-4cc4-aaea-28b1eae34fad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:18 user nova-compute[71321]: DEBUG nova.compute.manager [req-c7341168-5c17-4754-b22b-0f875edfe16b req-7104e328-c123-4f6d-8ac7-cb6b835faf1c service nova] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] No waiting events found dispatching network-vif-plugged-1df30b7e-ae74-466e-8076-8ba92f855cc8 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:35:18 user nova-compute[71321]: WARNING nova.compute.manager [req-c7341168-5c17-4754-b22b-0f875edfe16b req-7104e328-c123-4f6d-8ac7-cb6b835faf1c service nova] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Received unexpected event network-vif-plugged-1df30b7e-ae74-466e-8076-8ba92f855cc8 for instance with vm_state building and task_state spawning.
Apr 12 12:35:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:18 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:35:18 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:35:18 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:35:18 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:35:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c24566ee-48cd-4cc4-aaea-28b1eae34fad/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:18 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302918.567213, c24566ee-48cd-4cc4-aaea-28b1eae34fad => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:35:18 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] VM Resumed (Lifecycle Event)
Apr 12 12:35:18 user nova-compute[71321]: DEBUG nova.compute.manager [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:35:18 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:35:18 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Instance spawned successfully.
Apr 12 12:35:18 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:35:18 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:35:18 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:35:18 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:35:18 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:35:18 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:35:18 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:35:18 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:35:18 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:35:18 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:35:18 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681302918.5686824, c24566ee-48cd-4cc4-aaea-28b1eae34fad => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:35:18 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] VM Started (Lifecycle Event)
Apr 12 12:35:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c24566ee-48cd-4cc4-aaea-28b1eae34fad/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c24566ee-48cd-4cc4-aaea-28b1eae34fad/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:18 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:35:18 user nova-compute[71321]: INFO nova.compute.manager [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Took 6.32 seconds to spawn the instance on the hypervisor.
Apr 12 12:35:18 user nova-compute[71321]: DEBUG nova.compute.manager [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:35:18 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:35:18 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:35:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c24566ee-48cd-4cc4-aaea-28b1eae34fad/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe72c043-e035-4926-8f7f-455285f0dbe8/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:18 user nova-compute[71321]: INFO nova.compute.manager [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Took 7.20 seconds to build instance.
Apr 12 12:35:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "c24566ee-48cd-4cc4-aaea-28b1eae34fad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.293s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe72c043-e035-4926-8f7f-455285f0dbe8/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe72c043-e035-4926-8f7f-455285f0dbe8/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe72c043-e035-4926-8f7f-455285f0dbe8/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:19 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:35:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:35:20 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:35:20 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:35:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=7217MB free_disk=26.408336639404297GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:35:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 10116da0-785c-41cf-96bb-95721af863db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:35:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance a4107f2d-88e4-4846-9ece-cb16ad7ecd02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:35:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:35:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 839e85a2-f7af-482d-a5e6-09195888300e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:35:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:35:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance cda12475-d730-4c07-af54-a3a64482fc94 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:35:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance c5b9b1bb-a3d9-4073-8d49-70360dae6f29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:35:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 8403a098-a141-4feb-9eed-3731e2c7c152 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:35:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:35:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 239b22bb-d381-4bd3-9b73-642f174d7664 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:35:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance fe72c043-e035-4926-8f7f-455285f0dbe8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:35:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance fa011231-049f-40c3-89c0-53447a35752f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:35:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance c24566ee-48cd-4cc4-aaea-28b1eae34fad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:35:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:35:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=2176MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:35:21 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:35:21 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:35:21 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:35:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.660s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:22 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:35:22 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:35:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-a4107f2d-88e4-4846-9ece-cb16ad7ecd02" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:35:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-a4107f2d-88e4-4846-9ece-cb16ad7ecd02" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:35:22 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 12:35:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:22 user nova-compute[71321]: DEBUG nova.objects.instance [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lazy-loading 'flavor' on Instance uuid d584edf2-12e3-48d1-947f-fdfb0c9c7377 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:35:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:22 user nova-compute[71321]: INFO nova.compute.manager [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Attaching volume 6674cb31-cc82-4f02-97db-d65b7c87c844 to /dev/vdb
Apr 12 12:35:22 user nova-compute[71321]: DEBUG os_brick.utils [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:35:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:22 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ffca40-8f13-48bb-abdb-15ae416b825e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:22 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffcedfb-48f8-4ab1-a69d-64064fe44151]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:22 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0393e1-bb00-4237-b052-ef38d777bac9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:22 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbaf1e59-fb82-47a9-8a7e-b0f24a2393bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:35:22 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:35:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:35:22 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:35:22 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db60a96-cb77-4faf-9125-cfe935f49cc2]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:22 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:35:22 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:35:22 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:35:22 user nova-compute[71321]: DEBUG os_brick.utils [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:35:22 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Updating existing volume attachment record: 40c267cb-a20d-4ba9-ad48-5d36e28fddd4 {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:35:23 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Updating instance_info_cache with network_info: [{"id": "5680054b-9363-4825-ade2-add800d7142b", "address": "fa:16:3e:08:27:b7", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5680054b-93", "ovs_interfaceid": "5680054b-9363-4825-ade2-add800d7142b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:35:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-a4107f2d-88e4-4846-9ece-cb16ad7ecd02" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:35:23 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 12:35:23 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:35:23 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:35:23 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:35:23 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:35:23 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:35:23 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:35:23 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:35:24 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:24 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:35:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rjwNCiBZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:35:27 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:35:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:35:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:35:27 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:35:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:35:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:35:27 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:35:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844 -p 172.16.0.220:3260" returned: 21 in 0.032s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3367ef-4952-4610-98ec-e239ba311cf9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:35:27 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:35:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.038s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6667805e-5a89-4fd1-b3a9-f855dfdc38fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844] added
Apr 12 12:35:27 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:35:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77d00c5-7959-4634-93fe-38ffab494359]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:35:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[516ddaf2-3586-4d9d-981e-30ee66101ad7]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:35:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rjwNCiBZ {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rjwNCiBZ" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[182f877f-fb42-46fc-9fa1-2f17f61bff0a]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rjwNCiBZ'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:35:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb914ea-a706-4ac5-8c06-8b7e7ef1a774]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:35:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:28 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c7981c-807f-4eee-9760-d9efab7d8a8d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:35:28 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:35:28 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:35:28 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:35:28 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:35:28 user nova-compute[71321]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:35:28 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:35:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:35:28 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:35:28 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:35:28 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:35:28 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:35:28 user nova-compute[71321]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:35:28 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:35:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:28 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65001e5-69f9-4e48-8272-2ca206b99728]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844, portal: 172.16.0.220,3260]
Apr 12 12:35:28 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844, portal: 172.16.0.220,3260] successful.
Apr 12 12:35:28 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:35:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:28 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d54f67b-79ba-4ca5-8453-6857a217621d]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:35:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:28 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[475dca2a-9bcf-4e4e-b66e-78830ffaf1a6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:35:28 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:35:28 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:35:28 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:35:28 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:35:28 user nova-compute[71321]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:35:28 user nova-compute[71321]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844 (non-flash)
Apr 12 12:35:28 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:35:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:35:28 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:35:28 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:35:28 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:35:28 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:35:28 user nova-compute[71321]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:35:28 user nova-compute[71321]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844 (non-flash)
Apr 12 12:35:28 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:35:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:35:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:35:28 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:35:28 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:35:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:28 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f64b6ed-c2fd-4870-ad3c-c05d48bf7efe]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:28 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:35:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rjwNCiBZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:35:29 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:35:29 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23764366230306232', 'path': '/dev/sdd'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:35:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764366230306232', 'path': '/dev/sdd'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:35:29 user nova-compute[71321]: DEBUG nova.objects.instance [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lazy-loading 'flavor' on Instance uuid d584edf2-12e3-48d1-947f-fdfb0c9c7377 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:35:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 12:35:29 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:35:29 user nova-compute[71321]:   <source dev="/dev/sdd"/>
Apr 12 12:35:29 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:35:29 user nova-compute[71321]:   <serial>6674cb31-cc82-4f02-97db-d65b7c87c844</serial>
Apr 12 12:35:29 user nova-compute[71321]: </disk>
Apr 12 12:35:29 user nova-compute[71321]:  {{(pid=71321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 12:35:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:35:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:35:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] No VIF found with MAC fa:16:3e:eb:10:b5, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:35:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.306s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:31 user nova-compute[71321]: INFO nova.compute.manager [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Detaching volume 6674cb31-cc82-4f02-97db-d65b7c87c844
Apr 12 12:35:31 user nova-compute[71321]: INFO nova.virt.block_device [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Attempting to driver detach volume 6674cb31-cc82-4f02-97db-d65b7c87c844 from mountpoint /dev/vdb
Apr 12 12:35:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Attempting to detach device vdb from instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 from the persistent domain config. {{(pid=71321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:35:31 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:35:31 user nova-compute[71321]:   <source dev="/dev/sdd"/>
Apr 12 12:35:31 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:35:31 user nova-compute[71321]:   <serial>6674cb31-cc82-4f02-97db-d65b7c87c844</serial>
Apr 12 12:35:31 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 12:35:31 user nova-compute[71321]: </disk>
Apr 12 12:35:31 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:35:31 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Successfully detached device vdb from instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 from the persistent domain config.
Apr 12 12:35:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 from the live domain config. {{(pid=71321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:35:31 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:35:31 user nova-compute[71321]:   <source dev="/dev/sdd"/>
Apr 12 12:35:31 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:35:31 user nova-compute[71321]:   <serial>6674cb31-cc82-4f02-97db-d65b7c87c844</serial>
Apr 12 12:35:31 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 12:35:31 user nova-compute[71321]: </disk>
Apr 12 12:35:31 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Received event <DeviceRemovedEvent: 1681302931.6230662, d584edf2-12e3-48d1-947f-fdfb0c9c7377 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 {{(pid=71321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 12:35:31 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Successfully detached device vdb from instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 from the live domain config.
Apr 12 12:35:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rjwNCiBZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:35:31 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:35:31 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe2658d-a2bd-4ca5-90cb-eec8be0257d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:35:31 user nova-compute[71321]: No targets found.
Apr 12 12:35:31 user nova-compute[71321]: iSNS:
Apr 12 12:35:31 user nova-compute[71321]: No targets found.
Apr 12 12:35:31 user nova-compute[71321]: STATIC:
Apr 12 12:35:31 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d
Apr 12 12:35:31 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:35:31 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:35:31 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945
Apr 12 12:35:31 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:35:31 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:35:31 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0
Apr 12 12:35:31 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:35:31 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:35:31 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54
Apr 12 12:35:31 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:35:31 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:35:31 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844
Apr 12 12:35:31 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:35:31 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:35:31 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f
Apr 12 12:35:31 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:35:31 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:35:31 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8
Apr 12 12:35:31 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:35:31 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:35:31 user nova-compute[71321]: FIRMWARE:
Apr 12 12:35:31 user nova-compute[71321]: No targets found.
Apr 12 12:35:31 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:35:31 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:35:31 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[90740380-d52c-425e-9e46-8f9b3f584075]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd35ee8f-ec2c-4b7b-9ef4-afb2252942fb]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:35:31 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:35:31 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:35:31 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:35:31 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:35:31 user nova-compute[71321]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:35:31 user nova-compute[71321]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844 (non-flash)
Apr 12 12:35:31 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:35:31 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:35:31 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:35:31 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:35:31 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:35:31 user nova-compute[71321]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:35:31 user nova-compute[71321]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844 (non-flash)
Apr 12 12:35:31 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef44570d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844'): ({'sdd'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Removing single pathed devices sdd {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d40c46-b5e1-4876-904b-041d89c3bfe9]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[321e7313-aa03-42fd-8fd7-a036e9b8fa2b]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Flushing IO for device /dev/sdd {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[362b44cd-7cc5-4c00-b3e8-bacf4402e6a2]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[5658e20a-7e90-4112-b561-0fa7f384f1ad]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] SCSI volumes sdd have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4680d7fc-f1e4-4551-8017-27fae2e13d57]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c67276e-96ed-4eeb-a43a-5b76e64a7d5b]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844, portal: 172.16.0.220,3260]
Apr 12 12:35:31 user nova-compute[71321]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844, portal: 172.16.0.220,3260] successful.
Apr 12 12:35:31 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6674cb31-cc82-4f02-97db-d65b7c87c844 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef152ba-77d9-4e19-9153-fc6a8563508b]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] <== disconnect_volume: return (338ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:35:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:35:32 user nova-compute[71321]: DEBUG nova.objects.instance [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lazy-loading 'flavor' on Instance uuid d584edf2-12e3-48d1-947f-fdfb0c9c7377 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:35:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.829s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:35 user nova-compute[71321]: DEBUG nova.compute.manager [req-3bb77003-5756-4ecf-a723-c8d0e0d73edc req-400fa435-b4a8-4a6d-9324-0b789c4effe1 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-changed-94f43c42-9d4d-4625-b558-4be918b78ffb {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:35 user nova-compute[71321]: DEBUG nova.compute.manager [req-3bb77003-5756-4ecf-a723-c8d0e0d73edc req-400fa435-b4a8-4a6d-9324-0b789c4effe1 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Refreshing instance network info cache due to event network-changed-94f43c42-9d4d-4625-b558-4be918b78ffb. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:35:35 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3bb77003-5756-4ecf-a723-c8d0e0d73edc req-400fa435-b4a8-4a6d-9324-0b789c4effe1 service nova] Acquiring lock "refresh_cache-81cb942b-5bd6-47c4-8130-f5a4d17f10fa" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:35:35 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3bb77003-5756-4ecf-a723-c8d0e0d73edc req-400fa435-b4a8-4a6d-9324-0b789c4effe1 service nova] Acquired lock "refresh_cache-81cb942b-5bd6-47c4-8130-f5a4d17f10fa" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:35:35 user nova-compute[71321]: DEBUG nova.network.neutron [req-3bb77003-5756-4ecf-a723-c8d0e0d73edc req-400fa435-b4a8-4a6d-9324-0b789c4effe1 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Refreshing network info cache for port 94f43c42-9d4d-4625-b558-4be918b78ffb {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:35:35 user nova-compute[71321]: DEBUG nova.network.neutron [req-3bb77003-5756-4ecf-a723-c8d0e0d73edc req-400fa435-b4a8-4a6d-9324-0b789c4effe1 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Updated VIF entry in instance network info cache for port 94f43c42-9d4d-4625-b558-4be918b78ffb. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:35:35 user nova-compute[71321]: DEBUG nova.network.neutron [req-3bb77003-5756-4ecf-a723-c8d0e0d73edc req-400fa435-b4a8-4a6d-9324-0b789c4effe1 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Updating instance_info_cache with network_info: [{"id": "94f43c42-9d4d-4625-b558-4be918b78ffb", "address": "fa:16:3e:08:8e:12", "network": {"id": "255979eb-ff62-4b24-9a5a-06bc3b6da2c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1439583801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f43c42-9d", "ovs_interfaceid": "94f43c42-9d4d-4625-b558-4be918b78ffb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76450ca6-4f7a-4e03-9269-feaacfced76a", "address": "fa:16:3e:73:82:20", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76450ca6-4f", "ovs_interfaceid": "76450ca6-4f7a-4e03-9269-feaacfced76a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5dfbb175-cb83-461e-91da-d7cbde98c3e6", "address": "fa:16:3e:cf:39:d7", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dfbb175-cb", "ovs_interfaceid": "5dfbb175-cb83-461e-91da-d7cbde98c3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a995fb4-7c9a-443c-a66a-47c04d7862ea", "address": "fa:16:3e:24:fd:5a", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a995fb4-7c", "ovs_interfaceid": "4a995fb4-7c9a-443c-a66a-47c04d7862ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "501229b8-6d04-45a8-97df-927b8ec14ca3", "address": "fa:16:3e:b5:8f:dc", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap501229b8-6d", "ovs_interfaceid": "501229b8-6d04-45a8-97df-927b8ec14ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e59fa8d8-7765-453d-a135-0abe5f1cae78", "address": "fa:16:3e:6c:6f:97", "network": {"id": "d2127306-286f-42cb-9dcf-1b4c2e4a9861", "bridge": "br-int", "label": "tempest-device-tagging-net2-1354193313", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape59fa8d8-77", "ovs_interfaceid": "e59fa8d8-7765-453d-a135-0abe5f1cae78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bad3a184-db6f-4d2d-ac53-f1155fcf0fe1", "address": "fa:16:3e:e0:e2:20", "network": {"id": "d2127306-286f-42cb-9dcf-1b4c2e4a9861", "bridge": "br-int", "label": "tempest-device-tagging-net2-1354193313", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad3a184-db", "ovs_interfaceid": "bad3a184-db6f-4d2d-ac53-f1155fcf0fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:35:35 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3bb77003-5756-4ecf-a723-c8d0e0d73edc req-400fa435-b4a8-4a6d-9324-0b789c4effe1 service nova] Releasing lock "refresh_cache-81cb942b-5bd6-47c4-8130-f5a4d17f10fa" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:35:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:36 user nova-compute[71321]: INFO nova.compute.manager [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Terminating instance
Apr 12 12:35:36 user nova-compute[71321]: DEBUG nova.compute.manager [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:35:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:37 user nova-compute[71321]: DEBUG nova.compute.manager [req-ac9335c9-5f4c-4948-9b8d-22b626f8f0a1 req-bd54edd0-e235-4ee7-8c6b-9b25aaee0749 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-unplugged-94f43c42-9d4d-4625-b558-4be918b78ffb {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ac9335c9-5f4c-4948-9b8d-22b626f8f0a1 req-bd54edd0-e235-4ee7-8c6b-9b25aaee0749 service nova] Acquiring lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ac9335c9-5f4c-4948-9b8d-22b626f8f0a1 req-bd54edd0-e235-4ee7-8c6b-9b25aaee0749 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ac9335c9-5f4c-4948-9b8d-22b626f8f0a1 req-bd54edd0-e235-4ee7-8c6b-9b25aaee0749 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:37 user nova-compute[71321]: DEBUG nova.compute.manager [req-ac9335c9-5f4c-4948-9b8d-22b626f8f0a1 req-bd54edd0-e235-4ee7-8c6b-9b25aaee0749 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] No waiting events found dispatching network-vif-unplugged-94f43c42-9d4d-4625-b558-4be918b78ffb {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:35:37 user nova-compute[71321]: DEBUG nova.compute.manager [req-ac9335c9-5f4c-4948-9b8d-22b626f8f0a1 req-bd54edd0-e235-4ee7-8c6b-9b25aaee0749 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-unplugged-94f43c42-9d4d-4625-b558-4be918b78ffb for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:35:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:37 user nova-compute[71321]: DEBUG nova.compute.manager [req-1730949b-ba37-478b-b40f-159f90491e37 req-aa764b35-7d16-46f2-92d7-07043775216c service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-unplugged-501229b8-6d04-45a8-97df-927b8ec14ca3 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-1730949b-ba37-478b-b40f-159f90491e37 req-aa764b35-7d16-46f2-92d7-07043775216c service nova] Acquiring lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-1730949b-ba37-478b-b40f-159f90491e37 req-aa764b35-7d16-46f2-92d7-07043775216c service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-1730949b-ba37-478b-b40f-159f90491e37 req-aa764b35-7d16-46f2-92d7-07043775216c service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:37 user nova-compute[71321]: DEBUG nova.compute.manager [req-1730949b-ba37-478b-b40f-159f90491e37 req-aa764b35-7d16-46f2-92d7-07043775216c service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] No waiting events found dispatching network-vif-unplugged-501229b8-6d04-45a8-97df-927b8ec14ca3 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:35:37 user nova-compute[71321]: DEBUG nova.compute.manager [req-1730949b-ba37-478b-b40f-159f90491e37 req-aa764b35-7d16-46f2-92d7-07043775216c service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-unplugged-501229b8-6d04-45a8-97df-927b8ec14ca3 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:35:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:38 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Instance destroyed successfully.
Apr 12 12:35:38 user nova-compute[71321]: DEBUG nova.objects.instance [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lazy-loading 'resources' on Instance uuid 81cb942b-5bd6-47c4-8130-f5a4d17f10fa {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:33:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-256759259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-256759259',id=19,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxNMexTFhDz2xFUAc4wGA58bVNqR+Fa59qGoEiKr99V0q4IOgnoQTzSr7XTI3nk5SwdCrf8QdfX2WZWlW4pIaFx6quZwUHVtAENs6MteuKUONpmPxi7z1AGiMPLRGF49A==',key_name='tempest-keypair-2067665587',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:34:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f89f1f2dba8e4325b550ad91403e60ad',ramdisk_id='',reservation_id='r-mobcfx4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-602948185',owner_user_name='tempest-TaggedBootDevicesTest_v242-602948185-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:34:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e17bc9d4cf743c19f9493d30b62fc16',uuid=81cb942b-5bd6-47c4-8130-f5a4d17f10fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94f43c42-9d4d-4625-b558-4be918b78ffb", "address": "fa:16:3e:08:8e:12", "network": {"id": "255979eb-ff62-4b24-9a5a-06bc3b6da2c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1439583801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f43c42-9d", "ovs_interfaceid": "94f43c42-9d4d-4625-b558-4be918b78ffb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converting VIF {"id": "94f43c42-9d4d-4625-b558-4be918b78ffb", "address": "fa:16:3e:08:8e:12", "network": {"id": "255979eb-ff62-4b24-9a5a-06bc3b6da2c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1439583801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f43c42-9d", "ovs_interfaceid": "94f43c42-9d4d-4625-b558-4be918b78ffb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:8e:12,bridge_name='br-int',has_traffic_filtering=True,id=94f43c42-9d4d-4625-b558-4be918b78ffb,network=Network(255979eb-ff62-4b24-9a5a-06bc3b6da2c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94f43c42-9d') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG os_vif [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:8e:12,bridge_name='br-int',has_traffic_filtering=True,id=94f43c42-9d4d-4625-b558-4be918b78ffb,network=Network(255979eb-ff62-4b24-9a5a-06bc3b6da2c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94f43c42-9d') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94f43c42-9d, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:38 user nova-compute[71321]: INFO os_vif [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:8e:12,bridge_name='br-int',has_traffic_filtering=True,id=94f43c42-9d4d-4625-b558-4be918b78ffb,network=Network(255979eb-ff62-4b24-9a5a-06bc3b6da2c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94f43c42-9d')
Apr 12 12:35:38 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:33:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-256759259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-256759259',id=19,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxNMexTFhDz2xFUAc4wGA58bVNqR+Fa59qGoEiKr99V0q4IOgnoQTzSr7XTI3nk5SwdCrf8QdfX2WZWlW4pIaFx6quZwUHVtAENs6MteuKUONpmPxi7z1AGiMPLRGF49A==',key_name='tempest-keypair-2067665587',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:34:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f89f1f2dba8e4325b550ad91403e60ad',ramdisk_id='',reservation_id='r-mobcfx4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-602948185',owner_user_name='tempest-TaggedBootDevicesTest_v242-602948185-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:34:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e17bc9d4cf743c19f9493d30b62fc16',uuid=81cb942b-5bd6-47c4-8130-f5a4d17f10fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76450ca6-4f7a-4e03-9269-feaacfced76a", "address": "fa:16:3e:73:82:20", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76450ca6-4f", "ovs_interfaceid": "76450ca6-4f7a-4e03-9269-feaacfced76a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converting VIF {"id": "76450ca6-4f7a-4e03-9269-feaacfced76a", "address": "fa:16:3e:73:82:20", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76450ca6-4f", "ovs_interfaceid": "76450ca6-4f7a-4e03-9269-feaacfced76a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:82:20,bridge_name='br-int',has_traffic_filtering=True,id=76450ca6-4f7a-4e03-9269-feaacfced76a,network=Network(cdff297b-c932-49f5-8f91-31b7a475af78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap76450ca6-4f') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG os_vif [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:82:20,bridge_name='br-int',has_traffic_filtering=True,id=76450ca6-4f7a-4e03-9269-feaacfced76a,network=Network(cdff297b-c932-49f5-8f91-31b7a475af78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap76450ca6-4f') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76450ca6-4f, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:38 user nova-compute[71321]: INFO os_vif [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:82:20,bridge_name='br-int',has_traffic_filtering=True,id=76450ca6-4f7a-4e03-9269-feaacfced76a,network=Network(cdff297b-c932-49f5-8f91-31b7a475af78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap76450ca6-4f')
Apr 12 12:35:38 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:33:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-256759259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-256759259',id=19,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxNMexTFhDz2xFUAc4wGA58bVNqR+Fa59qGoEiKr99V0q4IOgnoQTzSr7XTI3nk5SwdCrf8QdfX2WZWlW4pIaFx6quZwUHVtAENs6MteuKUONpmPxi7z1AGiMPLRGF49A==',key_name='tempest-keypair-2067665587',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:34:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f89f1f2dba8e4325b550ad91403e60ad',ramdisk_id='',reservation_id='r-mobcfx4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-602948185',owner_user_name='tempest-TaggedBootDevicesTest_v242-602948185-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:34:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e17bc9d4cf743c19f9493d30b62fc16',uuid=81cb942b-5bd6-47c4-8130-f5a4d17f10fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5dfbb175-cb83-461e-91da-d7cbde98c3e6", "address": "fa:16:3e:cf:39:d7", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dfbb175-cb", "ovs_interfaceid": "5dfbb175-cb83-461e-91da-d7cbde98c3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converting VIF {"id": "5dfbb175-cb83-461e-91da-d7cbde98c3e6", "address": "fa:16:3e:cf:39:d7", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dfbb175-cb", "ovs_interfaceid": "5dfbb175-cb83-461e-91da-d7cbde98c3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:39:d7,bridge_name='br-int',has_traffic_filtering=True,id=5dfbb175-cb83-461e-91da-d7cbde98c3e6,network=Network(cdff297b-c932-49f5-8f91-31b7a475af78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5dfbb175-cb') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG os_vif [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:39:d7,bridge_name='br-int',has_traffic_filtering=True,id=5dfbb175-cb83-461e-91da-d7cbde98c3e6,network=Network(cdff297b-c932-49f5-8f91-31b7a475af78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5dfbb175-cb') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5dfbb175-cb, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:38 user nova-compute[71321]: INFO os_vif [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:39:d7,bridge_name='br-int',has_traffic_filtering=True,id=5dfbb175-cb83-461e-91da-d7cbde98c3e6,network=Network(cdff297b-c932-49f5-8f91-31b7a475af78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5dfbb175-cb')
Apr 12 12:35:38 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:33:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-256759259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-256759259',id=19,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxNMexTFhDz2xFUAc4wGA58bVNqR+Fa59qGoEiKr99V0q4IOgnoQTzSr7XTI3nk5SwdCrf8QdfX2WZWlW4pIaFx6quZwUHVtAENs6MteuKUONpmPxi7z1AGiMPLRGF49A==',key_name='tempest-keypair-2067665587',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:34:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f89f1f2dba8e4325b550ad91403e60ad',ramdisk_id='',reservation_id='r-mobcfx4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-602948185',owner_user_name='tempest-TaggedBootDevicesTest_v242-602948185-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:34:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e17bc9d4cf743c19f9493d30b62fc16',uuid=81cb942b-5bd6-47c4-8130-f5a4d17f10fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a995fb4-7c9a-443c-a66a-47c04d7862ea", "address": "fa:16:3e:24:fd:5a", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a995fb4-7c", "ovs_interfaceid": "4a995fb4-7c9a-443c-a66a-47c04d7862ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converting VIF {"id": "4a995fb4-7c9a-443c-a66a-47c04d7862ea", "address": "fa:16:3e:24:fd:5a", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a995fb4-7c", "ovs_interfaceid": "4a995fb4-7c9a-443c-a66a-47c04d7862ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:fd:5a,bridge_name='br-int',has_traffic_filtering=True,id=4a995fb4-7c9a-443c-a66a-47c04d7862ea,network=Network(cdff297b-c932-49f5-8f91-31b7a475af78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a995fb4-7c') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG os_vif [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:fd:5a,bridge_name='br-int',has_traffic_filtering=True,id=4a995fb4-7c9a-443c-a66a-47c04d7862ea,network=Network(cdff297b-c932-49f5-8f91-31b7a475af78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a995fb4-7c') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a995fb4-7c, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:38 user nova-compute[71321]: INFO os_vif [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:fd:5a,bridge_name='br-int',has_traffic_filtering=True,id=4a995fb4-7c9a-443c-a66a-47c04d7862ea,network=Network(cdff297b-c932-49f5-8f91-31b7a475af78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a995fb4-7c')
Apr 12 12:35:38 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:33:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-256759259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-256759259',id=19,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxNMexTFhDz2xFUAc4wGA58bVNqR+Fa59qGoEiKr99V0q4IOgnoQTzSr7XTI3nk5SwdCrf8QdfX2WZWlW4pIaFx6quZwUHVtAENs6MteuKUONpmPxi7z1AGiMPLRGF49A==',key_name='tempest-keypair-2067665587',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:34:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f89f1f2dba8e4325b550ad91403e60ad',ramdisk_id='',reservation_id='r-mobcfx4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-602948185',owner_user_name='tempest-TaggedBootDevicesTest_v242-602948185-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:34:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e17bc9d4cf743c19f9493d30b62fc16',uuid=81cb942b-5bd6-47c4-8130-f5a4d17f10fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "501229b8-6d04-45a8-97df-927b8ec14ca3", "address": "fa:16:3e:b5:8f:dc", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap501229b8-6d", "ovs_interfaceid": "501229b8-6d04-45a8-97df-927b8ec14ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converting VIF {"id": "501229b8-6d04-45a8-97df-927b8ec14ca3", "address": "fa:16:3e:b5:8f:dc", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap501229b8-6d", "ovs_interfaceid": "501229b8-6d04-45a8-97df-927b8ec14ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:8f:dc,bridge_name='br-int',has_traffic_filtering=True,id=501229b8-6d04-45a8-97df-927b8ec14ca3,network=Network(cdff297b-c932-49f5-8f91-31b7a475af78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap501229b8-6d') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG os_vif [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:8f:dc,bridge_name='br-int',has_traffic_filtering=True,id=501229b8-6d04-45a8-97df-927b8ec14ca3,network=Network(cdff297b-c932-49f5-8f91-31b7a475af78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap501229b8-6d') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap501229b8-6d, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:38 user nova-compute[71321]: INFO os_vif [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:8f:dc,bridge_name='br-int',has_traffic_filtering=True,id=501229b8-6d04-45a8-97df-927b8ec14ca3,network=Network(cdff297b-c932-49f5-8f91-31b7a475af78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap501229b8-6d')
Apr 12 12:35:38 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:33:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-256759259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-256759259',id=19,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxNMexTFhDz2xFUAc4wGA58bVNqR+Fa59qGoEiKr99V0q4IOgnoQTzSr7XTI3nk5SwdCrf8QdfX2WZWlW4pIaFx6quZwUHVtAENs6MteuKUONpmPxi7z1AGiMPLRGF49A==',key_name='tempest-keypair-2067665587',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:34:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f89f1f2dba8e4325b550ad91403e60ad',ramdisk_id='',reservation_id='r-mobcfx4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-602948185',owner_user_name='tempest-TaggedBootDevicesTest_v242-602948185-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:34:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e17bc9d4cf743c19f9493d30b62fc16',uuid=81cb942b-5bd6-47c4-8130-f5a4d17f10fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e59fa8d8-7765-453d-a135-0abe5f1cae78", "address": "fa:16:3e:6c:6f:97", "network": {"id": "d2127306-286f-42cb-9dcf-1b4c2e4a9861", "bridge": "br-int", "label": "tempest-device-tagging-net2-1354193313", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape59fa8d8-77", "ovs_interfaceid": "e59fa8d8-7765-453d-a135-0abe5f1cae78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converting VIF {"id": "e59fa8d8-7765-453d-a135-0abe5f1cae78", "address": "fa:16:3e:6c:6f:97", "network": {"id": "d2127306-286f-42cb-9dcf-1b4c2e4a9861", "bridge": "br-int", "label": "tempest-device-tagging-net2-1354193313", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape59fa8d8-77", "ovs_interfaceid": "e59fa8d8-7765-453d-a135-0abe5f1cae78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:6f:97,bridge_name='br-int',has_traffic_filtering=True,id=e59fa8d8-7765-453d-a135-0abe5f1cae78,network=Network(d2127306-286f-42cb-9dcf-1b4c2e4a9861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape59fa8d8-77') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG os_vif [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:6f:97,bridge_name='br-int',has_traffic_filtering=True,id=e59fa8d8-7765-453d-a135-0abe5f1cae78,network=Network(d2127306-286f-42cb-9dcf-1b4c2e4a9861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape59fa8d8-77') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape59fa8d8-77, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:38 user nova-compute[71321]: INFO os_vif [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:6f:97,bridge_name='br-int',has_traffic_filtering=True,id=e59fa8d8-7765-453d-a135-0abe5f1cae78,network=Network(d2127306-286f-42cb-9dcf-1b4c2e4a9861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape59fa8d8-77')
Apr 12 12:35:38 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T12:33:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-256759259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-256759259',id=19,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxNMexTFhDz2xFUAc4wGA58bVNqR+Fa59qGoEiKr99V0q4IOgnoQTzSr7XTI3nk5SwdCrf8QdfX2WZWlW4pIaFx6quZwUHVtAENs6MteuKUONpmPxi7z1AGiMPLRGF49A==',key_name='tempest-keypair-2067665587',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:34:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f89f1f2dba8e4325b550ad91403e60ad',ramdisk_id='',reservation_id='r-mobcfx4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-602948185',owner_user_name='tempest-TaggedBootDevicesTest_v242-602948185-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:34:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e17bc9d4cf743c19f9493d30b62fc16',uuid=81cb942b-5bd6-47c4-8130-f5a4d17f10fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bad3a184-db6f-4d2d-ac53-f1155fcf0fe1", "address": "fa:16:3e:e0:e2:20", "network": {"id": "d2127306-286f-42cb-9dcf-1b4c2e4a9861", "bridge": "br-int", "label": "tempest-device-tagging-net2-1354193313", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad3a184-db", "ovs_interfaceid": "bad3a184-db6f-4d2d-ac53-f1155fcf0fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converting VIF {"id": "bad3a184-db6f-4d2d-ac53-f1155fcf0fe1", "address": "fa:16:3e:e0:e2:20", "network": {"id": "d2127306-286f-42cb-9dcf-1b4c2e4a9861", "bridge": "br-int", "label": "tempest-device-tagging-net2-1354193313", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad3a184-db", "ovs_interfaceid": "bad3a184-db6f-4d2d-ac53-f1155fcf0fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e2:20,bridge_name='br-int',has_traffic_filtering=True,id=bad3a184-db6f-4d2d-ac53-f1155fcf0fe1,network=Network(d2127306-286f-42cb-9dcf-1b4c2e4a9861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad3a184-db') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG os_vif [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e2:20,bridge_name='br-int',has_traffic_filtering=True,id=bad3a184-db6f-4d2d-ac53-f1155fcf0fe1,network=Network(d2127306-286f-42cb-9dcf-1b4c2e4a9861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad3a184-db') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbad3a184-db, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:35:38 user nova-compute[71321]: INFO os_vif [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e2:20,bridge_name='br-int',has_traffic_filtering=True,id=bad3a184-db6f-4d2d-ac53-f1155fcf0fe1,network=Network(d2127306-286f-42cb-9dcf-1b4c2e4a9861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad3a184-db')
Apr 12 12:35:38 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kMLsNoeY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:35:38 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:35:38 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7871f5d-6b40-4d1a-96f2-b69483bdb8c0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:35:38 user nova-compute[71321]: No targets found.
Apr 12 12:35:38 user nova-compute[71321]: iSNS:
Apr 12 12:35:38 user nova-compute[71321]: No targets found.
Apr 12 12:35:38 user nova-compute[71321]: STATIC:
Apr 12 12:35:38 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d
Apr 12 12:35:38 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:35:38 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:35:38 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945
Apr 12 12:35:38 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:35:38 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:35:38 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0
Apr 12 12:35:38 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:35:38 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:35:38 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54
Apr 12 12:35:38 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:35:38 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:35:38 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f
Apr 12 12:35:38 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:35:38 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:35:38 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8
Apr 12 12:35:38 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:35:38 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:35:38 user nova-compute[71321]: FIRMWARE:
Apr 12 12:35:38 user nova-compute[71321]: No targets found.
Apr 12 12:35:38 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:35:38 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:35:38 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afdf0ef-4b27-44df-a2a6-57133d870703]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4aa5de2-c9e5-4c02-b04c-83ebee5d1f48]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:35:38 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:35:38 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:35:38 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:35:38 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:35:38 user nova-compute[71321]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:35:38 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:35:38 user nova-compute[71321]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d (non-flash)
Apr 12 12:35:38 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:35:38 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:35:38 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:35:38 user nova-compute[71321]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:35:38 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef64222440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d'): ({'sde'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Removing single pathed devices sde {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[91039489-752f-4b43-8e20-a771c3be43f9]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1c09d7-f31b-4823-91d0-09c1eec330e9]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Flushing IO for device /dev/sde {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de39897-05ff-40f6-bec8-c1541741d697]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ea73b8-a057-4b29-b4c0-4147769ed82c]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] SCSI volumes sde have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1da7091-aa05-4fed-96ad-8c159259e1dc]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8737f5d9-01a5-410f-9f8c-8e1bf431a728]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d, portal: 172.16.0.220,3260]
Apr 12 12:35:38 user nova-compute[71321]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d, portal: 172.16.0.220,3260] successful.
Apr 12 12:35:38 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:35:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc1d81b-c5d9-4267-8903-49a6a28c92e4]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] <== disconnect_volume: return (318ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UEzQqwmP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:35:39 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc743a46-bcf6-4cb0-8e90-d64435438ca1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:35:39 user nova-compute[71321]: No targets found.
Apr 12 12:35:39 user nova-compute[71321]: iSNS:
Apr 12 12:35:39 user nova-compute[71321]: No targets found.
Apr 12 12:35:39 user nova-compute[71321]: STATIC:
Apr 12 12:35:39 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945
Apr 12 12:35:39 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:35:39 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:35:39 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0
Apr 12 12:35:39 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:35:39 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:35:39 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54
Apr 12 12:35:39 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:35:39 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:35:39 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f
Apr 12 12:35:39 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:35:39 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:35:39 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8
Apr 12 12:35:39 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:35:39 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:35:39 user nova-compute[71321]: FIRMWARE:
Apr 12 12:35:39 user nova-compute[71321]: No targets found.
Apr 12 12:35:39 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:35:39 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:35:39 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-plugged-94f43c42-9d4d-4625-b558-4be918b78ffb {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Acquiring lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] No waiting events found dispatching network-vif-plugged-94f43c42-9d4d-4625-b558-4be918b78ffb {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:35:39 user nova-compute[71321]: WARNING nova.compute.manager [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received unexpected event network-vif-plugged-94f43c42-9d4d-4625-b558-4be918b78ffb for instance with vm_state active and task_state deleting.
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-unplugged-76450ca6-4f7a-4e03-9269-feaacfced76a {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Acquiring lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] No waiting events found dispatching network-vif-unplugged-76450ca6-4f7a-4e03-9269-feaacfced76a {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-unplugged-76450ca6-4f7a-4e03-9269-feaacfced76a for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-plugged-76450ca6-4f7a-4e03-9269-feaacfced76a {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Acquiring lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] No waiting events found dispatching network-vif-plugged-76450ca6-4f7a-4e03-9269-feaacfced76a {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:35:39 user nova-compute[71321]: WARNING nova.compute.manager [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received unexpected event network-vif-plugged-76450ca6-4f7a-4e03-9269-feaacfced76a for instance with vm_state active and task_state deleting.
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-unplugged-5dfbb175-cb83-461e-91da-d7cbde98c3e6 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Acquiring lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] No waiting events found dispatching network-vif-unplugged-5dfbb175-cb83-461e-91da-d7cbde98c3e6 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-unplugged-5dfbb175-cb83-461e-91da-d7cbde98c3e6 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-plugged-5dfbb175-cb83-461e-91da-d7cbde98c3e6 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Acquiring lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] No waiting events found dispatching network-vif-plugged-5dfbb175-cb83-461e-91da-d7cbde98c3e6 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:35:39 user nova-compute[71321]: WARNING nova.compute.manager [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received unexpected event network-vif-plugged-5dfbb175-cb83-461e-91da-d7cbde98c3e6 for instance with vm_state active and task_state deleting.
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-unplugged-4a995fb4-7c9a-443c-a66a-47c04d7862ea {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Acquiring lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] No waiting events found dispatching network-vif-unplugged-4a995fb4-7c9a-443c-a66a-47c04d7862ea {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-unplugged-4a995fb4-7c9a-443c-a66a-47c04d7862ea for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-plugged-4a995fb4-7c9a-443c-a66a-47c04d7862ea {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Acquiring lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] No waiting events found dispatching network-vif-plugged-4a995fb4-7c9a-443c-a66a-47c04d7862ea {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:35:39 user nova-compute[71321]: WARNING nova.compute.manager [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received unexpected event network-vif-plugged-4a995fb4-7c9a-443c-a66a-47c04d7862ea for instance with vm_state active and task_state deleting.
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-unplugged-bad3a184-db6f-4d2d-ac53-f1155fcf0fe1 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Acquiring lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] No waiting events found dispatching network-vif-unplugged-bad3a184-db6f-4d2d-ac53-f1155fcf0fe1 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-unplugged-bad3a184-db6f-4d2d-ac53-f1155fcf0fe1 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-plugged-bad3a184-db6f-4d2d-ac53-f1155fcf0fe1 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Acquiring lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] No waiting events found dispatching network-vif-plugged-bad3a184-db6f-4d2d-ac53-f1155fcf0fe1 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:35:39 user nova-compute[71321]: WARNING nova.compute.manager [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received unexpected event network-vif-plugged-bad3a184-db6f-4d2d-ac53-f1155fcf0fe1 for instance with vm_state active and task_state deleting.
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0e791c-4bac-4eb7-a7da-4a3854bcfce0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[af484365-3ac0-4614-8f74-a8bcc966081b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:35:39 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:35:39 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:35:39 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:35:39 user nova-compute[71321]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:35:39 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:35:39 user nova-compute[71321]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 (non-flash)
Apr 12 12:35:39 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:35:39 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:35:39 user nova-compute[71321]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:35:39 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef446b44c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8'): ({'sdf'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Removing single pathed devices sdf {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a857b983-f5aa-4494-9d17-2592bde2cc6a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e8ed6c-47d8-499d-8b7b-f0b448918542]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Flushing IO for device /dev/sdf {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca29c35c-9a8e-4a5f-999d-ff1a0ece5a87]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd0f35b-5711-456f-b054-d9b734edcd8c]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] SCSI volumes sdf have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[65356dec-907d-4019-ae8f-e9e277c8c547]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99477a0-ff89-4331-83ae-73f460193128]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8, portal: 172.16.0.220,3260]
Apr 12 12:35:39 user nova-compute[71321]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8, portal: 172.16.0.220,3260] successful.
Apr 12 12:35:39 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ae34a9-43d0-4111-84c5-370193d88db8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c401c9-7394-48f1-bd1f-ded8880e8ebd]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] <== disconnect_volume: return (368ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QWCjzXJI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:35:39 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2a3f6b-7fb6-4d34-973f-3789f15145f8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:35:39 user nova-compute[71321]: No targets found.
Apr 12 12:35:39 user nova-compute[71321]: iSNS:
Apr 12 12:35:39 user nova-compute[71321]: No targets found.
Apr 12 12:35:39 user nova-compute[71321]: STATIC:
Apr 12 12:35:39 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945
Apr 12 12:35:39 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:35:39 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:35:39 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0
Apr 12 12:35:39 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:35:39 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:35:39 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54
Apr 12 12:35:39 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:35:39 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:35:39 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f
Apr 12 12:35:39 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:35:39 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:35:39 user nova-compute[71321]: FIRMWARE:
Apr 12 12:35:39 user nova-compute[71321]: No targets found.
Apr 12 12:35:39 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:35:39 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:35:39 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[921ff1f0-5ce2-48b5-ac66-c55f80e1628c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c15423-64bb-440a-a477-8fb482d9bb30]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:35:39 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:35:39 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:35:39 user nova-compute[71321]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:35:39 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:35:39 user nova-compute[71321]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f (non-flash)
Apr 12 12:35:39 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:35:39 user nova-compute[71321]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:35:39 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef8a06c670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f'): ({'sdg'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Removing single pathed devices sdg {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e915d652-fd81-4e61-bf43-e0007b72b460]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7885834a-b1da-4448-942b-566e6329ad01]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Flushing IO for device /dev/sdg {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-4dff8140-c171-4108-835f-104f165801de req-32a1a639-210a-4eb4-89b2-f3c8beee408d service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-plugged-501229b8-6d04-45a8-97df-927b8ec14ca3 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4dff8140-c171-4108-835f-104f165801de req-32a1a639-210a-4eb4-89b2-f3c8beee408d service nova] Acquiring lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4dff8140-c171-4108-835f-104f165801de req-32a1a639-210a-4eb4-89b2-f3c8beee408d service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4dff8140-c171-4108-835f-104f165801de req-32a1a639-210a-4eb4-89b2-f3c8beee408d service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-4dff8140-c171-4108-835f-104f165801de req-32a1a639-210a-4eb4-89b2-f3c8beee408d service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] No waiting events found dispatching network-vif-plugged-501229b8-6d04-45a8-97df-927b8ec14ca3 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:35:39 user nova-compute[71321]: WARNING nova.compute.manager [req-4dff8140-c171-4108-835f-104f165801de req-32a1a639-210a-4eb4-89b2-f3c8beee408d service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received unexpected event network-vif-plugged-501229b8-6d04-45a8-97df-927b8ec14ca3 for instance with vm_state active and task_state deleting.
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-4dff8140-c171-4108-835f-104f165801de req-32a1a639-210a-4eb4-89b2-f3c8beee408d service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-unplugged-e59fa8d8-7765-453d-a135-0abe5f1cae78 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4dff8140-c171-4108-835f-104f165801de req-32a1a639-210a-4eb4-89b2-f3c8beee408d service nova] Acquiring lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4dff8140-c171-4108-835f-104f165801de req-32a1a639-210a-4eb4-89b2-f3c8beee408d service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4dff8140-c171-4108-835f-104f165801de req-32a1a639-210a-4eb4-89b2-f3c8beee408d service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-4dff8140-c171-4108-835f-104f165801de req-32a1a639-210a-4eb4-89b2-f3c8beee408d service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] No waiting events found dispatching network-vif-unplugged-e59fa8d8-7765-453d-a135-0abe5f1cae78 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-4dff8140-c171-4108-835f-104f165801de req-32a1a639-210a-4eb4-89b2-f3c8beee408d service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-unplugged-e59fa8d8-7765-453d-a135-0abe5f1cae78 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-4dff8140-c171-4108-835f-104f165801de req-32a1a639-210a-4eb4-89b2-f3c8beee408d service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-plugged-e59fa8d8-7765-453d-a135-0abe5f1cae78 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4dff8140-c171-4108-835f-104f165801de req-32a1a639-210a-4eb4-89b2-f3c8beee408d service nova] Acquiring lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4dff8140-c171-4108-835f-104f165801de req-32a1a639-210a-4eb4-89b2-f3c8beee408d service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4dff8140-c171-4108-835f-104f165801de req-32a1a639-210a-4eb4-89b2-f3c8beee408d service nova] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-4dff8140-c171-4108-835f-104f165801de req-32a1a639-210a-4eb4-89b2-f3c8beee408d service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] No waiting events found dispatching network-vif-plugged-e59fa8d8-7765-453d-a135-0abe5f1cae78 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:35:39 user nova-compute[71321]: WARNING nova.compute.manager [req-4dff8140-c171-4108-835f-104f165801de req-32a1a639-210a-4eb4-89b2-f3c8beee408d service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received unexpected event network-vif-plugged-e59fa8d8-7765-453d-a135-0abe5f1cae78 for instance with vm_state active and task_state deleting.
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[757d5085-b7b1-473d-82c7-fcc2912fc252]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4253f27a-2931-4406-ab88-9a3532616fa2]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] SCSI volumes sdg have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f57508-625b-464b-8783-1e029c84e94e]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ce4639-8c20-4425-8625-73804e425c00]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f, portal: 172.16.0.220,3260]
Apr 12 12:35:39 user nova-compute[71321]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f, portal: 172.16.0.220,3260] successful.
Apr 12 12:35:39 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82dcc4b0-743f-4c37-97fc-757dae433d0f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ffd7c2-9b62-4839-a4ee-01fde69c9430]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] <== disconnect_volume: return (311ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:35:39 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Deleting instance files /opt/stack/data/nova/instances/81cb942b-5bd6-47c4-8130-f5a4d17f10fa_del
Apr 12 12:35:39 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Deletion of /opt/stack/data/nova/instances/81cb942b-5bd6-47c4-8130-f5a4d17f10fa_del complete
Apr 12 12:35:39 user nova-compute[71321]: INFO nova.compute.manager [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Took 3.13 seconds to destroy the instance on the hypervisor.
Apr 12 12:35:39 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:35:39 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:41 user nova-compute[71321]: DEBUG nova.compute.manager [req-7f03c25c-dceb-4f5d-a3a4-42a3c096c33f req-a34a20e3-122f-459a-a237-5fa42d753eac service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-deleted-501229b8-6d04-45a8-97df-927b8ec14ca3 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:41 user nova-compute[71321]: INFO nova.compute.manager [req-7f03c25c-dceb-4f5d-a3a4-42a3c096c33f req-a34a20e3-122f-459a-a237-5fa42d753eac service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Neutron deleted interface 501229b8-6d04-45a8-97df-927b8ec14ca3; detaching it from the instance and deleting it from the info cache
Apr 12 12:35:41 user nova-compute[71321]: DEBUG nova.network.neutron [req-7f03c25c-dceb-4f5d-a3a4-42a3c096c33f req-a34a20e3-122f-459a-a237-5fa42d753eac service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Updating instance_info_cache with network_info: [{"id": "94f43c42-9d4d-4625-b558-4be918b78ffb", "address": "fa:16:3e:08:8e:12", "network": {"id": "255979eb-ff62-4b24-9a5a-06bc3b6da2c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1439583801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f43c42-9d", "ovs_interfaceid": "94f43c42-9d4d-4625-b558-4be918b78ffb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76450ca6-4f7a-4e03-9269-feaacfced76a", "address": "fa:16:3e:73:82:20", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76450ca6-4f", "ovs_interfaceid": "76450ca6-4f7a-4e03-9269-feaacfced76a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5dfbb175-cb83-461e-91da-d7cbde98c3e6", "address": "fa:16:3e:cf:39:d7", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dfbb175-cb", "ovs_interfaceid": "5dfbb175-cb83-461e-91da-d7cbde98c3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a995fb4-7c9a-443c-a66a-47c04d7862ea", "address": "fa:16:3e:24:fd:5a", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a995fb4-7c", "ovs_interfaceid": "4a995fb4-7c9a-443c-a66a-47c04d7862ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e59fa8d8-7765-453d-a135-0abe5f1cae78", "address": "fa:16:3e:6c:6f:97", "network": {"id": "d2127306-286f-42cb-9dcf-1b4c2e4a9861", "bridge": "br-int", "label": "tempest-device-tagging-net2-1354193313", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape59fa8d8-77", "ovs_interfaceid": "e59fa8d8-7765-453d-a135-0abe5f1cae78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bad3a184-db6f-4d2d-ac53-f1155fcf0fe1", "address": "fa:16:3e:e0:e2:20", "network": {"id": "d2127306-286f-42cb-9dcf-1b4c2e4a9861", "bridge": "br-int", "label": "tempest-device-tagging-net2-1354193313", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad3a184-db", "ovs_interfaceid": "bad3a184-db6f-4d2d-ac53-f1155fcf0fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:35:41 user nova-compute[71321]: DEBUG nova.compute.manager [req-7f03c25c-dceb-4f5d-a3a4-42a3c096c33f req-a34a20e3-122f-459a-a237-5fa42d753eac service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Detach interface failed, port_id=501229b8-6d04-45a8-97df-927b8ec14ca3, reason: Instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa could not be found. {{(pid=71321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 12:35:43 user nova-compute[71321]: DEBUG nova.compute.manager [req-8004c26d-d0b4-49aa-b2bc-c046cdfeff5a req-f41ce755-fa60-46ad-9826-7e686ad3f580 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-deleted-94f43c42-9d4d-4625-b558-4be918b78ffb {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:43 user nova-compute[71321]: INFO nova.compute.manager [req-8004c26d-d0b4-49aa-b2bc-c046cdfeff5a req-f41ce755-fa60-46ad-9826-7e686ad3f580 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Neutron deleted interface 94f43c42-9d4d-4625-b558-4be918b78ffb; detaching it from the instance and deleting it from the info cache
Apr 12 12:35:43 user nova-compute[71321]: DEBUG nova.network.neutron [req-8004c26d-d0b4-49aa-b2bc-c046cdfeff5a req-f41ce755-fa60-46ad-9826-7e686ad3f580 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Updating instance_info_cache with network_info: [{"id": "76450ca6-4f7a-4e03-9269-feaacfced76a", "address": "fa:16:3e:73:82:20", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76450ca6-4f", "ovs_interfaceid": "76450ca6-4f7a-4e03-9269-feaacfced76a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5dfbb175-cb83-461e-91da-d7cbde98c3e6", "address": "fa:16:3e:cf:39:d7", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dfbb175-cb", "ovs_interfaceid": "5dfbb175-cb83-461e-91da-d7cbde98c3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a995fb4-7c9a-443c-a66a-47c04d7862ea", "address": "fa:16:3e:24:fd:5a", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a995fb4-7c", "ovs_interfaceid": "4a995fb4-7c9a-443c-a66a-47c04d7862ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e59fa8d8-7765-453d-a135-0abe5f1cae78", "address": "fa:16:3e:6c:6f:97", "network": {"id": "d2127306-286f-42cb-9dcf-1b4c2e4a9861", "bridge": "br-int", "label": "tempest-device-tagging-net2-1354193313", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape59fa8d8-77", "ovs_interfaceid": "e59fa8d8-7765-453d-a135-0abe5f1cae78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bad3a184-db6f-4d2d-ac53-f1155fcf0fe1", "address": "fa:16:3e:e0:e2:20", "network": {"id": "d2127306-286f-42cb-9dcf-1b4c2e4a9861", "bridge": "br-int", "label": "tempest-device-tagging-net2-1354193313", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad3a184-db", "ovs_interfaceid": "bad3a184-db6f-4d2d-ac53-f1155fcf0fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:35:43 user nova-compute[71321]: DEBUG nova.compute.manager [req-8004c26d-d0b4-49aa-b2bc-c046cdfeff5a req-f41ce755-fa60-46ad-9826-7e686ad3f580 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Detach interface failed, port_id=94f43c42-9d4d-4625-b558-4be918b78ffb, reason: Instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa could not be found. {{(pid=71321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 12:35:43 user nova-compute[71321]: DEBUG nova.compute.manager [req-8004c26d-d0b4-49aa-b2bc-c046cdfeff5a req-f41ce755-fa60-46ad-9826-7e686ad3f580 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-deleted-bad3a184-db6f-4d2d-ac53-f1155fcf0fe1 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:43 user nova-compute[71321]: INFO nova.compute.manager [req-8004c26d-d0b4-49aa-b2bc-c046cdfeff5a req-f41ce755-fa60-46ad-9826-7e686ad3f580 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Neutron deleted interface bad3a184-db6f-4d2d-ac53-f1155fcf0fe1; detaching it from the instance and deleting it from the info cache
Apr 12 12:35:43 user nova-compute[71321]: DEBUG nova.network.neutron [req-8004c26d-d0b4-49aa-b2bc-c046cdfeff5a req-f41ce755-fa60-46ad-9826-7e686ad3f580 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Updating instance_info_cache with network_info: [{"id": "76450ca6-4f7a-4e03-9269-feaacfced76a", "address": "fa:16:3e:73:82:20", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76450ca6-4f", "ovs_interfaceid": "76450ca6-4f7a-4e03-9269-feaacfced76a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5dfbb175-cb83-461e-91da-d7cbde98c3e6", "address": "fa:16:3e:cf:39:d7", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dfbb175-cb", "ovs_interfaceid": "5dfbb175-cb83-461e-91da-d7cbde98c3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a995fb4-7c9a-443c-a66a-47c04d7862ea", "address": "fa:16:3e:24:fd:5a", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a995fb4-7c", "ovs_interfaceid": "4a995fb4-7c9a-443c-a66a-47c04d7862ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e59fa8d8-7765-453d-a135-0abe5f1cae78", "address": "fa:16:3e:6c:6f:97", "network": {"id": "d2127306-286f-42cb-9dcf-1b4c2e4a9861", "bridge": "br-int", "label": "tempest-device-tagging-net2-1354193313", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape59fa8d8-77", "ovs_interfaceid": "e59fa8d8-7765-453d-a135-0abe5f1cae78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:35:43 user nova-compute[71321]: DEBUG nova.compute.manager [req-8004c26d-d0b4-49aa-b2bc-c046cdfeff5a req-f41ce755-fa60-46ad-9826-7e686ad3f580 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Detach interface failed, port_id=bad3a184-db6f-4d2d-ac53-f1155fcf0fe1, reason: Instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa could not be found. {{(pid=71321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 12:35:43 user nova-compute[71321]: DEBUG nova.compute.manager [req-8004c26d-d0b4-49aa-b2bc-c046cdfeff5a req-f41ce755-fa60-46ad-9826-7e686ad3f580 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-deleted-4a995fb4-7c9a-443c-a66a-47c04d7862ea {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:43 user nova-compute[71321]: INFO nova.compute.manager [req-8004c26d-d0b4-49aa-b2bc-c046cdfeff5a req-f41ce755-fa60-46ad-9826-7e686ad3f580 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Neutron deleted interface 4a995fb4-7c9a-443c-a66a-47c04d7862ea; detaching it from the instance and deleting it from the info cache
Apr 12 12:35:43 user nova-compute[71321]: DEBUG nova.network.neutron [req-8004c26d-d0b4-49aa-b2bc-c046cdfeff5a req-f41ce755-fa60-46ad-9826-7e686ad3f580 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Updating instance_info_cache with network_info: [{"id": "76450ca6-4f7a-4e03-9269-feaacfced76a", "address": "fa:16:3e:73:82:20", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76450ca6-4f", "ovs_interfaceid": "76450ca6-4f7a-4e03-9269-feaacfced76a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5dfbb175-cb83-461e-91da-d7cbde98c3e6", "address": "fa:16:3e:cf:39:d7", "network": {"id": "cdff297b-c932-49f5-8f91-31b7a475af78", "bridge": "br-int", "label": "tempest-device-tagging-net1-883639918", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dfbb175-cb", "ovs_interfaceid": "5dfbb175-cb83-461e-91da-d7cbde98c3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e59fa8d8-7765-453d-a135-0abe5f1cae78", "address": "fa:16:3e:6c:6f:97", "network": {"id": "d2127306-286f-42cb-9dcf-1b4c2e4a9861", "bridge": "br-int", "label": "tempest-device-tagging-net2-1354193313", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f89f1f2dba8e4325b550ad91403e60ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape59fa8d8-77", "ovs_interfaceid": "e59fa8d8-7765-453d-a135-0abe5f1cae78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:35:43 user nova-compute[71321]: DEBUG nova.compute.manager [req-8004c26d-d0b4-49aa-b2bc-c046cdfeff5a req-f41ce755-fa60-46ad-9826-7e686ad3f580 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Detach interface failed, port_id=4a995fb4-7c9a-443c-a66a-47c04d7862ea, reason: Instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa could not be found. {{(pid=71321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 12:35:43 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:35:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:43 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Took 3.91 seconds to deallocate network for instance.
Apr 12 12:35:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:45 user nova-compute[71321]: DEBUG nova.compute.manager [req-a5c274b7-5f22-4270-8240-191f13d05796 req-bb93e7ec-3f8e-4707-bbb8-7bbd42d0f8c3 service nova] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Received event network-vif-deleted-e59fa8d8-7765-453d-a135-0abe5f1cae78 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:46 user nova-compute[71321]: INFO nova.compute.manager [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Took 2.42 seconds to detach 3 volumes for instance.
Apr 12 12:35:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:46 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:35:46 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:35:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.418s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:46 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Deleted allocations for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa
Apr 12 12:35:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "81cb942b-5bd6-47c4-8130-f5a4d17f10fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.091s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "239b22bb-d381-4bd3-9b73-642f174d7664" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "239b22bb-d381-4bd3-9b73-642f174d7664" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "239b22bb-d381-4bd3-9b73-642f174d7664-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "239b22bb-d381-4bd3-9b73-642f174d7664-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "239b22bb-d381-4bd3-9b73-642f174d7664-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:47 user nova-compute[71321]: INFO nova.compute.manager [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Terminating instance
Apr 12 12:35:47 user nova-compute[71321]: DEBUG nova.compute.manager [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:35:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5019f563-ac61-4a5b-a950-179401c95ce6 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "839e85a2-f7af-482d-a5e6-09195888300e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5019f563-ac61-4a5b-a950-179401c95ce6 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "839e85a2-f7af-482d-a5e6-09195888300e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5019f563-ac61-4a5b-a950-179401c95ce6 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "839e85a2-f7af-482d-a5e6-09195888300e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5019f563-ac61-4a5b-a950-179401c95ce6 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "839e85a2-f7af-482d-a5e6-09195888300e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5019f563-ac61-4a5b-a950-179401c95ce6 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "839e85a2-f7af-482d-a5e6-09195888300e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:47 user nova-compute[71321]: INFO nova.compute.manager [None req-5019f563-ac61-4a5b-a950-179401c95ce6 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Terminating instance
Apr 12 12:35:47 user nova-compute[71321]: DEBUG nova.compute.manager [None req-5019f563-ac61-4a5b-a950-179401c95ce6 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:35:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:47 user nova-compute[71321]: DEBUG nova.compute.manager [req-aad3e7a2-1bb8-4bc0-8a57-88a1f955d0d8 req-cb2c60f9-e2ec-46ae-bbf1-fd4048b3336b service nova] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Received event network-vif-unplugged-593b7bab-955d-417a-88c5-6016acf5efe6 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-aad3e7a2-1bb8-4bc0-8a57-88a1f955d0d8 req-cb2c60f9-e2ec-46ae-bbf1-fd4048b3336b service nova] Acquiring lock "239b22bb-d381-4bd3-9b73-642f174d7664-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-aad3e7a2-1bb8-4bc0-8a57-88a1f955d0d8 req-cb2c60f9-e2ec-46ae-bbf1-fd4048b3336b service nova] Lock "239b22bb-d381-4bd3-9b73-642f174d7664-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-aad3e7a2-1bb8-4bc0-8a57-88a1f955d0d8 req-cb2c60f9-e2ec-46ae-bbf1-fd4048b3336b service nova] Lock "239b22bb-d381-4bd3-9b73-642f174d7664-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:47 user nova-compute[71321]: DEBUG nova.compute.manager [req-aad3e7a2-1bb8-4bc0-8a57-88a1f955d0d8 req-cb2c60f9-e2ec-46ae-bbf1-fd4048b3336b service nova] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] No waiting events found dispatching network-vif-unplugged-593b7bab-955d-417a-88c5-6016acf5efe6 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:35:47 user nova-compute[71321]: DEBUG nova.compute.manager [req-aad3e7a2-1bb8-4bc0-8a57-88a1f955d0d8 req-cb2c60f9-e2ec-46ae-bbf1-fd4048b3336b service nova] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Received event network-vif-unplugged-593b7bab-955d-417a-88c5-6016acf5efe6 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:35:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG nova.compute.manager [req-86d31c06-a7b4-4db6-b687-fe0315697eed req-2fc2c818-8775-4e6b-b5d8-5b66ecd86d64 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Received event network-vif-unplugged-b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-86d31c06-a7b4-4db6-b687-fe0315697eed req-2fc2c818-8775-4e6b-b5d8-5b66ecd86d64 service nova] Acquiring lock "839e85a2-f7af-482d-a5e6-09195888300e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-86d31c06-a7b4-4db6-b687-fe0315697eed req-2fc2c818-8775-4e6b-b5d8-5b66ecd86d64 service nova] Lock "839e85a2-f7af-482d-a5e6-09195888300e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-86d31c06-a7b4-4db6-b687-fe0315697eed req-2fc2c818-8775-4e6b-b5d8-5b66ecd86d64 service nova] Lock "839e85a2-f7af-482d-a5e6-09195888300e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG nova.compute.manager [req-86d31c06-a7b4-4db6-b687-fe0315697eed req-2fc2c818-8775-4e6b-b5d8-5b66ecd86d64 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] No waiting events found dispatching network-vif-unplugged-b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG nova.compute.manager [req-86d31c06-a7b4-4db6-b687-fe0315697eed req-2fc2c818-8775-4e6b-b5d8-5b66ecd86d64 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Received event network-vif-unplugged-b5f18af0-544d-4978-b20e-85da7e880834 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:48 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Instance destroyed successfully.
Apr 12 12:35:48 user nova-compute[71321]: DEBUG nova.objects.instance [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lazy-loading 'resources' on Instance uuid 239b22bb-d381-4bd3-9b73-642f174d7664 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:33:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-17042605',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-17042605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-17042605',id=20,image_ref='5bf323e0-2e87-46b7-99e8-e588b4d03a87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:34:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ada441da2124adda751365952320e81',ramdisk_id='',reservation_id='r-xamkmvqc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-310589135',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-310589135-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-310589135',owner_user_name='tempest-TestVolumeBootPattern-310589135-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:34:14Z,user_data=None,user_id='076e65b43f664765ad1d48be6e814f40',uuid=239b22bb-d381-4bd3-9b73-642f174d7664,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "593b7bab-955d-417a-88c5-6016acf5efe6", "address": "fa:16:3e:38:0a:d9", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593b7bab-95", "ovs_interfaceid": "593b7bab-955d-417a-88c5-6016acf5efe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converting VIF {"id": "593b7bab-955d-417a-88c5-6016acf5efe6", "address": "fa:16:3e:38:0a:d9", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593b7bab-95", "ovs_interfaceid": "593b7bab-955d-417a-88c5-6016acf5efe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:0a:d9,bridge_name='br-int',has_traffic_filtering=True,id=593b7bab-955d-417a-88c5-6016acf5efe6,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap593b7bab-95') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG os_vif [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:0a:d9,bridge_name='br-int',has_traffic_filtering=True,id=593b7bab-955d-417a-88c5-6016acf5efe6,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap593b7bab-95') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:35:48 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Instance destroyed successfully.
Apr 12 12:35:48 user nova-compute[71321]: DEBUG nova.objects.instance [None req-5019f563-ac61-4a5b-a950-179401c95ce6 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lazy-loading 'resources' on Instance uuid 839e85a2-f7af-482d-a5e6-09195888300e {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap593b7bab-95, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-5019f563-ac61-4a5b-a950-179401c95ce6 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:28:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-880464121',display_name='tempest-ServerStableDeviceRescueTest-server-880464121',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-880464121',id=5,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbjsmMAk7TgSJuVPAPMbe+S9lCblPJCLl74ltjr7B+GvM2NkPL65YFl6sPwYL2BIrtM9phc+NecEtUrIGkGO+1xCyg6wipPFufRoi6dOJI6CI4+oKRDt9+nYbnf0HP/Kw==',key_name='tempest-keypair-1613417814',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:32:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b1faa529d424800900e10a7ceaa63d4',ramdisk_id='',reservation_id='r-9f4j5h8u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1967261752',owner_user_name='tempest-ServerStableDeviceRescueTest-1967261752-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:34:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d76f02dd70664dfea34586abbc213526',uuid=839e85a2-f7af-482d-a5e6-09195888300e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5f18af0-544d-4978-b20e-85da7e880834", "address": "fa:16:3e:f7:93:c8", "network": {"id": "b6e89fad-c9f7-473e-ab76-3f005281cc95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-175129642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1faa529d424800900e10a7ceaa63d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f18af0-54", "ovs_interfaceid": "b5f18af0-544d-4978-b20e-85da7e880834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-5019f563-ac61-4a5b-a950-179401c95ce6 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Converting VIF {"id": "b5f18af0-544d-4978-b20e-85da7e880834", "address": "fa:16:3e:f7:93:c8", "network": {"id": "b6e89fad-c9f7-473e-ab76-3f005281cc95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-175129642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1faa529d424800900e10a7ceaa63d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f18af0-54", "ovs_interfaceid": "b5f18af0-544d-4978-b20e-85da7e880834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-5019f563-ac61-4a5b-a950-179401c95ce6 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:93:c8,bridge_name='br-int',has_traffic_filtering=True,id=b5f18af0-544d-4978-b20e-85da7e880834,network=Network(b6e89fad-c9f7-473e-ab76-3f005281cc95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f18af0-54') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG os_vif [None req-5019f563-ac61-4a5b-a950-179401c95ce6 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:93:c8,bridge_name='br-int',has_traffic_filtering=True,id=b5f18af0-544d-4978-b20e-85da7e880834,network=Network(b6e89fad-c9f7-473e-ab76-3f005281cc95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f18af0-54') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5f18af0-54, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:48 user nova-compute[71321]: INFO os_vif [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:0a:d9,bridge_name='br-int',has_traffic_filtering=True,id=593b7bab-955d-417a-88c5-6016acf5efe6,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap593b7bab-95')
Apr 12 12:35:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WfqtkwTJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:35:48 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:35:48 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:35:48 user nova-compute[71321]: INFO os_vif [None req-5019f563-ac61-4a5b-a950-179401c95ce6 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:93:c8,bridge_name='br-int',has_traffic_filtering=True,id=b5f18af0-544d-4978-b20e-85da7e880834,network=Network(b6e89fad-c9f7-473e-ab76-3f005281cc95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f18af0-54')
Apr 12 12:35:48 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-5019f563-ac61-4a5b-a950-179401c95ce6 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Deleting instance files /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e_del
Apr 12 12:35:48 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-5019f563-ac61-4a5b-a950-179401c95ce6 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Deletion of /opt/stack/data/nova/instances/839e85a2-f7af-482d-a5e6-09195888300e_del complete
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efaacff-0c62-4279-9c22-ae31e697378d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:35:48 user nova-compute[71321]: No targets found.
Apr 12 12:35:48 user nova-compute[71321]: iSNS:
Apr 12 12:35:48 user nova-compute[71321]: No targets found.
Apr 12 12:35:48 user nova-compute[71321]: STATIC:
Apr 12 12:35:48 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945
Apr 12 12:35:48 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:35:48 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:35:48 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0
Apr 12 12:35:48 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:35:48 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:35:48 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54
Apr 12 12:35:48 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:35:48 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:35:48 user nova-compute[71321]: FIRMWARE:
Apr 12 12:35:48 user nova-compute[71321]: No targets found.
Apr 12 12:35:48 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:35:48 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:35:48 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db8eecb-9464-47c3-81b0-1db5e60bff8c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:48 user nova-compute[71321]: INFO nova.compute.manager [None req-5019f563-ac61-4a5b-a950-179401c95ce6 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Took 1.38 seconds to destroy the instance on the hypervisor.
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-5019f563-ac61-4a5b-a950-179401c95ce6 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[41354179-2b75-4425-848f-9c7c7c5876fe]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:35:48 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:35:48 user nova-compute[71321]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:35:48 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:35:48 user nova-compute[71321]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 (non-flash)
Apr 12 12:35:48 user nova-compute[71321]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:35:48 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef641f11b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0'): ({'sdh'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Removing single pathed devices sdh {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[63203b12-eb71-47ac-bed1-ee59083a6b22]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e344d2ba-125a-45f8-a6e1-bbf4ef239bb0]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Flushing IO for device /dev/sdh {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a845ca3-46c4-4ba8-b84e-f33bec122fa3]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.052s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6d3bec-006f-4e4d-8d8f-6bfaf0f5afae]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] SCSI volumes sdh have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a401b83-2cc6-4489-a371-760822418eeb]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc49483-eb78-4925-9797-115d2f2ae02c]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0, portal: 172.16.0.220,3260]
Apr 12 12:35:48 user nova-compute[71321]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0, portal: 172.16.0.220,3260] successful.
Apr 12 12:35:48 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dd6fd89-7d2a-450d-8c3e-b643393e19e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f675fa44-47d0-489a-a86a-2f68832b99b1]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] <== disconnect_volume: return (345ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:35:48 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Deleting instance files /opt/stack/data/nova/instances/239b22bb-d381-4bd3-9b73-642f174d7664_del
Apr 12 12:35:48 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Deletion of /opt/stack/data/nova/instances/239b22bb-d381-4bd3-9b73-642f174d7664_del complete
Apr 12 12:35:48 user nova-compute[71321]: INFO nova.compute.manager [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Took 1.85 seconds to destroy the instance on the hypervisor.
Apr 12 12:35:48 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:35:48 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:35:49 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:35:49 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Took 1.11 seconds to deallocate network for instance.
Apr 12 12:35:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5019f563-ac61-4a5b-a950-179401c95ce6 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5019f563-ac61-4a5b-a950-179401c95ce6 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:49 user nova-compute[71321]: DEBUG nova.compute.manager [req-2f6dae37-793c-4b87-9788-70589b1a27dc req-3b0b8e8c-bf34-4668-ae38-73543feb285f service nova] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Received event network-vif-plugged-593b7bab-955d-417a-88c5-6016acf5efe6 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2f6dae37-793c-4b87-9788-70589b1a27dc req-3b0b8e8c-bf34-4668-ae38-73543feb285f service nova] Acquiring lock "239b22bb-d381-4bd3-9b73-642f174d7664-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2f6dae37-793c-4b87-9788-70589b1a27dc req-3b0b8e8c-bf34-4668-ae38-73543feb285f service nova] Lock "239b22bb-d381-4bd3-9b73-642f174d7664-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2f6dae37-793c-4b87-9788-70589b1a27dc req-3b0b8e8c-bf34-4668-ae38-73543feb285f service nova] Lock "239b22bb-d381-4bd3-9b73-642f174d7664-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:49 user nova-compute[71321]: DEBUG nova.compute.manager [req-2f6dae37-793c-4b87-9788-70589b1a27dc req-3b0b8e8c-bf34-4668-ae38-73543feb285f service nova] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] No waiting events found dispatching network-vif-plugged-593b7bab-955d-417a-88c5-6016acf5efe6 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:35:49 user nova-compute[71321]: WARNING nova.compute.manager [req-2f6dae37-793c-4b87-9788-70589b1a27dc req-3b0b8e8c-bf34-4668-ae38-73543feb285f service nova] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Received unexpected event network-vif-plugged-593b7bab-955d-417a-88c5-6016acf5efe6 for instance with vm_state active and task_state deleting.
Apr 12 12:35:49 user nova-compute[71321]: DEBUG nova.compute.manager [req-2f6dae37-793c-4b87-9788-70589b1a27dc req-3b0b8e8c-bf34-4668-ae38-73543feb285f service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Received event network-vif-deleted-b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:49 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:35:49 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Took 0.84 seconds to deallocate network for instance.
Apr 12 12:35:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:50 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-5019f563-ac61-4a5b-a950-179401c95ce6 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:35:50 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-5019f563-ac61-4a5b-a950-179401c95ce6 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:35:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5019f563-ac61-4a5b-a950-179401c95ce6 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:50 user nova-compute[71321]: DEBUG nova.compute.manager [req-4127a144-caac-48fe-a41c-b18d4bcf67c4 req-3826af77-5b19-4d2b-92b0-073fad0c3e71 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Received event network-vif-plugged-b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4127a144-caac-48fe-a41c-b18d4bcf67c4 req-3826af77-5b19-4d2b-92b0-073fad0c3e71 service nova] Acquiring lock "839e85a2-f7af-482d-a5e6-09195888300e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4127a144-caac-48fe-a41c-b18d4bcf67c4 req-3826af77-5b19-4d2b-92b0-073fad0c3e71 service nova] Lock "839e85a2-f7af-482d-a5e6-09195888300e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4127a144-caac-48fe-a41c-b18d4bcf67c4 req-3826af77-5b19-4d2b-92b0-073fad0c3e71 service nova] Lock "839e85a2-f7af-482d-a5e6-09195888300e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:50 user nova-compute[71321]: DEBUG nova.compute.manager [req-4127a144-caac-48fe-a41c-b18d4bcf67c4 req-3826af77-5b19-4d2b-92b0-073fad0c3e71 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] No waiting events found dispatching network-vif-plugged-b5f18af0-544d-4978-b20e-85da7e880834 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:35:50 user nova-compute[71321]: WARNING nova.compute.manager [req-4127a144-caac-48fe-a41c-b18d4bcf67c4 req-3826af77-5b19-4d2b-92b0-073fad0c3e71 service nova] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Received unexpected event network-vif-plugged-b5f18af0-544d-4978-b20e-85da7e880834 for instance with vm_state deleted and task_state None.
Apr 12 12:35:50 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-5019f563-ac61-4a5b-a950-179401c95ce6 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Deleted allocations for instance 839e85a2-f7af-482d-a5e6-09195888300e
Apr 12 12:35:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5019f563-ac61-4a5b-a950-179401c95ce6 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "839e85a2-f7af-482d-a5e6-09195888300e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.114s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:50 user nova-compute[71321]: INFO nova.compute.manager [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Took 0.86 seconds to detach 1 volumes for instance.
Apr 12 12:35:50 user nova-compute[71321]: DEBUG nova.compute.manager [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Deleting volume: 3dd6fd89-7d2a-450d-8c3e-b643393e19e0 {{(pid=71321) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 12:35:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:35:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:35:51 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:35:51 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:35:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:51 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Deleted allocations for instance 239b22bb-d381-4bd3-9b73-642f174d7664
Apr 12 12:35:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "239b22bb-d381-4bd3-9b73-642f174d7664" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.216s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:35:51 user nova-compute[71321]: DEBUG nova.compute.manager [req-30bd10d8-d870-4cf6-9c77-8a613073bf9e req-ad3e6e0d-10d9-4471-9e92-5e676116b887 service nova] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Received event network-vif-deleted-593b7bab-955d-417a-88c5-6016acf5efe6 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:35:53 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681302938.374108, 81cb942b-5bd6-47c4-8130-f5a4d17f10fa => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:35:53 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] VM Stopped (Lifecycle Event)
Apr 12 12:35:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:53 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b037590d-2fff-48ae-8524-b42a8867af89 None None] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:35:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:35:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:03 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681302948.333407, 239b22bb-d381-4bd3-9b73-642f174d7664 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:36:03 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] VM Stopped (Lifecycle Event)
Apr 12 12:36:03 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681302948.3453903, 839e85a2-f7af-482d-a5e6-09195888300e => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:36:03 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] VM Stopped (Lifecycle Event)
Apr 12 12:36:03 user nova-compute[71321]: DEBUG nova.compute.manager [None req-c27dbade-6688-457b-9498-5b27462889b2 None None] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:36:03 user nova-compute[71321]: DEBUG nova.compute.manager [None req-abab598a-ce6d-49d8-8fae-9a949121ddaf None None] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:36:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:36:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:36:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 12:36:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 12:36:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 12:36:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:13 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:14 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:36:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:15 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:36:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:15 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:36:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:36:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c24566ee-48cd-4cc4-aaea-28b1eae34fad/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c24566ee-48cd-4cc4-aaea-28b1eae34fad/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c24566ee-48cd-4cc4-aaea-28b1eae34fad/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c24566ee-48cd-4cc4-aaea-28b1eae34fad/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe72c043-e035-4926-8f7f-455285f0dbe8/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe72c043-e035-4926-8f7f-455285f0dbe8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe72c043-e035-4926-8f7f-455285f0dbe8/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe72c043-e035-4926-8f7f-455285f0dbe8/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:17 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:36:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:18 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:36:18 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:36:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=7481MB free_disk=26.449085235595703GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:36:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 10116da0-785c-41cf-96bb-95721af863db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:36:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance a4107f2d-88e4-4846-9ece-cb16ad7ecd02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:36:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:36:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:36:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance cda12475-d730-4c07-af54-a3a64482fc94 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:36:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance c5b9b1bb-a3d9-4073-8d49-70360dae6f29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:36:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 8403a098-a141-4feb-9eed-3731e2c7c152 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:36:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance fe72c043-e035-4926-8f7f-455285f0dbe8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:36:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance fa011231-049f-40c3-89c0-53447a35752f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:36:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance c24566ee-48cd-4cc4-aaea-28b1eae34fad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:36:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:36:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:36:19 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:36:19 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:36:19 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:36:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.443s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:21 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:36:21 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:36:21 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:36:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-546c0c08-35f1-4043-ac30-56d49bc86af1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:36:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-546c0c08-35f1-4043-ac30-56d49bc86af1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:36:21 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 12:36:21 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Updating instance_info_cache with network_info: [{"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:36:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-546c0c08-35f1-4043-ac30-56d49bc86af1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:36:21 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 12:36:21 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:36:21 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:36:22 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:36:22 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:36:22 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:36:22 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:36:23 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:36:24 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:36:24 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:28 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "9439468d-7a45-443b-87ce-106907761a56" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "9439468d-7a45-443b-87ce-106907761a56" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:29 user nova-compute[71321]: INFO nova.compute.manager [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Unshelving
Apr 12 12:36:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:29 user nova-compute[71321]: INFO nova.virt.block_device [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Booting with volume b9c08f12-a467-4152-a8fb-00aef87ac9c9 at /dev/vdc
Apr 12 12:36:30 user nova-compute[71321]: DEBUG os_brick.utils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:36:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:30 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1d4158-33d1-4186-8685-ed0505473aed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:30 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3508329b-dd0b-4839-ae25-6961fb4c34d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:30 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[264f8236-d29a-4caa-b408-98dbc949bb6a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:30 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fccdc5-ee2a-47ab-abfc-7bad9bb39ca0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:36:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:36:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:36:30 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:36:30 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[74304c05-5cc7-4dd0-98c9-34ca493141d6]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:36:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:36:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:36:30 user nova-compute[71321]: DEBUG os_brick.utils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:36:30 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Updating existing volume attachment record: 01870c78-631b-4cee-ab09-3533b7845ccd {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:36:33 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:34 user nova-compute[71321]: DEBUG nova.objects.instance [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lazy-loading 'pci_requests' on Instance uuid 9439468d-7a45-443b-87ce-106907761a56 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:36:34 user nova-compute[71321]: DEBUG nova.objects.instance [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lazy-loading 'numa_topology' on Instance uuid 9439468d-7a45-443b-87ce-106907761a56 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:36:34 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:36:34 user nova-compute[71321]: INFO nova.compute.claims [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Claim successful on node user
Apr 12 12:36:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:35 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:36:35 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:36:35 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.521s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:35 user nova-compute[71321]: INFO nova.network.neutron [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Updating port 67b56c74-fc25-4bc8-875e-8a134830124b with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 12 12:36:35 user nova-compute[71321]: DEBUG nova.compute.manager [req-421768f7-cdad-4556-950f-fe2a5c9de68e req-9ef41591-4104-4255-865d-d0bcdd29afc3 service nova] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Received event network-changed-5fbb21e1-ece8-4e20-baa6-55fe59a41325 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:36:35 user nova-compute[71321]: DEBUG nova.compute.manager [req-421768f7-cdad-4556-950f-fe2a5c9de68e req-9ef41591-4104-4255-865d-d0bcdd29afc3 service nova] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Refreshing instance network info cache due to event network-changed-5fbb21e1-ece8-4e20-baa6-55fe59a41325. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:36:35 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-421768f7-cdad-4556-950f-fe2a5c9de68e req-9ef41591-4104-4255-865d-d0bcdd29afc3 service nova] Acquiring lock "refresh_cache-d584edf2-12e3-48d1-947f-fdfb0c9c7377" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:36:35 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-421768f7-cdad-4556-950f-fe2a5c9de68e req-9ef41591-4104-4255-865d-d0bcdd29afc3 service nova] Acquired lock "refresh_cache-d584edf2-12e3-48d1-947f-fdfb0c9c7377" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:36:35 user nova-compute[71321]: DEBUG nova.network.neutron [req-421768f7-cdad-4556-950f-fe2a5c9de68e req-9ef41591-4104-4255-865d-d0bcdd29afc3 service nova] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Refreshing network info cache for port 5fbb21e1-ece8-4e20-baa6-55fe59a41325 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:36:36 user nova-compute[71321]: DEBUG nova.network.neutron [req-421768f7-cdad-4556-950f-fe2a5c9de68e req-9ef41591-4104-4255-865d-d0bcdd29afc3 service nova] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Updated VIF entry in instance network info cache for port 5fbb21e1-ece8-4e20-baa6-55fe59a41325. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:36:36 user nova-compute[71321]: DEBUG nova.network.neutron [req-421768f7-cdad-4556-950f-fe2a5c9de68e req-9ef41591-4104-4255-865d-d0bcdd29afc3 service nova] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Updating instance_info_cache with network_info: [{"id": "5fbb21e1-ece8-4e20-baa6-55fe59a41325", "address": "fa:16:3e:eb:10:b5", "network": {"id": "cba3e8fe-24d8-4128-b9b8-4087ab3a4407", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-916061215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8ad4c8abb3447bd8ad5f5f2e95e2d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fbb21e1-ec", "ovs_interfaceid": "5fbb21e1-ece8-4e20-baa6-55fe59a41325", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:36:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-421768f7-cdad-4556-950f-fe2a5c9de68e req-9ef41591-4104-4255-865d-d0bcdd29afc3 service nova] Releasing lock "refresh_cache-d584edf2-12e3-48d1-947f-fdfb0c9c7377" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:36:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "refresh_cache-9439468d-7a45-443b-87ce-106907761a56" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:36:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquired lock "refresh_cache-9439468d-7a45-443b-87ce-106907761a56" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:36:36 user nova-compute[71321]: DEBUG nova.network.neutron [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:36:36 user nova-compute[71321]: DEBUG nova.compute.manager [req-0c75234c-a64d-4fd3-8b6a-ef943c938bbd req-fdbe9410-500d-4423-b5e6-8970912686c1 service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Received event network-changed-67b56c74-fc25-4bc8-875e-8a134830124b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:36:36 user nova-compute[71321]: DEBUG nova.compute.manager [req-0c75234c-a64d-4fd3-8b6a-ef943c938bbd req-fdbe9410-500d-4423-b5e6-8970912686c1 service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Refreshing instance network info cache due to event network-changed-67b56c74-fc25-4bc8-875e-8a134830124b. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:36:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0c75234c-a64d-4fd3-8b6a-ef943c938bbd req-fdbe9410-500d-4423-b5e6-8970912686c1 service nova] Acquiring lock "refresh_cache-9439468d-7a45-443b-87ce-106907761a56" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:36:37 user nova-compute[71321]: DEBUG nova.network.neutron [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Updating instance_info_cache with network_info: [{"id": "67b56c74-fc25-4bc8-875e-8a134830124b", "address": "fa:16:3e:14:ba:2c", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b56c74-fc", "ovs_interfaceid": "67b56c74-fc25-4bc8-875e-8a134830124b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:36:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Releasing lock "refresh_cache-9439468d-7a45-443b-87ce-106907761a56" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:36:37 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:36:37 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Creating image(s)
Apr 12 12:36:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "/opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "/opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "/opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:37 user nova-compute[71321]: DEBUG nova.objects.instance [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9439468d-7a45-443b-87ce-106907761a56 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:36:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0c75234c-a64d-4fd3-8b6a-ef943c938bbd req-fdbe9410-500d-4423-b5e6-8970912686c1 service nova] Acquired lock "refresh_cache-9439468d-7a45-443b-87ce-106907761a56" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:36:37 user nova-compute[71321]: DEBUG nova.network.neutron [req-0c75234c-a64d-4fd3-8b6a-ef943c938bbd req-fdbe9410-500d-4423-b5e6-8970912686c1 service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Refreshing network info cache for port 67b56c74-fc25-4bc8-875e-8a134830124b {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:36:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "6fa36d22cdb299cfae747dc45e27a7d3e61b7611" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "6fa36d22cdb299cfae747dc45e27a7d3e61b7611" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6fa36d22cdb299cfae747dc45e27a7d3e61b7611.part --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e8760cdc-9893-477f-afb1-bd9626caf708 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e8760cdc-9893-477f-afb1-bd9626caf708 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e8760cdc-9893-477f-afb1-bd9626caf708 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e8760cdc-9893-477f-afb1-bd9626caf708 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e8760cdc-9893-477f-afb1-bd9626caf708 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:38 user nova-compute[71321]: INFO nova.compute.manager [None req-e8760cdc-9893-477f-afb1-bd9626caf708 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Terminating instance
Apr 12 12:36:38 user nova-compute[71321]: DEBUG nova.compute.manager [None req-e8760cdc-9893-477f-afb1-bd9626caf708 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:36:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6fa36d22cdb299cfae747dc45e27a7d3e61b7611.part --force-share --output=json" returned: 0 in 0.168s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:38 user nova-compute[71321]: DEBUG nova.virt.images [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 3b243368-b9ac-481a-9051-c0bd3cadb017 was qcow2, converting to raw {{(pid=71321) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 12:36:38 user nova-compute[71321]: DEBUG nova.privsep.utils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 12:36:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6fa36d22cdb299cfae747dc45e27a7d3e61b7611.part /opt/stack/data/nova/instances/_base/6fa36d22cdb299cfae747dc45e27a7d3e61b7611.converted {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:38 user nova-compute[71321]: DEBUG nova.network.neutron [req-0c75234c-a64d-4fd3-8b6a-ef943c938bbd req-fdbe9410-500d-4423-b5e6-8970912686c1 service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Updated VIF entry in instance network info cache for port 67b56c74-fc25-4bc8-875e-8a134830124b. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:36:38 user nova-compute[71321]: DEBUG nova.network.neutron [req-0c75234c-a64d-4fd3-8b6a-ef943c938bbd req-fdbe9410-500d-4423-b5e6-8970912686c1 service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Updating instance_info_cache with network_info: [{"id": "67b56c74-fc25-4bc8-875e-8a134830124b", "address": "fa:16:3e:14:ba:2c", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b56c74-fc", "ovs_interfaceid": "67b56c74-fc25-4bc8-875e-8a134830124b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0c75234c-a64d-4fd3-8b6a-ef943c938bbd req-fdbe9410-500d-4423-b5e6-8970912686c1 service nova] Releasing lock "refresh_cache-9439468d-7a45-443b-87ce-106907761a56" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-eae887a9-36f4-4416-8b86-6c3382065f78 req-71453eae-1fb3-498f-ba3c-20c01368b551 service nova] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Received event network-vif-unplugged-5fbb21e1-ece8-4e20-baa6-55fe59a41325 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-eae887a9-36f4-4416-8b86-6c3382065f78 req-71453eae-1fb3-498f-ba3c-20c01368b551 service nova] Acquiring lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-eae887a9-36f4-4416-8b86-6c3382065f78 req-71453eae-1fb3-498f-ba3c-20c01368b551 service nova] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-eae887a9-36f4-4416-8b86-6c3382065f78 req-71453eae-1fb3-498f-ba3c-20c01368b551 service nova] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-eae887a9-36f4-4416-8b86-6c3382065f78 req-71453eae-1fb3-498f-ba3c-20c01368b551 service nova] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] No waiting events found dispatching network-vif-unplugged-5fbb21e1-ece8-4e20-baa6-55fe59a41325 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-eae887a9-36f4-4416-8b86-6c3382065f78 req-71453eae-1fb3-498f-ba3c-20c01368b551 service nova] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Received event network-vif-unplugged-5fbb21e1-ece8-4e20-baa6-55fe59a41325 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6fa36d22cdb299cfae747dc45e27a7d3e61b7611.part /opt/stack/data/nova/instances/_base/6fa36d22cdb299cfae747dc45e27a7d3e61b7611.converted" returned: 0 in 0.942s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6fa36d22cdb299cfae747dc45e27a7d3e61b7611.converted --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:39 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Instance destroyed successfully.
Apr 12 12:36:39 user nova-compute[71321]: DEBUG nova.objects.instance [None req-e8760cdc-9893-477f-afb1-bd9626caf708 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lazy-loading 'resources' on Instance uuid d584edf2-12e3-48d1-947f-fdfb0c9c7377 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-e8760cdc-9893-477f-afb1-bd9626caf708 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:30:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-651340607',display_name='tempest-SnapshotDataIntegrityTests-server-651340607',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-651340607',id=12,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8n/tv/M6R4wuDM0jbUye1gml7maodQ+9g689zJJzJ3WkTrfUhAnJqMicn9hfAmFSezo1t5uVHloxtsKXdGPLhaCAAP9IYcYEBLi42ToHoaHRnJDijgZlZ0V9SGIdT9Ig==',key_name='tempest-SnapshotDataIntegrityTests-1869203116',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:30:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c8ad4c8abb3447bd8ad5f5f2e95e2d78',ramdisk_id='',reservation_id='r-nzrrrw0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1611683463',owner_user_name='tempest-SnapshotDataIntegrityTests-1611683463-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:30:18Z,user_data=None,user_id='2272654f6bbb4fb39b3c334c32d4688c',uuid=d584edf2-12e3-48d1-947f-fdfb0c9c7377,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5fbb21e1-ece8-4e20-baa6-55fe59a41325", "address": "fa:16:3e:eb:10:b5", "network": {"id": "cba3e8fe-24d8-4128-b9b8-4087ab3a4407", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-916061215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8ad4c8abb3447bd8ad5f5f2e95e2d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fbb21e1-ec", "ovs_interfaceid": "5fbb21e1-ece8-4e20-baa6-55fe59a41325", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-e8760cdc-9893-477f-afb1-bd9626caf708 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Converting VIF {"id": "5fbb21e1-ece8-4e20-baa6-55fe59a41325", "address": "fa:16:3e:eb:10:b5", "network": {"id": "cba3e8fe-24d8-4128-b9b8-4087ab3a4407", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-916061215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8ad4c8abb3447bd8ad5f5f2e95e2d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fbb21e1-ec", "ovs_interfaceid": "5fbb21e1-ece8-4e20-baa6-55fe59a41325", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-e8760cdc-9893-477f-afb1-bd9626caf708 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:10:b5,bridge_name='br-int',has_traffic_filtering=True,id=5fbb21e1-ece8-4e20-baa6-55fe59a41325,network=Network(cba3e8fe-24d8-4128-b9b8-4087ab3a4407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fbb21e1-ec') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG os_vif [None req-e8760cdc-9893-477f-afb1-bd9626caf708 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:10:b5,bridge_name='br-int',has_traffic_filtering=True,id=5fbb21e1-ece8-4e20-baa6-55fe59a41325,network=Network(cba3e8fe-24d8-4128-b9b8-4087ab3a4407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fbb21e1-ec') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5fbb21e1-ec, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:36:39 user nova-compute[71321]: INFO os_vif [None req-e8760cdc-9893-477f-afb1-bd9626caf708 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:10:b5,bridge_name='br-int',has_traffic_filtering=True,id=5fbb21e1-ece8-4e20-baa6-55fe59a41325,network=Network(cba3e8fe-24d8-4128-b9b8-4087ab3a4407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fbb21e1-ec')
Apr 12 12:36:39 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-e8760cdc-9893-477f-afb1-bd9626caf708 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Deleting instance files /opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377_del
Apr 12 12:36:39 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-e8760cdc-9893-477f-afb1-bd9626caf708 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Deletion of /opt/stack/data/nova/instances/d584edf2-12e3-48d1-947f-fdfb0c9c7377_del complete
Apr 12 12:36:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6fa36d22cdb299cfae747dc45e27a7d3e61b7611.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "6fa36d22cdb299cfae747dc45e27a7d3e61b7611" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.152s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6fa36d22cdb299cfae747dc45e27a7d3e61b7611 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:39 user nova-compute[71321]: INFO nova.compute.manager [None req-e8760cdc-9893-477f-afb1-bd9626caf708 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Took 1.26 seconds to destroy the instance on the hypervisor.
Apr 12 12:36:39 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-e8760cdc-9893-477f-afb1-bd9626caf708 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6fa36d22cdb299cfae747dc45e27a7d3e61b7611 --force-share --output=json" returned: 0 in 0.146s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "6fa36d22cdb299cfae747dc45e27a7d3e61b7611" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "6fa36d22cdb299cfae747dc45e27a7d3e61b7611" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6fa36d22cdb299cfae747dc45e27a7d3e61b7611 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6fa36d22cdb299cfae747dc45e27a7d3e61b7611 --force-share --output=json" returned: 0 in 0.153s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6fa36d22cdb299cfae747dc45e27a7d3e61b7611,backing_fmt=raw /opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6fa36d22cdb299cfae747dc45e27a7d3e61b7611,backing_fmt=raw /opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk 1073741824" returned: 0 in 0.056s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "6fa36d22cdb299cfae747dc45e27a7d3e61b7611" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6fa36d22cdb299cfae747dc45e27a7d3e61b7611 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "cda12475-d730-4c07-af54-a3a64482fc94" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "cda12475-d730-4c07-af54-a3a64482fc94" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "cda12475-d730-4c07-af54-a3a64482fc94-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "cda12475-d730-4c07-af54-a3a64482fc94-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "cda12475-d730-4c07-af54-a3a64482fc94-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:39 user nova-compute[71321]: INFO nova.compute.manager [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Terminating instance
Apr 12 12:36:39 user nova-compute[71321]: DEBUG nova.compute.manager [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6fa36d22cdb299cfae747dc45e27a7d3e61b7611 --force-share --output=json" returned: 0 in 0.141s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG nova.objects.instance [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lazy-loading 'migration_context' on Instance uuid 9439468d-7a45-443b-87ce-106907761a56 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:40 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Rebasing disk image.
Apr 12 12:36:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.161s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 -F raw /opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:40 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Instance destroyed successfully.
Apr 12 12:36:40 user nova-compute[71321]: DEBUG nova.objects.instance [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lazy-loading 'resources' on Instance uuid cda12475-d730-4c07-af54-a3a64482fc94 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-51459992',display_name='tempest-TestVolumeBootPattern-volume-backed-server-51459992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-51459992',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:32:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ada441da2124adda751365952320e81',ramdisk_id='',reservation_id='r-21mh704a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-310589135',owner_user_name='tempest-TestVolumeBootPattern-310589135-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:32:14Z,user_data=None,user_id='076e65b43f664765ad1d48be6e814f40',uuid=cda12475-d730-4c07-af54-a3a64482fc94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00018f63-5e54-484b-beb9-e2aa082e0e5c", "address": "fa:16:3e:6e:1c:df", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00018f63-5e", "ovs_interfaceid": "00018f63-5e54-484b-beb9-e2aa082e0e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converting VIF {"id": "00018f63-5e54-484b-beb9-e2aa082e0e5c", "address": "fa:16:3e:6e:1c:df", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00018f63-5e", "ovs_interfaceid": "00018f63-5e54-484b-beb9-e2aa082e0e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:1c:df,bridge_name='br-int',has_traffic_filtering=True,id=00018f63-5e54-484b-beb9-e2aa082e0e5c,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00018f63-5e') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG os_vif [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:1c:df,bridge_name='br-int',has_traffic_filtering=True,id=00018f63-5e54-484b-beb9-e2aa082e0e5c,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00018f63-5e') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00018f63-5e, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:36:40 user nova-compute[71321]: INFO os_vif [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:1c:df,bridge_name='br-int',has_traffic_filtering=True,id=00018f63-5e54-484b-beb9-e2aa082e0e5c,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00018f63-5e')
Apr 12 12:36:40 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yWXIcdRN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:36:40 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:36:40 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:40 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Took 1.26 seconds to deallocate network for instance.
Apr 12 12:36:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a869d623-117b-4b06-b427-38a9ef9161e3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:36:40 user nova-compute[71321]: No targets found.
Apr 12 12:36:40 user nova-compute[71321]: iSNS:
Apr 12 12:36:40 user nova-compute[71321]: No targets found.
Apr 12 12:36:40 user nova-compute[71321]: STATIC:
Apr 12 12:36:40 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945
Apr 12 12:36:40 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:36:40 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:36:40 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54
Apr 12 12:36:40 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:36:40 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:36:40 user nova-compute[71321]: FIRMWARE:
Apr 12 12:36:40 user nova-compute[71321]: No targets found.
Apr 12 12:36:40 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:36:40 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:36:40 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[67db2b3e-8e67-41d0-932c-6bf82359be29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e8760cdc-9893-477f-afb1-bd9626caf708 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e8760cdc-9893-477f-afb1-bd9626caf708 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0596563-54a8-4880-84a1-941a35c172ce]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:36:40 user nova-compute[71321]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:36:40 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 (non-flash)
Apr 12 12:36:40 user nova-compute[71321]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:36:40 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:36:40 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef8a17a710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54'): ({'sdb'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Removing single pathed devices sdb {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0195b9-f5d6-44b6-8753-812a5f4b098c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50e2def-8236-409a-b692-185d3df12566]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Flushing IO for device /dev/sdb {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[deaa1ce6-22f0-4dcc-a8e2-d5f975e3238a]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c51674-2dc3-46e3-9157-3f05ef41fec6]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] SCSI volumes sdb have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[773abceb-c450-4a2c-835b-8942f915adc3]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1ffa46-22bb-4b03-b1fa-c457d94b8724]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54, portal: 172.16.0.220,3260]
Apr 12 12:36:41 user nova-compute[71321]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54, portal: 172.16.0.220,3260] successful.
Apr 12 12:36:41 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef33dd78-da9a-4747-9d21-9daa49f81ef5]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] <== disconnect_volume: return (373ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:36:41 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Deleting instance files /opt/stack/data/nova/instances/cda12475-d730-4c07-af54-a3a64482fc94_del
Apr 12 12:36:41 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Deletion of /opt/stack/data/nova/instances/cda12475-d730-4c07-af54-a3a64482fc94_del complete
Apr 12 12:36:41 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-e8760cdc-9893-477f-afb1-bd9626caf708 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-e8760cdc-9893-477f-afb1-bd9626caf708 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:36:41 user nova-compute[71321]: INFO nova.compute.manager [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Took 1.40 seconds to destroy the instance on the hypervisor.
Apr 12 12:36:41 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: cda12475-d730-4c07-af54-a3a64482fc94] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e8760cdc-9893-477f-afb1-bd9626caf708 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:41 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-e8760cdc-9893-477f-afb1-bd9626caf708 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Deleted allocations for instance d584edf2-12e3-48d1-947f-fdfb0c9c7377
Apr 12 12:36:41 user nova-compute[71321]: DEBUG nova.compute.manager [req-ab0810d9-09ce-4607-84b7-7288ced2c903 req-f5eab61b-445f-4484-96ca-c20401e22d48 service nova] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Received event network-vif-plugged-5fbb21e1-ece8-4e20-baa6-55fe59a41325 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ab0810d9-09ce-4607-84b7-7288ced2c903 req-f5eab61b-445f-4484-96ca-c20401e22d48 service nova] Acquiring lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ab0810d9-09ce-4607-84b7-7288ced2c903 req-f5eab61b-445f-4484-96ca-c20401e22d48 service nova] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ab0810d9-09ce-4607-84b7-7288ced2c903 req-f5eab61b-445f-4484-96ca-c20401e22d48 service nova] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG nova.compute.manager [req-ab0810d9-09ce-4607-84b7-7288ced2c903 req-f5eab61b-445f-4484-96ca-c20401e22d48 service nova] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] No waiting events found dispatching network-vif-plugged-5fbb21e1-ece8-4e20-baa6-55fe59a41325 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:36:41 user nova-compute[71321]: WARNING nova.compute.manager [req-ab0810d9-09ce-4607-84b7-7288ced2c903 req-f5eab61b-445f-4484-96ca-c20401e22d48 service nova] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Received unexpected event network-vif-plugged-5fbb21e1-ece8-4e20-baa6-55fe59a41325 for instance with vm_state deleted and task_state None.
Apr 12 12:36:41 user nova-compute[71321]: DEBUG nova.compute.manager [req-ab0810d9-09ce-4607-84b7-7288ced2c903 req-f5eab61b-445f-4484-96ca-c20401e22d48 service nova] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Received event network-vif-plugged-5fbb21e1-ece8-4e20-baa6-55fe59a41325 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ab0810d9-09ce-4607-84b7-7288ced2c903 req-f5eab61b-445f-4484-96ca-c20401e22d48 service nova] Acquiring lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ab0810d9-09ce-4607-84b7-7288ced2c903 req-f5eab61b-445f-4484-96ca-c20401e22d48 service nova] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ab0810d9-09ce-4607-84b7-7288ced2c903 req-f5eab61b-445f-4484-96ca-c20401e22d48 service nova] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG nova.compute.manager [req-ab0810d9-09ce-4607-84b7-7288ced2c903 req-f5eab61b-445f-4484-96ca-c20401e22d48 service nova] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] No waiting events found dispatching network-vif-plugged-5fbb21e1-ece8-4e20-baa6-55fe59a41325 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:36:41 user nova-compute[71321]: WARNING nova.compute.manager [req-ab0810d9-09ce-4607-84b7-7288ced2c903 req-f5eab61b-445f-4484-96ca-c20401e22d48 service nova] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Received unexpected event network-vif-plugged-5fbb21e1-ece8-4e20-baa6-55fe59a41325 for instance with vm_state deleted and task_state None.
Apr 12 12:36:41 user nova-compute[71321]: DEBUG nova.compute.manager [req-ab0810d9-09ce-4607-84b7-7288ced2c903 req-f5eab61b-445f-4484-96ca-c20401e22d48 service nova] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Received event network-vif-deleted-5fbb21e1-ece8-4e20-baa6-55fe59a41325 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG nova.compute.manager [req-ab0810d9-09ce-4607-84b7-7288ced2c903 req-f5eab61b-445f-4484-96ca-c20401e22d48 service nova] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Received event network-vif-unplugged-00018f63-5e54-484b-beb9-e2aa082e0e5c {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ab0810d9-09ce-4607-84b7-7288ced2c903 req-f5eab61b-445f-4484-96ca-c20401e22d48 service nova] Acquiring lock "cda12475-d730-4c07-af54-a3a64482fc94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ab0810d9-09ce-4607-84b7-7288ced2c903 req-f5eab61b-445f-4484-96ca-c20401e22d48 service nova] Lock "cda12475-d730-4c07-af54-a3a64482fc94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ab0810d9-09ce-4607-84b7-7288ced2c903 req-f5eab61b-445f-4484-96ca-c20401e22d48 service nova] Lock "cda12475-d730-4c07-af54-a3a64482fc94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG nova.compute.manager [req-ab0810d9-09ce-4607-84b7-7288ced2c903 req-f5eab61b-445f-4484-96ca-c20401e22d48 service nova] [instance: cda12475-d730-4c07-af54-a3a64482fc94] No waiting events found dispatching network-vif-unplugged-00018f63-5e54-484b-beb9-e2aa082e0e5c {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG nova.compute.manager [req-ab0810d9-09ce-4607-84b7-7288ced2c903 req-f5eab61b-445f-4484-96ca-c20401e22d48 service nova] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Received event network-vif-unplugged-00018f63-5e54-484b-beb9-e2aa082e0e5c for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e8760cdc-9893-477f-afb1-bd9626caf708 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "d584edf2-12e3-48d1-947f-fdfb0c9c7377" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.322s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:41 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 -F raw /opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk" returned: 0 in 2.395s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Ensure instance console log exists: /opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Start _get_guest_xml network_info=[{"id": "67b56c74-fc25-4bc8-875e-8a134830124b", "address": "fa:16:3e:14:ba:2c", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b56c74-fc", "ovs_interfaceid": "67b56c74-fc25-4bc8-875e-8a134830124b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='686ab114b3a535a276ebae5d3f039e67',container_format='bare',created_at=2023-04-12T12:34:37Z,direct_url=<?>,disk_format='qcow2',id=3b243368-b9ac-481a-9051-c0bd3cadb017,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-806455308-shelved',owner='5fec0c6dc7ab46b0b6b0a580252f40e3',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-12T12:34:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '01870c78-631b-4cee-ab09-3533b7845ccd', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fTvwiPuO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '9439468d-7a45-443b-87ce-106907761a56', 'attached_at': '', 'detached_at': '', 'volume_id': 'b9c08f12-a467-4152-a8fb-00aef87ac9c9', 'serial': 'b9c08f12-a467-4152-a8fb-00aef87ac9c9'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:36:42 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Took 1.29 seconds to deallocate network for instance.
Apr 12 12:36:42 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:36:42 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:36:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='686ab114b3a535a276ebae5d3f039e67',container_format='bare',created_at=2023-04-12T12:34:37Z,direct_url=<?>,disk_format='qcow2',id=3b243368-b9ac-481a-9051-c0bd3cadb017,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-806455308-shelved',owner='5fec0c6dc7ab46b0b6b0a580252f40e3',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-12T12:34:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG nova.objects.instance [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9439468d-7a45-443b-87ce-106907761a56 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fTvwiPuO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:36:42 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:36:42 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:36:42 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:36:42 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:36:42 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:36:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 -p 172.16.0.220:3260" returned: 21 in 0.039s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[429c626f-5b36-4f4b-91f2-28ee51308e67]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:36:42 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9b1efe-a669-407e-85bf-64e0a38f9ec8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9] added
Apr 12 12:36:42 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[744dcc1e-bcc7-4405-8aab-3bb2c50bdf86]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae846a69-853b-4d26-ba48-072fbdc00619]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fTvwiPuO {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fTvwiPuO" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca5f35e-9075-4e75-9d66-6c3d322019a0]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fTvwiPuO'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.035s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[576a4d31-b32a-4e89-9a67-13b62ec77c83]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[60706084-8796-48ad-8a4b-97dfff5b3aad]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:36:42 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:36:42 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:36:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:43 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf427f94-7cce-432b-a10e-a7f2ae29216a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9, portal: 172.16.0.220,3260]
Apr 12 12:36:43 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9, portal: 172.16.0.220,3260] successful.
Apr 12 12:36:43 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:36:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:43 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e895506-93c7-4d9d-84f5-f28744b00394]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:36:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:43 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1bc9c6-826c-4b46-a05a-74d4c64c645b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:36:43 user nova-compute[71321]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 (non-flash)
Apr 12 12:36:43 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:36:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:36:43 user nova-compute[71321]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 (non-flash)
Apr 12 12:36:43 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:36:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:36:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:36:43 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:36:43 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:36:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:43 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98b44b2-14ac-461b-9a68-7734b26565b1]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:43 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:36:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fTvwiPuO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:36:43 user nova-compute[71321]: INFO nova.compute.manager [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Took 0.85 seconds to detach 1 volumes for instance.
Apr 12 12:36:43 user nova-compute[71321]: DEBUG nova.compute.manager [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Deleting volume: f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54 {{(pid=71321) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 12:36:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:43 user nova-compute[71321]: DEBUG nova.compute.manager [req-3a0f1eb8-d0e2-4f27-b521-5a71a6b25251 req-dcc15e9e-87e1-4ce8-87c9-5eff69e8aaf1 service nova] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Received event network-vif-plugged-00018f63-5e54-484b-beb9-e2aa082e0e5c {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:36:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3a0f1eb8-d0e2-4f27-b521-5a71a6b25251 req-dcc15e9e-87e1-4ce8-87c9-5eff69e8aaf1 service nova] Acquiring lock "cda12475-d730-4c07-af54-a3a64482fc94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3a0f1eb8-d0e2-4f27-b521-5a71a6b25251 req-dcc15e9e-87e1-4ce8-87c9-5eff69e8aaf1 service nova] Lock "cda12475-d730-4c07-af54-a3a64482fc94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3a0f1eb8-d0e2-4f27-b521-5a71a6b25251 req-dcc15e9e-87e1-4ce8-87c9-5eff69e8aaf1 service nova] Lock "cda12475-d730-4c07-af54-a3a64482fc94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:43 user nova-compute[71321]: DEBUG nova.compute.manager [req-3a0f1eb8-d0e2-4f27-b521-5a71a6b25251 req-dcc15e9e-87e1-4ce8-87c9-5eff69e8aaf1 service nova] [instance: cda12475-d730-4c07-af54-a3a64482fc94] No waiting events found dispatching network-vif-plugged-00018f63-5e54-484b-beb9-e2aa082e0e5c {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:36:43 user nova-compute[71321]: WARNING nova.compute.manager [req-3a0f1eb8-d0e2-4f27-b521-5a71a6b25251 req-dcc15e9e-87e1-4ce8-87c9-5eff69e8aaf1 service nova] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Received unexpected event network-vif-plugged-00018f63-5e54-484b-beb9-e2aa082e0e5c for instance with vm_state deleted and task_state None.
Apr 12 12:36:43 user nova-compute[71321]: DEBUG nova.compute.manager [req-3a0f1eb8-d0e2-4f27-b521-5a71a6b25251 req-dcc15e9e-87e1-4ce8-87c9-5eff69e8aaf1 service nova] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Received event network-vif-deleted-00018f63-5e54-484b-beb9-e2aa082e0e5c {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:36:43 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:36:43 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:36:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:44 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Deleted allocations for instance cda12475-d730-4c07-af54-a3a64482fc94
Apr 12 12:36:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "cda12475-d730-4c07-af54-a3a64482fc94" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.147s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:36:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23233646139383932', 'path': '/dev/sdb'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:36:44 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233646139383932', 'path': '/dev/sdb'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:36:44 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T12:32:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-806455308',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-806455308',id=16,image_ref='3b243368-b9ac-481a-9051-c0bd3cadb017',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-250399543',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:32:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5fec0c6dc7ab46b0b6b0a580252f40e3',ramdisk_id='',reservation_id='r-d9g2es3z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2036744628',owner_user_name='tempest-AttachVolumeShelveTestJSON-2036744628-project-member',shelved_at='2023-04-12T12:34:41.596118',shelved_host='user',shelved_image_id='3b243368-b9ac-481a-9051-c0bd3cadb017'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:36:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e4935eed324b868477f8e88918364a',uuid=9439468d-7a45-443b-87ce-106907761a56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "67b56c74-fc25-4bc8-875e-8a134830124b", "address": "fa:16:3e:14:ba:2c", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b56c74-fc", "ovs_interfaceid": "67b56c74-fc25-4bc8-875e-8a134830124b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:36:44 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Converting VIF {"id": "67b56c74-fc25-4bc8-875e-8a134830124b", "address": "fa:16:3e:14:ba:2c", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b56c74-fc", "ovs_interfaceid": "67b56c74-fc25-4bc8-875e-8a134830124b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:36:44 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:ba:2c,bridge_name='br-int',has_traffic_filtering=True,id=67b56c74-fc25-4bc8-875e-8a134830124b,network=Network(4ba97279-e122-4c2b-b931-dde33e1d71df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b56c74-fc') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:36:44 user nova-compute[71321]: DEBUG nova.objects.instance [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lazy-loading 'pci_devices' on Instance uuid 9439468d-7a45-443b-87ce-106907761a56 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:36:44 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:36:44 user nova-compute[71321]:   <uuid>9439468d-7a45-443b-87ce-106907761a56</uuid>
Apr 12 12:36:44 user nova-compute[71321]:   <name>instance-00000010</name>
Apr 12 12:36:44 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:36:44 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:36:44 user nova-compute[71321]:   <metadata>
Apr 12 12:36:44 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:36:44 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:36:44 user nova-compute[71321]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-806455308</nova:name>
Apr 12 12:36:44 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:36:42</nova:creationTime>
Apr 12 12:36:44 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:36:44 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:36:44 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:36:44 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:36:44 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:36:44 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:36:44 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:36:44 user nova-compute[71321]:       <nova:owner>
Apr 12 12:36:44 user nova-compute[71321]:         <nova:user uuid="46e4935eed324b868477f8e88918364a">tempest-AttachVolumeShelveTestJSON-2036744628-project-member</nova:user>
Apr 12 12:36:44 user nova-compute[71321]:         <nova:project uuid="5fec0c6dc7ab46b0b6b0a580252f40e3">tempest-AttachVolumeShelveTestJSON-2036744628</nova:project>
Apr 12 12:36:44 user nova-compute[71321]:       </nova:owner>
Apr 12 12:36:44 user nova-compute[71321]:       <nova:root type="image" uuid="3b243368-b9ac-481a-9051-c0bd3cadb017"/>
Apr 12 12:36:44 user nova-compute[71321]:       <nova:ports>
Apr 12 12:36:44 user nova-compute[71321]:         <nova:port uuid="67b56c74-fc25-4bc8-875e-8a134830124b">
Apr 12 12:36:44 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 12:36:44 user nova-compute[71321]:         </nova:port>
Apr 12 12:36:44 user nova-compute[71321]:       </nova:ports>
Apr 12 12:36:44 user nova-compute[71321]:     </nova:instance>
Apr 12 12:36:44 user nova-compute[71321]:   </metadata>
Apr 12 12:36:44 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:36:44 user nova-compute[71321]:     <system>
Apr 12 12:36:44 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:36:44 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:36:44 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:36:44 user nova-compute[71321]:       <entry name="serial">9439468d-7a45-443b-87ce-106907761a56</entry>
Apr 12 12:36:44 user nova-compute[71321]:       <entry name="uuid">9439468d-7a45-443b-87ce-106907761a56</entry>
Apr 12 12:36:44 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:36:44 user nova-compute[71321]:     </system>
Apr 12 12:36:44 user nova-compute[71321]:   </sysinfo>
Apr 12 12:36:44 user nova-compute[71321]:   <os>
Apr 12 12:36:44 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:36:44 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:36:44 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:36:44 user nova-compute[71321]:   </os>
Apr 12 12:36:44 user nova-compute[71321]:   <features>
Apr 12 12:36:44 user nova-compute[71321]:     <acpi/>
Apr 12 12:36:44 user nova-compute[71321]:     <apic/>
Apr 12 12:36:44 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:36:44 user nova-compute[71321]:   </features>
Apr 12 12:36:44 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:36:44 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:36:44 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:36:44 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:36:44 user nova-compute[71321]:   </clock>
Apr 12 12:36:44 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:36:44 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:36:44 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:36:44 user nova-compute[71321]:   </cpu>
Apr 12 12:36:44 user nova-compute[71321]:   <devices>
Apr 12 12:36:44 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:36:44 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:36:44 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk"/>
Apr 12 12:36:44 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:36:44 user nova-compute[71321]:     </disk>
Apr 12 12:36:44 user nova-compute[71321]:     <disk type="block" device="disk">
Apr 12 12:36:44 user nova-compute[71321]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:36:44 user nova-compute[71321]:       <source dev="/dev/sdb"/>
Apr 12 12:36:44 user nova-compute[71321]:       <target dev="vdc" bus="virtio"/>
Apr 12 12:36:44 user nova-compute[71321]:       <serial>b9c08f12-a467-4152-a8fb-00aef87ac9c9</serial>
Apr 12 12:36:44 user nova-compute[71321]:     </disk>
Apr 12 12:36:44 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:36:44 user nova-compute[71321]:       <mac address="fa:16:3e:14:ba:2c"/>
Apr 12 12:36:44 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:36:44 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:36:44 user nova-compute[71321]:       <target dev="tap67b56c74-fc"/>
Apr 12 12:36:44 user nova-compute[71321]:     </interface>
Apr 12 12:36:44 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:36:44 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/console.log" append="off"/>
Apr 12 12:36:44 user nova-compute[71321]:     </serial>
Apr 12 12:36:44 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:36:44 user nova-compute[71321]:     <video>
Apr 12 12:36:44 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:36:44 user nova-compute[71321]:     </video>
Apr 12 12:36:44 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:36:44 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:36:44 user nova-compute[71321]:     </rng>
Apr 12 12:36:44 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:36:44 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:36:44 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:36:44 user nova-compute[71321]:     </memballoon>
Apr 12 12:36:44 user nova-compute[71321]:   </devices>
Apr 12 12:36:44 user nova-compute[71321]: </domain>
Apr 12 12:36:44 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:36:44 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T12:32:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-806455308',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-806455308',id=16,image_ref='3b243368-b9ac-481a-9051-c0bd3cadb017',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-250399543',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:32:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5fec0c6dc7ab46b0b6b0a580252f40e3',ramdisk_id='',reservation_id='r-d9g2es3z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2036744628',owner_user_name='tempest-AttachVolumeShelveTestJSON-2036744628-project-member',shelved_at='2023-04-12T12:34:41.596118',shelved_host='user',shelved_image_id='3b243368-b9ac-481a-9051-c0bd3cadb017'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:36:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e4935eed324b868477f8e88918364a',uuid=9439468d-7a45-443b-87ce-106907761a56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "67b56c74-fc25-4bc8-875e-8a134830124b", "address": "fa:16:3e:14:ba:2c", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b56c74-fc", "ovs_interfaceid": "67b56c74-fc25-4bc8-875e-8a134830124b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:36:44 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Converting VIF {"id": "67b56c74-fc25-4bc8-875e-8a134830124b", "address": "fa:16:3e:14:ba:2c", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b56c74-fc", "ovs_interfaceid": "67b56c74-fc25-4bc8-875e-8a134830124b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:36:44 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:ba:2c,bridge_name='br-int',has_traffic_filtering=True,id=67b56c74-fc25-4bc8-875e-8a134830124b,network=Network(4ba97279-e122-4c2b-b931-dde33e1d71df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b56c74-fc') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:36:44 user nova-compute[71321]: DEBUG os_vif [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:ba:2c,bridge_name='br-int',has_traffic_filtering=True,id=67b56c74-fc25-4bc8-875e-8a134830124b,network=Network(4ba97279-e122-4c2b-b931-dde33e1d71df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b56c74-fc') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:36:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:36:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:36:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67b56c74-fc, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:36:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap67b56c74-fc, col_values=(('external_ids', {'iface-id': '67b56c74-fc25-4bc8-875e-8a134830124b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:ba:2c', 'vm-uuid': '9439468d-7a45-443b-87ce-106907761a56'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:36:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:36:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:44 user nova-compute[71321]: INFO os_vif [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:ba:2c,bridge_name='br-int',has_traffic_filtering=True,id=67b56c74-fc25-4bc8-875e-8a134830124b,network=Network(4ba97279-e122-4c2b-b931-dde33e1d71df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b56c74-fc')
Apr 12 12:36:44 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:36:44 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:36:44 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] No VIF found with MAC fa:16:3e:14:ba:2c, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:36:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:46 user nova-compute[71321]: DEBUG nova.compute.manager [req-7415841b-754d-43d9-938f-ee54939fde55 req-fb22ec50-7033-4501-987e-342840c0209c service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Received event network-vif-plugged-67b56c74-fc25-4bc8-875e-8a134830124b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:36:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7415841b-754d-43d9-938f-ee54939fde55 req-fb22ec50-7033-4501-987e-342840c0209c service nova] Acquiring lock "9439468d-7a45-443b-87ce-106907761a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7415841b-754d-43d9-938f-ee54939fde55 req-fb22ec50-7033-4501-987e-342840c0209c service nova] Lock "9439468d-7a45-443b-87ce-106907761a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7415841b-754d-43d9-938f-ee54939fde55 req-fb22ec50-7033-4501-987e-342840c0209c service nova] Lock "9439468d-7a45-443b-87ce-106907761a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:46 user nova-compute[71321]: DEBUG nova.compute.manager [req-7415841b-754d-43d9-938f-ee54939fde55 req-fb22ec50-7033-4501-987e-342840c0209c service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] No waiting events found dispatching network-vif-plugged-67b56c74-fc25-4bc8-875e-8a134830124b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:36:46 user nova-compute[71321]: WARNING nova.compute.manager [req-7415841b-754d-43d9-938f-ee54939fde55 req-fb22ec50-7033-4501-987e-342840c0209c service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Received unexpected event network-vif-plugged-67b56c74-fc25-4bc8-875e-8a134830124b for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 12:36:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "89cc5f86-c387-4966-8bbf-a64d42d30db7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:47 user nova-compute[71321]: DEBUG nova.compute.manager [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:36:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:47 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:36:47 user nova-compute[71321]: INFO nova.compute.claims [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Claim successful on node user
Apr 12 12:36:48 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303008.137288, 9439468d-7a45-443b-87ce-106907761a56 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:36:48 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 9439468d-7a45-443b-87ce-106907761a56] VM Resumed (Lifecycle Event)
Apr 12 12:36:48 user nova-compute[71321]: DEBUG nova.compute.manager [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:36:48 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 9439468d-7a45-443b-87ce-106907761a56] Instance spawned successfully.
Apr 12 12:36:48 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 9439468d-7a45-443b-87ce-106907761a56] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG nova.compute.manager [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 9439468d-7a45-443b-87ce-106907761a56] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:36:48 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 9439468d-7a45-443b-87ce-106907761a56] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:36:48 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303008.143335, 9439468d-7a45-443b-87ce-106907761a56 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:36:48 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 9439468d-7a45-443b-87ce-106907761a56] VM Started (Lifecycle Event)
Apr 12 12:36:48 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 9439468d-7a45-443b-87ce-106907761a56] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 9439468d-7a45-443b-87ce-106907761a56] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-515ddde5-64ff-483d-98b0-894ac61ba3a0 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "fe72c043-e035-4926-8f7f-455285f0dbe8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-515ddde5-64ff-483d-98b0-894ac61ba3a0 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "fe72c043-e035-4926-8f7f-455285f0dbe8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-515ddde5-64ff-483d-98b0-894ac61ba3a0 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "fe72c043-e035-4926-8f7f-455285f0dbe8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-515ddde5-64ff-483d-98b0-894ac61ba3a0 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "fe72c043-e035-4926-8f7f-455285f0dbe8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-515ddde5-64ff-483d-98b0-894ac61ba3a0 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "fe72c043-e035-4926-8f7f-455285f0dbe8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:48 user nova-compute[71321]: INFO nova.compute.manager [None req-515ddde5-64ff-483d-98b0-894ac61ba3a0 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Terminating instance
Apr 12 12:36:48 user nova-compute[71321]: DEBUG nova.compute.manager [None req-515ddde5-64ff-483d-98b0-894ac61ba3a0 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG nova.compute.manager [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG nova.network.neutron [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:36:48 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 9439468d-7a45-443b-87ce-106907761a56] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:36:48 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:36:48 user nova-compute[71321]: DEBUG nova.compute.manager [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG nova.compute.manager [req-2c811ced-8c5f-459d-8353-fc5ae1389e91 req-cb0d431b-c984-48db-a77c-ab6dc0396887 service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Received event network-vif-plugged-67b56c74-fc25-4bc8-875e-8a134830124b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2c811ced-8c5f-459d-8353-fc5ae1389e91 req-cb0d431b-c984-48db-a77c-ab6dc0396887 service nova] Acquiring lock "9439468d-7a45-443b-87ce-106907761a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2c811ced-8c5f-459d-8353-fc5ae1389e91 req-cb0d431b-c984-48db-a77c-ab6dc0396887 service nova] Lock "9439468d-7a45-443b-87ce-106907761a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2c811ced-8c5f-459d-8353-fc5ae1389e91 req-cb0d431b-c984-48db-a77c-ab6dc0396887 service nova] Lock "9439468d-7a45-443b-87ce-106907761a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG nova.compute.manager [req-2c811ced-8c5f-459d-8353-fc5ae1389e91 req-cb0d431b-c984-48db-a77c-ab6dc0396887 service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] No waiting events found dispatching network-vif-plugged-67b56c74-fc25-4bc8-875e-8a134830124b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:36:48 user nova-compute[71321]: WARNING nova.compute.manager [req-2c811ced-8c5f-459d-8353-fc5ae1389e91 req-cb0d431b-c984-48db-a77c-ab6dc0396887 service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Received unexpected event network-vif-plugged-67b56c74-fc25-4bc8-875e-8a134830124b for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 12:36:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG nova.compute.manager [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG nova.compute.manager [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:36:48 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Creating image(s)
Apr 12 12:36:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "/opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "/opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "/opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "9439468d-7a45-443b-87ce-106907761a56" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.797s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG nova.compute.manager [req-fe40c372-65ae-49db-8acc-3be0772e5973 req-2d05324c-4ded-40f6-9a23-b2e1cb032453 service nova] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Received event network-vif-unplugged-2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-fe40c372-65ae-49db-8acc-3be0772e5973 req-2d05324c-4ded-40f6-9a23-b2e1cb032453 service nova] Acquiring lock "fe72c043-e035-4926-8f7f-455285f0dbe8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-fe40c372-65ae-49db-8acc-3be0772e5973 req-2d05324c-4ded-40f6-9a23-b2e1cb032453 service nova] Lock "fe72c043-e035-4926-8f7f-455285f0dbe8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-fe40c372-65ae-49db-8acc-3be0772e5973 req-2d05324c-4ded-40f6-9a23-b2e1cb032453 service nova] Lock "fe72c043-e035-4926-8f7f-455285f0dbe8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG nova.compute.manager [req-fe40c372-65ae-49db-8acc-3be0772e5973 req-2d05324c-4ded-40f6-9a23-b2e1cb032453 service nova] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] No waiting events found dispatching network-vif-unplugged-2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG nova.compute.manager [req-fe40c372-65ae-49db-8acc-3be0772e5973 req-2d05324c-4ded-40f6-9a23-b2e1cb032453 service nova] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Received event network-vif-unplugged-2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.183s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG nova.policy [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1db0203a6e6f4cc3bccbf19577a0c82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ec9671123c4a00a2880de4b4df8d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.183s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk 1073741824" returned: 0 in 0.058s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:49 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Instance destroyed successfully.
Apr 12 12:36:49 user nova-compute[71321]: DEBUG nova.objects.instance [None req-515ddde5-64ff-483d-98b0-894ac61ba3a0 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lazy-loading 'resources' on Instance uuid fe72c043-e035-4926-8f7f-455285f0dbe8 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:36:49 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-515ddde5-64ff-483d-98b0-894ac61ba3a0 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:34:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1900654939',display_name='tempest-ServersNegativeTestJSON-server-1900654939',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1900654939',id=21,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:35:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ab04e4f968f4c07af43f3fe6651713a',ramdisk_id='',reservation_id='r-7qqrkhco',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1331801987',owner_user_name='tempest-ServersNegativeTestJSON-1331801987-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:35:05Z,user_data=None,user_id='bc42504b7aab4fedb136acd998adeddb',uuid=fe72c043-e035-4926-8f7f-455285f0dbe8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd", "address": "fa:16:3e:97:e5:5f", "network": {"id": "963759e8-808d-494c-9dea-0efa9f78804a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-684057570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ab04e4f968f4c07af43f3fe6651713a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5696a6-8f", "ovs_interfaceid": "2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:36:49 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-515ddde5-64ff-483d-98b0-894ac61ba3a0 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Converting VIF {"id": "2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd", "address": "fa:16:3e:97:e5:5f", "network": {"id": "963759e8-808d-494c-9dea-0efa9f78804a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-684057570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ab04e4f968f4c07af43f3fe6651713a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5696a6-8f", "ovs_interfaceid": "2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:36:49 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-515ddde5-64ff-483d-98b0-894ac61ba3a0 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:e5:5f,bridge_name='br-int',has_traffic_filtering=True,id=2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd,network=Network(963759e8-808d-494c-9dea-0efa9f78804a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a5696a6-8f') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:36:49 user nova-compute[71321]: DEBUG os_vif [None req-515ddde5-64ff-483d-98b0-894ac61ba3a0 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:e5:5f,bridge_name='br-int',has_traffic_filtering=True,id=2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd,network=Network(963759e8-808d-494c-9dea-0efa9f78804a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a5696a6-8f') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:36:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.193s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a5696a6-8f, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:36:49 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Checking if we can resize image /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:36:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:36:49 user nova-compute[71321]: INFO os_vif [None req-515ddde5-64ff-483d-98b0-894ac61ba3a0 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:e5:5f,bridge_name='br-int',has_traffic_filtering=True,id=2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd,network=Network(963759e8-808d-494c-9dea-0efa9f78804a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a5696a6-8f')
Apr 12 12:36:49 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-515ddde5-64ff-483d-98b0-894ac61ba3a0 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Deleting instance files /opt/stack/data/nova/instances/fe72c043-e035-4926-8f7f-455285f0dbe8_del
Apr 12 12:36:49 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-515ddde5-64ff-483d-98b0-894ac61ba3a0 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Deletion of /opt/stack/data/nova/instances/fe72c043-e035-4926-8f7f-455285f0dbe8_del complete
Apr 12 12:36:49 user nova-compute[71321]: INFO nova.compute.manager [None req-515ddde5-64ff-483d-98b0-894ac61ba3a0 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Took 1.07 seconds to destroy the instance on the hypervisor.
Apr 12 12:36:49 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-515ddde5-64ff-483d-98b0-894ac61ba3a0 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:36:49 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:36:49 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:36:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:49 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Cannot resize image /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:36:49 user nova-compute[71321]: DEBUG nova.objects.instance [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'migration_context' on Instance uuid 89cc5f86-c387-4966-8bbf-a64d42d30db7 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:36:49 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:36:49 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Ensure instance console log exists: /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:36:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:50 user nova-compute[71321]: DEBUG nova.network.neutron [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Successfully created port: c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:36:50 user nova-compute[71321]: DEBUG nova.compute.manager [req-659aa3e8-33ad-405d-80d0-16ebf4fc9ba7 req-03859aa1-54be-4783-901f-9510a72bf673 service nova] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Received event network-vif-plugged-2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:36:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-659aa3e8-33ad-405d-80d0-16ebf4fc9ba7 req-03859aa1-54be-4783-901f-9510a72bf673 service nova] Acquiring lock "fe72c043-e035-4926-8f7f-455285f0dbe8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-659aa3e8-33ad-405d-80d0-16ebf4fc9ba7 req-03859aa1-54be-4783-901f-9510a72bf673 service nova] Lock "fe72c043-e035-4926-8f7f-455285f0dbe8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-659aa3e8-33ad-405d-80d0-16ebf4fc9ba7 req-03859aa1-54be-4783-901f-9510a72bf673 service nova] Lock "fe72c043-e035-4926-8f7f-455285f0dbe8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:50 user nova-compute[71321]: DEBUG nova.compute.manager [req-659aa3e8-33ad-405d-80d0-16ebf4fc9ba7 req-03859aa1-54be-4783-901f-9510a72bf673 service nova] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] No waiting events found dispatching network-vif-plugged-2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:36:50 user nova-compute[71321]: WARNING nova.compute.manager [req-659aa3e8-33ad-405d-80d0-16ebf4fc9ba7 req-03859aa1-54be-4783-901f-9510a72bf673 service nova] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Received unexpected event network-vif-plugged-2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd for instance with vm_state active and task_state deleting.
Apr 12 12:36:50 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:36:50 user nova-compute[71321]: DEBUG nova.compute.manager [req-2edbea04-88a0-4625-a3d4-e662d3d3985c req-c8e84903-b5da-49ad-bffd-8c9c82d2d963 service nova] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Received event network-vif-deleted-2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:36:50 user nova-compute[71321]: INFO nova.compute.manager [req-2edbea04-88a0-4625-a3d4-e662d3d3985c req-c8e84903-b5da-49ad-bffd-8c9c82d2d963 service nova] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Neutron deleted interface 2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd; detaching it from the instance and deleting it from the info cache
Apr 12 12:36:50 user nova-compute[71321]: DEBUG nova.network.neutron [req-2edbea04-88a0-4625-a3d4-e662d3d3985c req-c8e84903-b5da-49ad-bffd-8c9c82d2d963 service nova] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:36:50 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Took 1.44 seconds to deallocate network for instance.
Apr 12 12:36:50 user nova-compute[71321]: DEBUG nova.compute.manager [req-2edbea04-88a0-4625-a3d4-e662d3d3985c req-c8e84903-b5da-49ad-bffd-8c9c82d2d963 service nova] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Detach interface failed, port_id=2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd, reason: Instance fe72c043-e035-4926-8f7f-455285f0dbe8 could not be found. {{(pid=71321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 12:36:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-515ddde5-64ff-483d-98b0-894ac61ba3a0 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-515ddde5-64ff-483d-98b0-894ac61ba3a0 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:51 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-515ddde5-64ff-483d-98b0-894ac61ba3a0 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:36:51 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-515ddde5-64ff-483d-98b0-894ac61ba3a0 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:36:51 user nova-compute[71321]: DEBUG nova.network.neutron [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Successfully updated port: c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:36:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-515ddde5-64ff-483d-98b0-894ac61ba3a0 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.595s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "refresh_cache-89cc5f86-c387-4966-8bbf-a64d42d30db7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:36:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquired lock "refresh_cache-89cc5f86-c387-4966-8bbf-a64d42d30db7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:36:51 user nova-compute[71321]: DEBUG nova.network.neutron [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:36:51 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-515ddde5-64ff-483d-98b0-894ac61ba3a0 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Deleted allocations for instance fe72c043-e035-4926-8f7f-455285f0dbe8
Apr 12 12:36:51 user nova-compute[71321]: DEBUG nova.network.neutron [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:36:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-515ddde5-64ff-483d-98b0-894ac61ba3a0 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "fe72c043-e035-4926-8f7f-455285f0dbe8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.334s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:51 user nova-compute[71321]: DEBUG nova.network.neutron [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Updating instance_info_cache with network_info: [{"id": "c3155961-f301-4a26-a599-1d648d2500b0", "address": "fa:16:3e:75:3a:c1", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3155961-f3", "ovs_interfaceid": "c3155961-f301-4a26-a599-1d648d2500b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:36:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Releasing lock "refresh_cache-89cc5f86-c387-4966-8bbf-a64d42d30db7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:36:51 user nova-compute[71321]: DEBUG nova.compute.manager [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Instance network_info: |[{"id": "c3155961-f301-4a26-a599-1d648d2500b0", "address": "fa:16:3e:75:3a:c1", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3155961-f3", "ovs_interfaceid": "c3155961-f301-4a26-a599-1d648d2500b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:36:51 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Start _get_guest_xml network_info=[{"id": "c3155961-f301-4a26-a599-1d648d2500b0", "address": "fa:16:3e:75:3a:c1", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3155961-f3", "ovs_interfaceid": "c3155961-f301-4a26-a599-1d648d2500b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:36:51 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:36:51 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:36:51 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:36:51 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:36:51 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:36:51 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:36:51 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:36:51 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:36:51 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:36:51 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:36:51 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:36:51 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:36:51 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:36:51 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:36:51 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:36:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1426605846',display_name='tempest-ServerRescueNegativeTestJSON-server-1426605846',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1426605846',id=24,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoCyqzs+8zrj4h6uGdmSsuDYdl4XZy4hARXsIlRPh7dRZ2tEg+K3UMhHPOf8n5+xfHG0dd1ftUcbN4N2gdcb3nvuvPgtvGBh8vkaOa3CldqRPPAwwxfvBWjOglZdUPChQ==',key_name='tempest-keypair-856573039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9ec9671123c4a00a2880de4b4df8d3e',ramdisk_id='',reservation_id='r-mdc0x69g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1979263125',owner_user_name='tempest-ServerRescueNegativeTestJSON-1979263125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:36:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1db0203a6e6f4cc3bccbf19577a0c82f',uuid=89cc5f86-c387-4966-8bbf-a64d42d30db7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3155961-f301-4a26-a599-1d648d2500b0", "address": "fa:16:3e:75:3a:c1", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3155961-f3", "ovs_interfaceid": "c3155961-f301-4a26-a599-1d648d2500b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:36:51 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Converting VIF {"id": "c3155961-f301-4a26-a599-1d648d2500b0", "address": "fa:16:3e:75:3a:c1", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3155961-f3", "ovs_interfaceid": "c3155961-f301-4a26-a599-1d648d2500b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:36:51 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:3a:c1,bridge_name='br-int',has_traffic_filtering=True,id=c3155961-f301-4a26-a599-1d648d2500b0,network=Network(0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3155961-f3') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:36:51 user nova-compute[71321]: DEBUG nova.objects.instance [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'pci_devices' on Instance uuid 89cc5f86-c387-4966-8bbf-a64d42d30db7 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:36:51 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:36:51 user nova-compute[71321]:   <uuid>89cc5f86-c387-4966-8bbf-a64d42d30db7</uuid>
Apr 12 12:36:51 user nova-compute[71321]:   <name>instance-00000018</name>
Apr 12 12:36:51 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:36:51 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:36:51 user nova-compute[71321]:   <metadata>
Apr 12 12:36:51 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:36:51 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:36:51 user nova-compute[71321]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1426605846</nova:name>
Apr 12 12:36:51 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:36:51</nova:creationTime>
Apr 12 12:36:51 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:36:51 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:36:51 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:36:51 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:36:51 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:36:51 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:36:51 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:36:51 user nova-compute[71321]:       <nova:owner>
Apr 12 12:36:51 user nova-compute[71321]:         <nova:user uuid="1db0203a6e6f4cc3bccbf19577a0c82f">tempest-ServerRescueNegativeTestJSON-1979263125-project-member</nova:user>
Apr 12 12:36:51 user nova-compute[71321]:         <nova:project uuid="f9ec9671123c4a00a2880de4b4df8d3e">tempest-ServerRescueNegativeTestJSON-1979263125</nova:project>
Apr 12 12:36:51 user nova-compute[71321]:       </nova:owner>
Apr 12 12:36:51 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:36:51 user nova-compute[71321]:       <nova:ports>
Apr 12 12:36:51 user nova-compute[71321]:         <nova:port uuid="c3155961-f301-4a26-a599-1d648d2500b0">
Apr 12 12:36:51 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 12:36:51 user nova-compute[71321]:         </nova:port>
Apr 12 12:36:51 user nova-compute[71321]:       </nova:ports>
Apr 12 12:36:51 user nova-compute[71321]:     </nova:instance>
Apr 12 12:36:51 user nova-compute[71321]:   </metadata>
Apr 12 12:36:51 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:36:51 user nova-compute[71321]:     <system>
Apr 12 12:36:51 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:36:51 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:36:51 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:36:51 user nova-compute[71321]:       <entry name="serial">89cc5f86-c387-4966-8bbf-a64d42d30db7</entry>
Apr 12 12:36:51 user nova-compute[71321]:       <entry name="uuid">89cc5f86-c387-4966-8bbf-a64d42d30db7</entry>
Apr 12 12:36:51 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:36:51 user nova-compute[71321]:     </system>
Apr 12 12:36:51 user nova-compute[71321]:   </sysinfo>
Apr 12 12:36:51 user nova-compute[71321]:   <os>
Apr 12 12:36:51 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:36:51 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:36:51 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:36:51 user nova-compute[71321]:   </os>
Apr 12 12:36:51 user nova-compute[71321]:   <features>
Apr 12 12:36:51 user nova-compute[71321]:     <acpi/>
Apr 12 12:36:51 user nova-compute[71321]:     <apic/>
Apr 12 12:36:51 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:36:51 user nova-compute[71321]:   </features>
Apr 12 12:36:51 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:36:51 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:36:51 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:36:51 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:36:51 user nova-compute[71321]:   </clock>
Apr 12 12:36:51 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:36:51 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:36:51 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:36:51 user nova-compute[71321]:   </cpu>
Apr 12 12:36:51 user nova-compute[71321]:   <devices>
Apr 12 12:36:51 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:36:51 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:36:51 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk"/>
Apr 12 12:36:51 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:36:51 user nova-compute[71321]:     </disk>
Apr 12 12:36:51 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:36:51 user nova-compute[71321]:       <mac address="fa:16:3e:75:3a:c1"/>
Apr 12 12:36:51 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:36:51 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:36:51 user nova-compute[71321]:       <target dev="tapc3155961-f3"/>
Apr 12 12:36:51 user nova-compute[71321]:     </interface>
Apr 12 12:36:51 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:36:51 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/console.log" append="off"/>
Apr 12 12:36:51 user nova-compute[71321]:     </serial>
Apr 12 12:36:51 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:36:51 user nova-compute[71321]:     <video>
Apr 12 12:36:51 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:36:51 user nova-compute[71321]:     </video>
Apr 12 12:36:51 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:36:51 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:36:51 user nova-compute[71321]:     </rng>
Apr 12 12:36:51 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:36:51 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:36:51 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:36:51 user nova-compute[71321]:     </memballoon>
Apr 12 12:36:51 user nova-compute[71321]:   </devices>
Apr 12 12:36:51 user nova-compute[71321]: </domain>
Apr 12 12:36:51 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:36:52 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:36:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1426605846',display_name='tempest-ServerRescueNegativeTestJSON-server-1426605846',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1426605846',id=24,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoCyqzs+8zrj4h6uGdmSsuDYdl4XZy4hARXsIlRPh7dRZ2tEg+K3UMhHPOf8n5+xfHG0dd1ftUcbN4N2gdcb3nvuvPgtvGBh8vkaOa3CldqRPPAwwxfvBWjOglZdUPChQ==',key_name='tempest-keypair-856573039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9ec9671123c4a00a2880de4b4df8d3e',ramdisk_id='',reservation_id='r-mdc0x69g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1979263125',owner_user_name='tempest-ServerRescueNegativeTestJSON-1979263125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:36:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1db0203a6e6f4cc3bccbf19577a0c82f',uuid=89cc5f86-c387-4966-8bbf-a64d42d30db7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3155961-f301-4a26-a599-1d648d2500b0", "address": "fa:16:3e:75:3a:c1", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3155961-f3", "ovs_interfaceid": "c3155961-f301-4a26-a599-1d648d2500b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:36:52 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Converting VIF {"id": "c3155961-f301-4a26-a599-1d648d2500b0", "address": "fa:16:3e:75:3a:c1", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3155961-f3", "ovs_interfaceid": "c3155961-f301-4a26-a599-1d648d2500b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:36:52 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:3a:c1,bridge_name='br-int',has_traffic_filtering=True,id=c3155961-f301-4a26-a599-1d648d2500b0,network=Network(0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3155961-f3') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:36:52 user nova-compute[71321]: DEBUG os_vif [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:3a:c1,bridge_name='br-int',has_traffic_filtering=True,id=c3155961-f301-4a26-a599-1d648d2500b0,network=Network(0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3155961-f3') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:36:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:36:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:36:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3155961-f3, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:36:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc3155961-f3, col_values=(('external_ids', {'iface-id': 'c3155961-f301-4a26-a599-1d648d2500b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:3a:c1', 'vm-uuid': '89cc5f86-c387-4966-8bbf-a64d42d30db7'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:36:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:36:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:52 user nova-compute[71321]: INFO os_vif [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:3a:c1,bridge_name='br-int',has_traffic_filtering=True,id=c3155961-f301-4a26-a599-1d648d2500b0,network=Network(0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3155961-f3')
Apr 12 12:36:52 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:36:52 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] No VIF found with MAC fa:16:3e:75:3a:c1, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:36:52 user nova-compute[71321]: DEBUG nova.compute.manager [req-98691480-49a9-4ece-980d-04dd51d73a5d req-f4b746b1-4bcc-4a72-9596-01ee483f376a service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Received event network-changed-8243f136-fe60-498f-80e1-27a598c434a3 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:36:52 user nova-compute[71321]: DEBUG nova.compute.manager [req-98691480-49a9-4ece-980d-04dd51d73a5d req-f4b746b1-4bcc-4a72-9596-01ee483f376a service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Refreshing instance network info cache due to event network-changed-8243f136-fe60-498f-80e1-27a598c434a3. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:36:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-98691480-49a9-4ece-980d-04dd51d73a5d req-f4b746b1-4bcc-4a72-9596-01ee483f376a service nova] Acquiring lock "refresh_cache-fa011231-049f-40c3-89c0-53447a35752f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:36:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-98691480-49a9-4ece-980d-04dd51d73a5d req-f4b746b1-4bcc-4a72-9596-01ee483f376a service nova] Acquired lock "refresh_cache-fa011231-049f-40c3-89c0-53447a35752f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:36:52 user nova-compute[71321]: DEBUG nova.network.neutron [req-98691480-49a9-4ece-980d-04dd51d73a5d req-f4b746b1-4bcc-4a72-9596-01ee483f376a service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Refreshing network info cache for port 8243f136-fe60-498f-80e1-27a598c434a3 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:36:52 user nova-compute[71321]: DEBUG nova.compute.manager [req-28f0a6bf-e67c-4de1-831c-36f6d9a6f4c3 req-c9e49dda-a67f-41d7-a6ba-868f11d2e197 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received event network-changed-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:36:52 user nova-compute[71321]: DEBUG nova.compute.manager [req-28f0a6bf-e67c-4de1-831c-36f6d9a6f4c3 req-c9e49dda-a67f-41d7-a6ba-868f11d2e197 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Refreshing instance network info cache due to event network-changed-c3155961-f301-4a26-a599-1d648d2500b0. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:36:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-28f0a6bf-e67c-4de1-831c-36f6d9a6f4c3 req-c9e49dda-a67f-41d7-a6ba-868f11d2e197 service nova] Acquiring lock "refresh_cache-89cc5f86-c387-4966-8bbf-a64d42d30db7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:36:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-28f0a6bf-e67c-4de1-831c-36f6d9a6f4c3 req-c9e49dda-a67f-41d7-a6ba-868f11d2e197 service nova] Acquired lock "refresh_cache-89cc5f86-c387-4966-8bbf-a64d42d30db7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:36:52 user nova-compute[71321]: DEBUG nova.network.neutron [req-28f0a6bf-e67c-4de1-831c-36f6d9a6f4c3 req-c9e49dda-a67f-41d7-a6ba-868f11d2e197 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Refreshing network info cache for port c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:36:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "fa011231-049f-40c3-89c0-53447a35752f" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "fa011231-049f-40c3-89c0-53447a35752f" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:53 user nova-compute[71321]: INFO nova.compute.manager [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Shelve offloading
Apr 12 12:36:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:54 user nova-compute[71321]: DEBUG nova.network.neutron [req-98691480-49a9-4ece-980d-04dd51d73a5d req-f4b746b1-4bcc-4a72-9596-01ee483f376a service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Updated VIF entry in instance network info cache for port 8243f136-fe60-498f-80e1-27a598c434a3. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:36:54 user nova-compute[71321]: DEBUG nova.network.neutron [req-98691480-49a9-4ece-980d-04dd51d73a5d req-f4b746b1-4bcc-4a72-9596-01ee483f376a service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Updating instance_info_cache with network_info: [{"id": "8243f136-fe60-498f-80e1-27a598c434a3", "address": "fa:16:3e:2f:02:41", "network": {"id": "34ecf1c9-50ff-4168-8650-a5277102ccaa", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730184159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a894beccbd45af9d4486772fccb949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8243f136-fe", "ovs_interfaceid": "8243f136-fe60-498f-80e1-27a598c434a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:36:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-98691480-49a9-4ece-980d-04dd51d73a5d req-f4b746b1-4bcc-4a72-9596-01ee483f376a service nova] Releasing lock "refresh_cache-fa011231-049f-40c3-89c0-53447a35752f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:36:54 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: fa011231-049f-40c3-89c0-53447a35752f] Instance destroyed successfully.
Apr 12 12:36:54 user nova-compute[71321]: DEBUG nova.compute.manager [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:36:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "refresh_cache-fa011231-049f-40c3-89c0-53447a35752f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:36:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquired lock "refresh_cache-fa011231-049f-40c3-89c0-53447a35752f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:36:54 user nova-compute[71321]: DEBUG nova.network.neutron [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:36:54 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681302999.4044282, d584edf2-12e3-48d1-947f-fdfb0c9c7377 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:36:54 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] VM Stopped (Lifecycle Event)
Apr 12 12:36:54 user nova-compute[71321]: DEBUG nova.compute.manager [None req-9fb0e9a9-55e1-421f-b24e-8b46053154f5 None None] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:36:54 user nova-compute[71321]: DEBUG nova.network.neutron [req-28f0a6bf-e67c-4de1-831c-36f6d9a6f4c3 req-c9e49dda-a67f-41d7-a6ba-868f11d2e197 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Updated VIF entry in instance network info cache for port c3155961-f301-4a26-a599-1d648d2500b0. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:36:54 user nova-compute[71321]: DEBUG nova.network.neutron [req-28f0a6bf-e67c-4de1-831c-36f6d9a6f4c3 req-c9e49dda-a67f-41d7-a6ba-868f11d2e197 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Updating instance_info_cache with network_info: [{"id": "c3155961-f301-4a26-a599-1d648d2500b0", "address": "fa:16:3e:75:3a:c1", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3155961-f3", "ovs_interfaceid": "c3155961-f301-4a26-a599-1d648d2500b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:36:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-28f0a6bf-e67c-4de1-831c-36f6d9a6f4c3 req-c9e49dda-a67f-41d7-a6ba-868f11d2e197 service nova] Releasing lock "refresh_cache-89cc5f86-c387-4966-8bbf-a64d42d30db7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:36:54 user nova-compute[71321]: DEBUG nova.network.neutron [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Updating instance_info_cache with network_info: [{"id": "8243f136-fe60-498f-80e1-27a598c434a3", "address": "fa:16:3e:2f:02:41", "network": {"id": "34ecf1c9-50ff-4168-8650-a5277102ccaa", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730184159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a894beccbd45af9d4486772fccb949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8243f136-fe", "ovs_interfaceid": "8243f136-fe60-498f-80e1-27a598c434a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:36:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Releasing lock "refresh_cache-fa011231-049f-40c3-89c0-53447a35752f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:36:54 user nova-compute[71321]: DEBUG nova.compute.manager [req-11766f80-321b-4756-aa23-206078ed6090 req-d9b6d6b8-6f37-495e-adb8-1f63b2bc55b8 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received event network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:36:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-11766f80-321b-4756-aa23-206078ed6090 req-d9b6d6b8-6f37-495e-adb8-1f63b2bc55b8 service nova] Acquiring lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-11766f80-321b-4756-aa23-206078ed6090 req-d9b6d6b8-6f37-495e-adb8-1f63b2bc55b8 service nova] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-11766f80-321b-4756-aa23-206078ed6090 req-d9b6d6b8-6f37-495e-adb8-1f63b2bc55b8 service nova] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:54 user nova-compute[71321]: DEBUG nova.compute.manager [req-11766f80-321b-4756-aa23-206078ed6090 req-d9b6d6b8-6f37-495e-adb8-1f63b2bc55b8 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] No waiting events found dispatching network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:36:54 user nova-compute[71321]: WARNING nova.compute.manager [req-11766f80-321b-4756-aa23-206078ed6090 req-d9b6d6b8-6f37-495e-adb8-1f63b2bc55b8 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received unexpected event network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 for instance with vm_state building and task_state spawning.
Apr 12 12:36:54 user nova-compute[71321]: DEBUG nova.compute.manager [req-11766f80-321b-4756-aa23-206078ed6090 req-d9b6d6b8-6f37-495e-adb8-1f63b2bc55b8 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received event network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:36:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-11766f80-321b-4756-aa23-206078ed6090 req-d9b6d6b8-6f37-495e-adb8-1f63b2bc55b8 service nova] Acquiring lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-11766f80-321b-4756-aa23-206078ed6090 req-d9b6d6b8-6f37-495e-adb8-1f63b2bc55b8 service nova] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-11766f80-321b-4756-aa23-206078ed6090 req-d9b6d6b8-6f37-495e-adb8-1f63b2bc55b8 service nova] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:54 user nova-compute[71321]: DEBUG nova.compute.manager [req-11766f80-321b-4756-aa23-206078ed6090 req-d9b6d6b8-6f37-495e-adb8-1f63b2bc55b8 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] No waiting events found dispatching network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:36:54 user nova-compute[71321]: WARNING nova.compute.manager [req-11766f80-321b-4756-aa23-206078ed6090 req-d9b6d6b8-6f37-495e-adb8-1f63b2bc55b8 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received unexpected event network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 for instance with vm_state building and task_state spawning.
Apr 12 12:36:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:54 user nova-compute[71321]: DEBUG nova.compute.manager [req-084d9944-5b96-4669-82a7-3852ae7f735a req-aa0e5e44-0dfc-434d-bc71-84a7102db804 service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Received event network-vif-unplugged-8243f136-fe60-498f-80e1-27a598c434a3 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:36:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-084d9944-5b96-4669-82a7-3852ae7f735a req-aa0e5e44-0dfc-434d-bc71-84a7102db804 service nova] Acquiring lock "fa011231-049f-40c3-89c0-53447a35752f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-084d9944-5b96-4669-82a7-3852ae7f735a req-aa0e5e44-0dfc-434d-bc71-84a7102db804 service nova] Lock "fa011231-049f-40c3-89c0-53447a35752f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-084d9944-5b96-4669-82a7-3852ae7f735a req-aa0e5e44-0dfc-434d-bc71-84a7102db804 service nova] Lock "fa011231-049f-40c3-89c0-53447a35752f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:54 user nova-compute[71321]: DEBUG nova.compute.manager [req-084d9944-5b96-4669-82a7-3852ae7f735a req-aa0e5e44-0dfc-434d-bc71-84a7102db804 service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] No waiting events found dispatching network-vif-unplugged-8243f136-fe60-498f-80e1-27a598c434a3 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:36:54 user nova-compute[71321]: WARNING nova.compute.manager [req-084d9944-5b96-4669-82a7-3852ae7f735a req-aa0e5e44-0dfc-434d-bc71-84a7102db804 service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Received unexpected event network-vif-unplugged-8243f136-fe60-498f-80e1-27a598c434a3 for instance with vm_state active and task_state shelving.
Apr 12 12:36:54 user nova-compute[71321]: DEBUG nova.compute.manager [req-084d9944-5b96-4669-82a7-3852ae7f735a req-aa0e5e44-0dfc-434d-bc71-84a7102db804 service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Received event network-vif-plugged-8243f136-fe60-498f-80e1-27a598c434a3 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:36:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-084d9944-5b96-4669-82a7-3852ae7f735a req-aa0e5e44-0dfc-434d-bc71-84a7102db804 service nova] Acquiring lock "fa011231-049f-40c3-89c0-53447a35752f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-084d9944-5b96-4669-82a7-3852ae7f735a req-aa0e5e44-0dfc-434d-bc71-84a7102db804 service nova] Lock "fa011231-049f-40c3-89c0-53447a35752f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-084d9944-5b96-4669-82a7-3852ae7f735a req-aa0e5e44-0dfc-434d-bc71-84a7102db804 service nova] Lock "fa011231-049f-40c3-89c0-53447a35752f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:54 user nova-compute[71321]: DEBUG nova.compute.manager [req-084d9944-5b96-4669-82a7-3852ae7f735a req-aa0e5e44-0dfc-434d-bc71-84a7102db804 service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] No waiting events found dispatching network-vif-plugged-8243f136-fe60-498f-80e1-27a598c434a3 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:36:54 user nova-compute[71321]: WARNING nova.compute.manager [req-084d9944-5b96-4669-82a7-3852ae7f735a req-aa0e5e44-0dfc-434d-bc71-84a7102db804 service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Received unexpected event network-vif-plugged-8243f136-fe60-498f-80e1-27a598c434a3 for instance with vm_state active and task_state shelving.
Apr 12 12:36:55 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: fa011231-049f-40c3-89c0-53447a35752f] Instance destroyed successfully.
Apr 12 12:36:55 user nova-compute[71321]: DEBUG nova.objects.instance [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lazy-loading 'resources' on Instance uuid fa011231-049f-40c3-89c0-53447a35752f {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:34:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-224414802',display_name='tempest-TestShelveInstance-server-224414802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-224414802',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIXMDy37+J0z2zjXuZ61N5MrklsBTrLDHZ5WONUVRavY0GPTGKIiOPe6k/JrTv4Yj3TrMCnYedVgrFp1+M+iVBHHlbm5MUjkvlQ73cuxRdVBOG/e8rbEfvGvKpVaF3RRQ==',key_name='tempest-TestShelveInstance-568010420',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:35:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99a894beccbd45af9d4486772fccb949',ramdisk_id='',reservation_id='r-e0ge4cua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1585323339',owner_user_name='tempest-TestShelveInstance-1585323339-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:35:11Z,user_data=None,user_id='b4b62db7ef8e4ae4bc11ff520c6afcd8',uuid=fa011231-049f-40c3-89c0-53447a35752f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8243f136-fe60-498f-80e1-27a598c434a3", "address": "fa:16:3e:2f:02:41", "network": {"id": "34ecf1c9-50ff-4168-8650-a5277102ccaa", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730184159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a894beccbd45af9d4486772fccb949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8243f136-fe", "ovs_interfaceid": "8243f136-fe60-498f-80e1-27a598c434a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Converting VIF {"id": "8243f136-fe60-498f-80e1-27a598c434a3", "address": "fa:16:3e:2f:02:41", "network": {"id": "34ecf1c9-50ff-4168-8650-a5277102ccaa", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730184159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a894beccbd45af9d4486772fccb949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8243f136-fe", "ovs_interfaceid": "8243f136-fe60-498f-80e1-27a598c434a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:02:41,bridge_name='br-int',has_traffic_filtering=True,id=8243f136-fe60-498f-80e1-27a598c434a3,network=Network(34ecf1c9-50ff-4168-8650-a5277102ccaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8243f136-fe') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG os_vif [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:02:41,bridge_name='br-int',has_traffic_filtering=True,id=8243f136-fe60-498f-80e1-27a598c434a3,network=Network(34ecf1c9-50ff-4168-8650-a5277102ccaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8243f136-fe') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8243f136-fe, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:36:55 user nova-compute[71321]: INFO os_vif [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:02:41,bridge_name='br-int',has_traffic_filtering=True,id=8243f136-fe60-498f-80e1-27a598c434a3,network=Network(34ecf1c9-50ff-4168-8650-a5277102ccaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8243f136-fe')
Apr 12 12:36:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MJbBXUwj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:36:55 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:36:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11f252c-03a5-418f-822b-0b4e32570d57]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:36:55 user nova-compute[71321]: No targets found.
Apr 12 12:36:55 user nova-compute[71321]: iSNS:
Apr 12 12:36:55 user nova-compute[71321]: No targets found.
Apr 12 12:36:55 user nova-compute[71321]: STATIC:
Apr 12 12:36:55 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9
Apr 12 12:36:55 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:36:55 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:36:55 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945
Apr 12 12:36:55 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:36:55 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:36:55 user nova-compute[71321]: FIRMWARE:
Apr 12 12:36:55 user nova-compute[71321]: No targets found.
Apr 12 12:36:55 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:36:55 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:36:55 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57e4af4-5ede-44e3-a921-404757d64246]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c98dd7-744b-4dcb-b3bb-b04f396c061f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:36:55 user nova-compute[71321]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 (non-flash)
Apr 12 12:36:55 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:36:55 user nova-compute[71321]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 (non-flash)
Apr 12 12:36:55 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef446c79a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945'): ({'sdc'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Removing single pathed devices sdc {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c4893f-4162-4fa2-99c7-c862bc0fd764]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd57e537-8ed3-4d53-b902-1bc43b95f1fd]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Flushing IO for device /dev/sdc {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1ef88e-9856-48ab-bbb6-5c0a938e9303]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.069s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[688d6a18-0782-489b-af7d-71f07239b71a]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] SCSI volumes sdc have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[76938287-7356-45f7-868b-8fd1b747df7c]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681303000.8028162, cda12475-d730-4c07-af54-a3a64482fc94 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:36:55 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: cda12475-d730-4c07-af54-a3a64482fc94] VM Stopped (Lifecycle Event)
Apr 12 12:36:55 user nova-compute[71321]: DEBUG nova.compute.manager [None req-cd713b41-65e4-47ae-bdbb-eee30bec8ed0 None None] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[33440066-a837-4b07-af21-5c597c82e127]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945, portal: 172.16.0.220,3260]
Apr 12 12:36:55 user nova-compute[71321]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945, portal: 172.16.0.220,3260] successful.
Apr 12 12:36:55 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2465db55-e064-4a56-9653-8315af597b09]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] <== disconnect_volume: return (362ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:36:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:36:55 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Deleting instance files /opt/stack/data/nova/instances/fa011231-049f-40c3-89c0-53447a35752f_del
Apr 12 12:36:55 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Deletion of /opt/stack/data/nova/instances/fa011231-049f-40c3-89c0-53447a35752f_del complete
Apr 12 12:36:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:36:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:36:56 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303016.0900328, 89cc5f86-c387-4966-8bbf-a64d42d30db7 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:36:56 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] VM Resumed (Lifecycle Event)
Apr 12 12:36:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:36:56 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Instance spawned successfully.
Apr 12 12:36:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:36:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:36:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:36:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:36:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:36:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:36:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:36:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:36:56 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:36:56 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303016.0929968, 89cc5f86-c387-4966-8bbf-a64d42d30db7 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:36:56 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] VM Started (Lifecycle Event)
Apr 12 12:36:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:36:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:36:56 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:36:56 user nova-compute[71321]: INFO nova.compute.manager [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Took 7.74 seconds to spawn the instance on the hypervisor.
Apr 12 12:36:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:36:56 user nova-compute[71321]: INFO nova.compute.manager [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Took 8.71 seconds to build instance.
Apr 12 12:36:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.831s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:57 user nova-compute[71321]: DEBUG nova.compute.manager [req-ae880407-7806-498b-bee1-67470828b139 req-e2f182f7-6624-4861-8ccc-aceca5936a26 service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Received event network-changed-8243f136-fe60-498f-80e1-27a598c434a3 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:36:57 user nova-compute[71321]: DEBUG nova.compute.manager [req-ae880407-7806-498b-bee1-67470828b139 req-e2f182f7-6624-4861-8ccc-aceca5936a26 service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Refreshing instance network info cache due to event network-changed-8243f136-fe60-498f-80e1-27a598c434a3. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:36:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ae880407-7806-498b-bee1-67470828b139 req-e2f182f7-6624-4861-8ccc-aceca5936a26 service nova] Acquiring lock "refresh_cache-fa011231-049f-40c3-89c0-53447a35752f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:36:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ae880407-7806-498b-bee1-67470828b139 req-e2f182f7-6624-4861-8ccc-aceca5936a26 service nova] Acquired lock "refresh_cache-fa011231-049f-40c3-89c0-53447a35752f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:36:57 user nova-compute[71321]: DEBUG nova.network.neutron [req-ae880407-7806-498b-bee1-67470828b139 req-e2f182f7-6624-4861-8ccc-aceca5936a26 service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Refreshing network info cache for port 8243f136-fe60-498f-80e1-27a598c434a3 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:36:57 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Deleted allocations for instance fa011231-049f-40c3-89c0-53447a35752f
Apr 12 12:36:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:36:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:36:57 user nova-compute[71321]: DEBUG nova.objects.instance [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lazy-loading 'numa_topology' on Instance uuid fa011231-049f-40c3-89c0-53447a35752f {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:36:57 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:36:57 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:36:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:57 user nova-compute[71321]: DEBUG nova.network.neutron [req-ae880407-7806-498b-bee1-67470828b139 req-e2f182f7-6624-4861-8ccc-aceca5936a26 service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Updated VIF entry in instance network info cache for port 8243f136-fe60-498f-80e1-27a598c434a3. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:36:57 user nova-compute[71321]: DEBUG nova.network.neutron [req-ae880407-7806-498b-bee1-67470828b139 req-e2f182f7-6624-4861-8ccc-aceca5936a26 service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Updating instance_info_cache with network_info: [{"id": "8243f136-fe60-498f-80e1-27a598c434a3", "address": "fa:16:3e:2f:02:41", "network": {"id": "34ecf1c9-50ff-4168-8650-a5277102ccaa", "bridge": null, "label": "tempest-TestShelveInstance-1730184159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a894beccbd45af9d4486772fccb949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8243f136-fe", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:36:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ae880407-7806-498b-bee1-67470828b139 req-e2f182f7-6624-4861-8ccc-aceca5936a26 service nova] Releasing lock "refresh_cache-fa011231-049f-40c3-89c0-53447a35752f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:36:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "fa011231-049f-40c3-89c0-53447a35752f" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.617s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:36:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:04 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681303009.14257, fe72c043-e035-4926-8f7f-455285f0dbe8 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:37:04 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] VM Stopped (Lifecycle Event)
Apr 12 12:37:04 user nova-compute[71321]: DEBUG nova.compute.manager [None req-c9308774-e62f-4038-82f1-eeae95ce7143 None None] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:37:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4672d577-a1ac-4287-b158-13d9c4b0c9b3 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "c24566ee-48cd-4cc4-aaea-28b1eae34fad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:37:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4672d577-a1ac-4287-b158-13d9c4b0c9b3 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "c24566ee-48cd-4cc4-aaea-28b1eae34fad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:37:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4672d577-a1ac-4287-b158-13d9c4b0c9b3 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "c24566ee-48cd-4cc4-aaea-28b1eae34fad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:37:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4672d577-a1ac-4287-b158-13d9c4b0c9b3 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "c24566ee-48cd-4cc4-aaea-28b1eae34fad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:37:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4672d577-a1ac-4287-b158-13d9c4b0c9b3 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "c24566ee-48cd-4cc4-aaea-28b1eae34fad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:37:07 user nova-compute[71321]: INFO nova.compute.manager [None req-4672d577-a1ac-4287-b158-13d9c4b0c9b3 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Terminating instance
Apr 12 12:37:07 user nova-compute[71321]: DEBUG nova.compute.manager [None req-4672d577-a1ac-4287-b158-13d9c4b0c9b3 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:37:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:08 user nova-compute[71321]: DEBUG nova.compute.manager [req-f717736a-5032-4e54-88f9-523599b17021 req-a912d26f-702d-425d-8fcd-acd68ba70695 service nova] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Received event network-vif-unplugged-1df30b7e-ae74-466e-8076-8ba92f855cc8 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:37:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f717736a-5032-4e54-88f9-523599b17021 req-a912d26f-702d-425d-8fcd-acd68ba70695 service nova] Acquiring lock "c24566ee-48cd-4cc4-aaea-28b1eae34fad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:37:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f717736a-5032-4e54-88f9-523599b17021 req-a912d26f-702d-425d-8fcd-acd68ba70695 service nova] Lock "c24566ee-48cd-4cc4-aaea-28b1eae34fad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:37:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f717736a-5032-4e54-88f9-523599b17021 req-a912d26f-702d-425d-8fcd-acd68ba70695 service nova] Lock "c24566ee-48cd-4cc4-aaea-28b1eae34fad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:37:08 user nova-compute[71321]: DEBUG nova.compute.manager [req-f717736a-5032-4e54-88f9-523599b17021 req-a912d26f-702d-425d-8fcd-acd68ba70695 service nova] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] No waiting events found dispatching network-vif-unplugged-1df30b7e-ae74-466e-8076-8ba92f855cc8 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:37:08 user nova-compute[71321]: DEBUG nova.compute.manager [req-f717736a-5032-4e54-88f9-523599b17021 req-a912d26f-702d-425d-8fcd-acd68ba70695 service nova] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Received event network-vif-unplugged-1df30b7e-ae74-466e-8076-8ba92f855cc8 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:37:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:08 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Instance destroyed successfully.
Apr 12 12:37:08 user nova-compute[71321]: DEBUG nova.objects.instance [None req-4672d577-a1ac-4287-b158-13d9c4b0c9b3 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lazy-loading 'resources' on Instance uuid c24566ee-48cd-4cc4-aaea-28b1eae34fad {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:37:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-4672d577-a1ac-4287-b158-13d9c4b0c9b3 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:35:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-844880205',display_name='tempest-VolumesAdminNegativeTest-server-844880205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-844880205',id=23,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:35:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d607e0aed1f47129540181261c6ebc7',ramdisk_id='',reservation_id='r-q4ly7tj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-714206228',owner_user_name='tempest-VolumesAdminNegativeTest-714206228-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:35:19Z,user_data=None,user_id='b3a887c10bf74974a648e3ec048fcdd7',uuid=c24566ee-48cd-4cc4-aaea-28b1eae34fad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1df30b7e-ae74-466e-8076-8ba92f855cc8", "address": "fa:16:3e:b4:55:22", "network": {"id": "6e43ca53-1563-43b0-84cc-d3f759c61c37", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-908305790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d607e0aed1f47129540181261c6ebc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1df30b7e-ae", "ovs_interfaceid": "1df30b7e-ae74-466e-8076-8ba92f855cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:37:08 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-4672d577-a1ac-4287-b158-13d9c4b0c9b3 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Converting VIF {"id": "1df30b7e-ae74-466e-8076-8ba92f855cc8", "address": "fa:16:3e:b4:55:22", "network": {"id": "6e43ca53-1563-43b0-84cc-d3f759c61c37", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-908305790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d607e0aed1f47129540181261c6ebc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1df30b7e-ae", "ovs_interfaceid": "1df30b7e-ae74-466e-8076-8ba92f855cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:37:08 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-4672d577-a1ac-4287-b158-13d9c4b0c9b3 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:55:22,bridge_name='br-int',has_traffic_filtering=True,id=1df30b7e-ae74-466e-8076-8ba92f855cc8,network=Network(6e43ca53-1563-43b0-84cc-d3f759c61c37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1df30b7e-ae') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:37:08 user nova-compute[71321]: DEBUG os_vif [None req-4672d577-a1ac-4287-b158-13d9c4b0c9b3 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:55:22,bridge_name='br-int',has_traffic_filtering=True,id=1df30b7e-ae74-466e-8076-8ba92f855cc8,network=Network(6e43ca53-1563-43b0-84cc-d3f759c61c37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1df30b7e-ae') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:37:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1df30b7e-ae, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:37:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:37:08 user nova-compute[71321]: INFO os_vif [None req-4672d577-a1ac-4287-b158-13d9c4b0c9b3 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:55:22,bridge_name='br-int',has_traffic_filtering=True,id=1df30b7e-ae74-466e-8076-8ba92f855cc8,network=Network(6e43ca53-1563-43b0-84cc-d3f759c61c37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1df30b7e-ae')
Apr 12 12:37:08 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-4672d577-a1ac-4287-b158-13d9c4b0c9b3 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Deleting instance files /opt/stack/data/nova/instances/c24566ee-48cd-4cc4-aaea-28b1eae34fad_del
Apr 12 12:37:08 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-4672d577-a1ac-4287-b158-13d9c4b0c9b3 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Deletion of /opt/stack/data/nova/instances/c24566ee-48cd-4cc4-aaea-28b1eae34fad_del complete
Apr 12 12:37:08 user nova-compute[71321]: INFO nova.compute.manager [None req-4672d577-a1ac-4287-b158-13d9c4b0c9b3 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Took 0.68 seconds to destroy the instance on the hypervisor.
Apr 12 12:37:08 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-4672d577-a1ac-4287-b158-13d9c4b0c9b3 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:37:08 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:37:08 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:37:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "546c0c08-35f1-4043-ac30-56d49bc86af1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:37:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:37:08 user nova-compute[71321]: DEBUG nova.objects.instance [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lazy-loading 'flavor' on Instance uuid 546c0c08-35f1-4043-ac30-56d49bc86af1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:37:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:37:09 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681303014.188578, fa011231-049f-40c3-89c0-53447a35752f => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:37:09 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: fa011231-049f-40c3-89c0-53447a35752f] VM Stopped (Lifecycle Event)
Apr 12 12:37:09 user nova-compute[71321]: DEBUG nova.compute.manager [None req-10db75e4-5406-4c89-a61f-11f45b82cbe1 None None] [instance: fa011231-049f-40c3-89c0-53447a35752f] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:37:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "546c0c08-35f1-4043-ac30-56d49bc86af1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:37:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:37:09 user nova-compute[71321]: INFO nova.compute.manager [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Attaching volume 285a2e71-c724-427a-94a8-d0f646e9083f to /dev/vdb
Apr 12 12:37:09 user nova-compute[71321]: DEBUG os_brick.utils [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:37:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:09 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:37:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:09 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a85ada9-425e-4212-91a8-354924072b4a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:09 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Took 0.97 seconds to deallocate network for instance.
Apr 12 12:37:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:09 user nova-compute[71321]: DEBUG nova.compute.manager [req-8bebca0c-3be0-4b3d-9604-0bf0cebf4c79 req-d28d0b9b-5de0-4d80-87fc-d152aee9ad85 service nova] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Received event network-vif-deleted-1df30b7e-ae74-466e-8076-8ba92f855cc8 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:37:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:09 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1447f34a-9afa-42d3-807a-f3b9b1168d15]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:09 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0af90c-b4a0-4a5c-a45c-b0c03e0e438d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:09 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dfac53-a598-47f4-82e3-7924611703c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:37:09 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:37:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4672d577-a1ac-4287-b158-13d9c4b0c9b3 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:37:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4672d577-a1ac-4287-b158-13d9c4b0c9b3 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:37:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:37:09 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:37:09 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91705d3-6600-42e1-9d81-a1022a5b9e04]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:09 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:37:09 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:37:09 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:37:09 user nova-compute[71321]: DEBUG os_brick.utils [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:37:09 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Updating existing volume attachment record: c728d344-872f-43f0-9838-85b1c6ee571a {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:37:09 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-4672d577-a1ac-4287-b158-13d9c4b0c9b3 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:37:09 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-4672d577-a1ac-4287-b158-13d9c4b0c9b3 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:37:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4672d577-a1ac-4287-b158-13d9c4b0c9b3 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:37:09 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-4672d577-a1ac-4287-b158-13d9c4b0c9b3 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Deleted allocations for instance c24566ee-48cd-4cc4-aaea-28b1eae34fad
Apr 12 12:37:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4672d577-a1ac-4287-b158-13d9c4b0c9b3 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "c24566ee-48cd-4cc4-aaea-28b1eae34fad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.319s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:37:10 user nova-compute[71321]: DEBUG nova.compute.manager [req-089d45ec-6cbb-48aa-a1ff-a9b45f25e037 req-ecc35721-d2fc-45d9-a421-f82b279cc22e service nova] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Received event network-vif-plugged-1df30b7e-ae74-466e-8076-8ba92f855cc8 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:37:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-089d45ec-6cbb-48aa-a1ff-a9b45f25e037 req-ecc35721-d2fc-45d9-a421-f82b279cc22e service nova] Acquiring lock "c24566ee-48cd-4cc4-aaea-28b1eae34fad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:37:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-089d45ec-6cbb-48aa-a1ff-a9b45f25e037 req-ecc35721-d2fc-45d9-a421-f82b279cc22e service nova] Lock "c24566ee-48cd-4cc4-aaea-28b1eae34fad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:37:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-089d45ec-6cbb-48aa-a1ff-a9b45f25e037 req-ecc35721-d2fc-45d9-a421-f82b279cc22e service nova] Lock "c24566ee-48cd-4cc4-aaea-28b1eae34fad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:37:10 user nova-compute[71321]: DEBUG nova.compute.manager [req-089d45ec-6cbb-48aa-a1ff-a9b45f25e037 req-ecc35721-d2fc-45d9-a421-f82b279cc22e service nova] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] No waiting events found dispatching network-vif-plugged-1df30b7e-ae74-466e-8076-8ba92f855cc8 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:37:10 user nova-compute[71321]: WARNING nova.compute.manager [req-089d45ec-6cbb-48aa-a1ff-a9b45f25e037 req-ecc35721-d2fc-45d9-a421-f82b279cc22e service nova] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Received unexpected event network-vif-plugged-1df30b7e-ae74-466e-8076-8ba92f855cc8 for instance with vm_state deleted and task_state None.
Apr 12 12:37:13 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TonhIRZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:37:14 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:37:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:37:14 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:37:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:37:14 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:37:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b870a9-f692-45e9-afed-d10fc8022928]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:37:14 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e35648-7d13-4182-8749-3ea5aeae3183]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f] added
Apr 12 12:37:14 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[547ca107-fbc9-4638-88c7-573dea9362a0]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c168a0-57d0-48ca-b41f-46d7f2eb22a6]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TonhIRZC {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TonhIRZC" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cebc788-9c48-423d-90b2-5f2f9b056ee2]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TonhIRZC'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b39a5e-a7c6-4569-baa8-435dbd9efe92]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6599f8b6-3947-4fbf-b8e8-ed5b1c151a05]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 (non-flash)
Apr 12 12:37:14 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 (non-flash)
Apr 12 12:37:14 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e14c28f-0ab4-413a-904c-dd39a945ac5f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f, portal: 172.16.0.220,3260]
Apr 12 12:37:14 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f, portal: 172.16.0.220,3260] successful.
Apr 12 12:37:14 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0bbfc0-e8cb-4e13-87f0-650c80c57fb8]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1e68ac-d2f4-4ac5-a882-dbb155d5bf31]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 (non-flash)
Apr 12 12:37:14 user nova-compute[71321]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)
Apr 12 12:37:14 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 (non-flash)
Apr 12 12:37:14 user nova-compute[71321]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)
Apr 12 12:37:14 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f8d066-1b51-4984-84c6-1f8377895d1b]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TonhIRZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:37:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:15 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:37:15 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23962363634316665', 'path': '/dev/sdc'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:37:15 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962363634316665', 'path': '/dev/sdc'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:37:15 user nova-compute[71321]: DEBUG nova.objects.instance [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lazy-loading 'flavor' on Instance uuid 546c0c08-35f1-4043-ac30-56d49bc86af1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:37:15 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 12:37:15 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:37:15 user nova-compute[71321]:   <source dev="/dev/sdc"/>
Apr 12 12:37:15 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:37:15 user nova-compute[71321]:   <serial>285a2e71-c724-427a-94a8-d0f646e9083f</serial>
Apr 12 12:37:15 user nova-compute[71321]: </disk>
Apr 12 12:37:15 user nova-compute[71321]:  {{(pid=71321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 12:37:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:37:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:37:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] No VIF found with MAC fa:16:3e:14:16:c4, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:37:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.154s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:37:16 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:37:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:37:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:37:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:37:16 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:37:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:18 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:37:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:18 user nova-compute[71321]: DEBUG nova.compute.manager [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Stashing vm_state: active {{(pid=71321) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 12 12:37:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:37:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:37:18 user nova-compute[71321]: DEBUG nova.objects.instance [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lazy-loading 'pci_requests' on Instance uuid 546c0c08-35f1-4043-ac30-56d49bc86af1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:37:18 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:37:18 user nova-compute[71321]: INFO nova.compute.claims [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Claim successful on node user
Apr 12 12:37:18 user nova-compute[71321]: DEBUG nova.objects.instance [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lazy-loading 'resources' on Instance uuid 546c0c08-35f1-4043-ac30-56d49bc86af1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:37:18 user nova-compute[71321]: DEBUG nova.objects.instance [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lazy-loading 'pci_devices' on Instance uuid 546c0c08-35f1-4043-ac30-56d49bc86af1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:37:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:18 user nova-compute[71321]: INFO nova.compute.resource_tracker [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Updating resource usage from migration 13fdba50-49cb-4806-a103-10b8c219a3de
Apr 12 12:37:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:18 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:37:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:19 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:37:19 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:37:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.544s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:37:19 user nova-compute[71321]: INFO nova.compute.manager [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Migrating
Apr 12 12:37:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:37:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquired lock "compute-rpcapi-router" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:37:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:19 user nova-compute[71321]: INFO nova.compute.rpcapi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Apr 12 12:37:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Releasing lock "compute-rpcapi-router" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:37:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "refresh_cache-546c0c08-35f1-4043-ac30-56d49bc86af1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:37:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquired lock "refresh_cache-546c0c08-35f1-4043-ac30-56d49bc86af1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:37:19 user nova-compute[71321]: DEBUG nova.network.neutron [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:37:19 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:37:19 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:37:19 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=7728MB free_disk=26.447715759277344GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:37:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:37:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:37:19 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Applying migration context for instance 546c0c08-35f1-4043-ac30-56d49bc86af1 as it has an incoming, in-progress migration 13fdba50-49cb-4806-a103-10b8c219a3de. Migration status is pre-migrating {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 12 12:37:19 user nova-compute[71321]: INFO nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Updating resource usage from migration 13fdba50-49cb-4806-a103-10b8c219a3de
Apr 12 12:37:19 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 10116da0-785c-41cf-96bb-95721af863db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:37:19 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance a4107f2d-88e4-4846-9ece-cb16ad7ecd02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:37:19 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance c5b9b1bb-a3d9-4073-8d49-70360dae6f29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:37:19 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 8403a098-a141-4feb-9eed-3731e2c7c152 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:37:19 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 9439468d-7a45-443b-87ce-106907761a56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:37:19 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:37:19 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Migration 13fdba50-49cb-4806-a103-10b8c219a3de is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 12 12:37:19 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:37:19 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:37:19 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=1600MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:37:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:20 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:37:20 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:37:20 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:37:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.426s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:37:20 user nova-compute[71321]: DEBUG nova.network.neutron [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Updating instance_info_cache with network_info: [{"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:37:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Releasing lock "refresh_cache-546c0c08-35f1-4043-ac30-56d49bc86af1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:37:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Starting migrate_disk_and_power_off {{(pid=71321) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 12 12:37:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:20 user nova-compute[71321]: DEBUG nova.compute.manager [req-295852f0-e867-4562-9916-fb05bd34c8e4 req-d2ed9d56-f722-41cb-b4ca-c6dbfc269162 service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received event network-vif-unplugged-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:37:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-295852f0-e867-4562-9916-fb05bd34c8e4 req-d2ed9d56-f722-41cb-b4ca-c6dbfc269162 service nova] Acquiring lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:37:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-295852f0-e867-4562-9916-fb05bd34c8e4 req-d2ed9d56-f722-41cb-b4ca-c6dbfc269162 service nova] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:37:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-295852f0-e867-4562-9916-fb05bd34c8e4 req-d2ed9d56-f722-41cb-b4ca-c6dbfc269162 service nova] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:37:20 user nova-compute[71321]: DEBUG nova.compute.manager [req-295852f0-e867-4562-9916-fb05bd34c8e4 req-d2ed9d56-f722-41cb-b4ca-c6dbfc269162 service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] No waiting events found dispatching network-vif-unplugged-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:37:20 user nova-compute[71321]: WARNING nova.compute.manager [req-295852f0-e867-4562-9916-fb05bd34c8e4 req-d2ed9d56-f722-41cb-b4ca-c6dbfc269162 service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received unexpected event network-vif-unplugged-6f21df63-1895-4500-b119-c4670a7f3569 for instance with vm_state active and task_state resize_migrating.
Apr 12 12:37:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:21 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Instance destroyed successfully.
Apr 12 12:37:21 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T12:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1139912608',display_name='tempest-ServerActionsTestJSON-server-548854806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1139912608',id=4,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9e64miZ/iyVASS4OS8AZthMPT8KBHm0byN/8NFP7U1AgI9/hOw/R+BSPozX14usgKt+VEqTE1BPs7aRGcfyuCZ/K0LBkD7enTbPYgw3NHHlO3PWScCWY1ae7IFb2uJEw==',key_name='tempest-keypair-1245622558',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:32:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7ba5375005114c8594e0ae86b2f19093',ramdisk_id='',reservation_id='r-kvv9k7th',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1233797030',owner_user_name='tempest-ServerActionsTestJSON-1233797030-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:37:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29f7f46d32f4465ba3e8b504c645c22f',uuid=546c0c08-35f1-4043-ac30-56d49bc86af1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1652638760-network", "vif_mac": "fa:16:3e:14:16:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converting VIF {"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1652638760-network", "vif_mac": "fa:16:3e:14:16:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f21df63-1895-4500-b119-c4670a7f3569,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21df63-18') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG os_vif [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f21df63-1895-4500-b119-c4670a7f3569,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21df63-18') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f21df63-18, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:21 user nova-compute[71321]: INFO os_vif [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f21df63-1895-4500-b119-c4670a7f3569,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21df63-18')
Apr 12 12:37:21 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TonhIRZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:37:21 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:37:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[312490af-4ed2-47f9-bdf1-4a58155b2de0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:37:21 user nova-compute[71321]: No targets found.
Apr 12 12:37:21 user nova-compute[71321]: iSNS:
Apr 12 12:37:21 user nova-compute[71321]: No targets found.
Apr 12 12:37:21 user nova-compute[71321]: STATIC:
Apr 12 12:37:21 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9
Apr 12 12:37:21 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:37:21 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:37:21 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f
Apr 12 12:37:21 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:37:21 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:37:21 user nova-compute[71321]: FIRMWARE:
Apr 12 12:37:21 user nova-compute[71321]: No targets found.
Apr 12 12:37:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:37:21 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:37:21 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdba820a-0d56-403c-9116-d49154435d7d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c639de53-44ae-4dde-a5f2-e9acbd1a7cc7]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 (non-flash)
Apr 12 12:37:21 user nova-compute[71321]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)
Apr 12 12:37:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 (non-flash)
Apr 12 12:37:21 user nova-compute[71321]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)
Apr 12 12:37:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef8a0b65f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f'): ({'sdc'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Removing single pathed devices sdc {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85974fa-cd18-420d-a6b6-db9550a08344]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf09caa5-b337-468e-aeb2-a7c3d63a5644]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Flushing IO for device /dev/sdc {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c55f49a-f2ef-42ef-b1a0-1e46362ed13f]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8f475a-9b97-4d12-8f3e-da04e66edf73]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] SCSI volumes sdc have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec112d79-1fac-49c2-b528-3205b926de3a]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b160a81-d7d0-40b4-af93-d84382478d38]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f, portal: 172.16.0.220,3260]
Apr 12 12:37:21 user nova-compute[71321]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f, portal: 172.16.0.220,3260] successful.
Apr 12 12:37:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f443fc-5168-4b5e-811f-a756858c1de8]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] <== disconnect_volume: return (318ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:22 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:37:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1_resize/disk /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] CMD "cp -r /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1_resize/disk /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk" returned: 0 in 0.590s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1_resize/disk.info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk.info {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] CMD "cp -r /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1_resize/disk.info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk.info" returned: 0 in 0.044s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:23 user nova-compute[71321]: DEBUG nova.compute.manager [req-2ef9b723-bd27-4dae-ad5a-28f3b236253d req-32b90b8f-552a-4a48-b636-357983bcd782 service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received event network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:37:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2ef9b723-bd27-4dae-ad5a-28f3b236253d req-32b90b8f-552a-4a48-b636-357983bcd782 service nova] Acquiring lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:37:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2ef9b723-bd27-4dae-ad5a-28f3b236253d req-32b90b8f-552a-4a48-b636-357983bcd782 service nova] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:37:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2ef9b723-bd27-4dae-ad5a-28f3b236253d req-32b90b8f-552a-4a48-b636-357983bcd782 service nova] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:37:23 user nova-compute[71321]: DEBUG nova.compute.manager [req-2ef9b723-bd27-4dae-ad5a-28f3b236253d req-32b90b8f-552a-4a48-b636-357983bcd782 service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] No waiting events found dispatching network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:37:23 user nova-compute[71321]: WARNING nova.compute.manager [req-2ef9b723-bd27-4dae-ad5a-28f3b236253d req-32b90b8f-552a-4a48-b636-357983bcd782 service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received unexpected event network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 for instance with vm_state active and task_state resize_migrating.
Apr 12 12:37:23 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:37:23 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:37:23 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681303028.2483401, c24566ee-48cd-4cc4-aaea-28b1eae34fad => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:37:23 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] VM Stopped (Lifecycle Event)
Apr 12 12:37:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-c5b9b1bb-a3d9-4073-8d49-70360dae6f29" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:37:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-c5b9b1bb-a3d9-4073-8d49-70360dae6f29" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:37:23 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 12:37:23 user nova-compute[71321]: DEBUG nova.compute.manager [None req-82db1c57-f9b2-49a4-b014-0a61f3ce1861 None None] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:37:23 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Updating instance_info_cache with network_info: [{"id": "33441356-cd95-4247-86bb-3f49f00d8e81", "address": "fa:16:3e:9a:89:f9", "network": {"id": "6e43ca53-1563-43b0-84cc-d3f759c61c37", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-908305790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d607e0aed1f47129540181261c6ebc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33441356-cd", "ovs_interfaceid": "33441356-cd95-4247-86bb-3f49f00d8e81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:37:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-c5b9b1bb-a3d9-4073-8d49-70360dae6f29" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:37:23 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 12:37:23 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:37:23 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:37:23 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:37:23 user nova-compute[71321]: DEBUG nova.network.neutron [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Port 6f21df63-1895-4500-b119-c4670a7f3569 binding to destination host user is already ACTIVE {{(pid=71321) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 12 12:37:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:37:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:37:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:37:24 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:37:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "refresh_cache-546c0c08-35f1-4043-ac30-56d49bc86af1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:37:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquired lock "refresh_cache-546c0c08-35f1-4043-ac30-56d49bc86af1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:37:24 user nova-compute[71321]: DEBUG nova.network.neutron [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:37:24 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:37:24 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:37:24 user nova-compute[71321]: DEBUG nova.network.neutron [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Updating instance_info_cache with network_info: [{"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:37:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Releasing lock "refresh_cache-546c0c08-35f1-4043-ac30-56d49bc86af1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:37:24 user nova-compute[71321]: DEBUG os_brick.utils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:37:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[240b541e-b4fc-4498-b535-ecb441115392]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e39a62c-85f9-46b5-85b0-218756278c9d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e686e833-4b92-4c2d-afcd-5de51945457a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c08d09-ea41-4dcd-824c-d5a9e041ae95]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:37:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:37:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:37:24 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:37:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb813b9c-acc9-4de2-8489-564fa176055a]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:37:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:37:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:37:24 user nova-compute[71321]: DEBUG os_brick.utils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:37:24 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:25 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:37:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Starting finish_migration {{(pid=71321) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Instance directory exists: not creating {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 12:37:29 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Creating image(s)
Apr 12 12:37:29 user nova-compute[71321]: DEBUG nova.objects.instance [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lazy-loading 'trusted_certs' on Instance uuid 546c0c08-35f1-4043-ac30-56d49bc86af1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.142s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Checking if we can resize image /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Cannot resize image /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Did not create local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Ensure instance console log exists: /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Start _get_guest_xml network_info=[{"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1652638760-network", "vif_mac": "fa:16:3e:14:16:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f76ef69e-23ab-4f9c-9d82-66ab2f545d9c', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TonhIRZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '546c0c08-35f1-4043-ac30-56d49bc86af1', 'attached_at': '2023-04-12T12:37:29.000000', 'detached_at': '', 'volume_id': '285a2e71-c724-427a-94a8-d0f646e9083f', 'serial': '285a2e71-c724-427a-94a8-d0f646e9083f'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:37:29 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:37:29 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:37:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG nova.objects.instance [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lazy-loading 'vcpu_model' on Instance uuid 546c0c08-35f1-4043-ac30-56d49bc86af1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TonhIRZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:37:29 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:37:29 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:37:29 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:37:29 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:37:29 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:37:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[814f84a6-7b78-4b4a-a453-c8df04ee4918]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:37:29 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e85669-57d9-4cf6-8806-50d826915c37]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f] added
Apr 12 12:37:29 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2808448-dfcb-46af-9ea4-d55e3857ef25]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6527b47-d406-48e8-aa54-6d33b0c39a94]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TonhIRZC {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TonhIRZC" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d037ca4b-0c92-4eab-b391-bb3c9f2eb9e1]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TonhIRZC'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84d9958-0c15-40a4-8d45-604e4a57d1dd]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[769f3e64-94ea-42eb-a357-c3561bd511fe]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 (non-flash)
Apr 12 12:37:29 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 (non-flash)
Apr 12 12:37:29 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:37:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:30 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e882a35e-b351-4d29-afc8-8bd1b2a5c8cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f, portal: 172.16.0.220,3260]
Apr 12 12:37:30 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f, portal: 172.16.0.220,3260] successful.
Apr 12 12:37:30 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:37:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:30 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae5acb4-0fd0-4183-a50d-99d7b33728ff]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:37:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:30 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbec42e-0e12-4003-8c35-2fce4f4055de]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 (non-flash)
Apr 12 12:37:30 user nova-compute[71321]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)
Apr 12 12:37:30 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:37:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 (non-flash)
Apr 12 12:37:30 user nova-compute[71321]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)
Apr 12 12:37:30 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:37:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:37:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:37:30 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:37:30 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:37:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:30 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[630ff695-10fe-4584-b9f8-79d86d580745]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:30 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: None {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:37:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:31 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:37:31 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TonhIRZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:37:31 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:37:31 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23962363634316665', 'path': '/dev/sdc'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:37:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962363634316665', 'path': '/dev/sdc'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:37:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T12:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1139912608',display_name='tempest-ServerActionsTestJSON-server-548854806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1139912608',id=4,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9e64miZ/iyVASS4OS8AZthMPT8KBHm0byN/8NFP7U1AgI9/hOw/R+BSPozX14usgKt+VEqTE1BPs7aRGcfyuCZ/K0LBkD7enTbPYgw3NHHlO3PWScCWY1ae7IFb2uJEw==',key_name='tempest-keypair-1245622558',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:32:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7ba5375005114c8594e0ae86b2f19093',ramdisk_id='',reservation_id='r-kvv9k7th',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1233797030',owner_user_name='tempest-ServerActionsTestJSON-1233797030-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:37:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29f7f46d32f4465ba3e8b504c645c22f',uuid=546c0c08-35f1-4043-ac30-56d49bc86af1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1652638760-network", "vif_mac": "fa:16:3e:14:16:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:37:31 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converting VIF {"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1652638760-network", "vif_mac": "fa:16:3e:14:16:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:37:31 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f21df63-1895-4500-b119-c4670a7f3569,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21df63-18') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:37:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:37:31 user nova-compute[71321]:   <uuid>546c0c08-35f1-4043-ac30-56d49bc86af1</uuid>
Apr 12 12:37:31 user nova-compute[71321]:   <name>instance-00000004</name>
Apr 12 12:37:31 user nova-compute[71321]:   <memory>196608</memory>
Apr 12 12:37:31 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:37:31 user nova-compute[71321]:   <metadata>
Apr 12 12:37:31 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:37:31 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:37:31 user nova-compute[71321]:       <nova:name>tempest-ServerActionsTestJSON-server-548854806</nova:name>
Apr 12 12:37:31 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:37:29</nova:creationTime>
Apr 12 12:37:31 user nova-compute[71321]:       <nova:flavor name="m1.micro">
Apr 12 12:37:31 user nova-compute[71321]:         <nova:memory>192</nova:memory>
Apr 12 12:37:31 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:37:31 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:37:31 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:37:31 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:37:31 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:37:31 user nova-compute[71321]:       <nova:owner>
Apr 12 12:37:31 user nova-compute[71321]:         <nova:user uuid="29f7f46d32f4465ba3e8b504c645c22f">tempest-ServerActionsTestJSON-1233797030-project-member</nova:user>
Apr 12 12:37:31 user nova-compute[71321]:         <nova:project uuid="7ba5375005114c8594e0ae86b2f19093">tempest-ServerActionsTestJSON-1233797030</nova:project>
Apr 12 12:37:31 user nova-compute[71321]:       </nova:owner>
Apr 12 12:37:31 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:37:31 user nova-compute[71321]:       <nova:ports>
Apr 12 12:37:31 user nova-compute[71321]:         <nova:port uuid="6f21df63-1895-4500-b119-c4670a7f3569">
Apr 12 12:37:31 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 12:37:31 user nova-compute[71321]:         </nova:port>
Apr 12 12:37:31 user nova-compute[71321]:       </nova:ports>
Apr 12 12:37:31 user nova-compute[71321]:     </nova:instance>
Apr 12 12:37:31 user nova-compute[71321]:   </metadata>
Apr 12 12:37:31 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:37:31 user nova-compute[71321]:     <system>
Apr 12 12:37:31 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:37:31 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:37:31 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:37:31 user nova-compute[71321]:       <entry name="serial">546c0c08-35f1-4043-ac30-56d49bc86af1</entry>
Apr 12 12:37:31 user nova-compute[71321]:       <entry name="uuid">546c0c08-35f1-4043-ac30-56d49bc86af1</entry>
Apr 12 12:37:31 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:37:31 user nova-compute[71321]:     </system>
Apr 12 12:37:31 user nova-compute[71321]:   </sysinfo>
Apr 12 12:37:31 user nova-compute[71321]:   <os>
Apr 12 12:37:31 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:37:31 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:37:31 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:37:31 user nova-compute[71321]:   </os>
Apr 12 12:37:31 user nova-compute[71321]:   <features>
Apr 12 12:37:31 user nova-compute[71321]:     <acpi/>
Apr 12 12:37:31 user nova-compute[71321]:     <apic/>
Apr 12 12:37:31 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:37:31 user nova-compute[71321]:   </features>
Apr 12 12:37:31 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:37:31 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:37:31 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:37:31 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:37:31 user nova-compute[71321]:   </clock>
Apr 12 12:37:31 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:37:31 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:37:31 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:37:31 user nova-compute[71321]:   </cpu>
Apr 12 12:37:31 user nova-compute[71321]:   <devices>
Apr 12 12:37:31 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:37:31 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:37:31 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk"/>
Apr 12 12:37:31 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:37:31 user nova-compute[71321]:     </disk>
Apr 12 12:37:31 user nova-compute[71321]:     <disk type="block" device="disk">
Apr 12 12:37:31 user nova-compute[71321]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:37:31 user nova-compute[71321]:       <source dev="/dev/sdc"/>
Apr 12 12:37:31 user nova-compute[71321]:       <target dev="vdb" bus="virtio"/>
Apr 12 12:37:31 user nova-compute[71321]:       <serial>285a2e71-c724-427a-94a8-d0f646e9083f</serial>
Apr 12 12:37:31 user nova-compute[71321]:     </disk>
Apr 12 12:37:31 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:37:31 user nova-compute[71321]:       <mac address="fa:16:3e:14:16:c4"/>
Apr 12 12:37:31 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:37:31 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:37:31 user nova-compute[71321]:       <target dev="tap6f21df63-18"/>
Apr 12 12:37:31 user nova-compute[71321]:     </interface>
Apr 12 12:37:31 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:37:31 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/console.log" append="off"/>
Apr 12 12:37:31 user nova-compute[71321]:     </serial>
Apr 12 12:37:31 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:37:31 user nova-compute[71321]:     <video>
Apr 12 12:37:31 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:37:31 user nova-compute[71321]:     </video>
Apr 12 12:37:31 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:37:31 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:37:31 user nova-compute[71321]:     </rng>
Apr 12 12:37:31 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:37:31 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:37:31 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:37:31 user nova-compute[71321]:     </memballoon>
Apr 12 12:37:31 user nova-compute[71321]:   </devices>
Apr 12 12:37:31 user nova-compute[71321]: </domain>
Apr 12 12:37:31 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:37:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T12:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1139912608',display_name='tempest-ServerActionsTestJSON-server-548854806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1139912608',id=4,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9e64miZ/iyVASS4OS8AZthMPT8KBHm0byN/8NFP7U1AgI9/hOw/R+BSPozX14usgKt+VEqTE1BPs7aRGcfyuCZ/K0LBkD7enTbPYgw3NHHlO3PWScCWY1ae7IFb2uJEw==',key_name='tempest-keypair-1245622558',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:32:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7ba5375005114c8594e0ae86b2f19093',ramdisk_id='',reservation_id='r-kvv9k7th',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1233797030',owner_user_name='tempest-ServerActionsTestJSON-1233797030-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:37:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29f7f46d32f4465ba3e8b504c645c22f',uuid=546c0c08-35f1-4043-ac30-56d49bc86af1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1652638760-network", "vif_mac": "fa:16:3e:14:16:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:37:31 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converting VIF {"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1652638760-network", "vif_mac": "fa:16:3e:14:16:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:37:31 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f21df63-1895-4500-b119-c4670a7f3569,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21df63-18') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:37:31 user nova-compute[71321]: DEBUG os_vif [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f21df63-1895-4500-b119-c4670a7f3569,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21df63-18') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:37:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:37:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:37:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f21df63-18, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:37:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6f21df63-18, col_values=(('external_ids', {'iface-id': '6f21df63-1895-4500-b119-c4670a7f3569', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:16:c4', 'vm-uuid': '546c0c08-35f1-4043-ac30-56d49bc86af1'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:37:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:37:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:31 user nova-compute[71321]: INFO os_vif [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f21df63-1895-4500-b119-c4670a7f3569,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21df63-18')
Apr 12 12:37:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:37:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:37:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] No VIF found with MAC fa:16:3e:14:16:c4, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:37:32 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:32 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:32 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:32 user nova-compute[71321]: DEBUG nova.compute.manager [req-cc23f6d5-da24-4faf-8fd0-5ad8e973e148 req-353b529c-ea03-42d0-aac6-86494303052f service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received event network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:37:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-cc23f6d5-da24-4faf-8fd0-5ad8e973e148 req-353b529c-ea03-42d0-aac6-86494303052f service nova] Acquiring lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:37:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-cc23f6d5-da24-4faf-8fd0-5ad8e973e148 req-353b529c-ea03-42d0-aac6-86494303052f service nova] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:37:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-cc23f6d5-da24-4faf-8fd0-5ad8e973e148 req-353b529c-ea03-42d0-aac6-86494303052f service nova] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:37:32 user nova-compute[71321]: DEBUG nova.compute.manager [req-cc23f6d5-da24-4faf-8fd0-5ad8e973e148 req-353b529c-ea03-42d0-aac6-86494303052f service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] No waiting events found dispatching network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:37:32 user nova-compute[71321]: WARNING nova.compute.manager [req-cc23f6d5-da24-4faf-8fd0-5ad8e973e148 req-353b529c-ea03-42d0-aac6-86494303052f service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received unexpected event network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 for instance with vm_state active and task_state resize_finish.
Apr 12 12:37:33 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:33 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:34 user nova-compute[71321]: DEBUG nova.compute.manager [req-25b271a2-1c8e-4ec4-9c82-92482796280a req-d5921965-b1ee-4ae4-83cd-59e7b91b746f service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received event network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:37:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-25b271a2-1c8e-4ec4-9c82-92482796280a req-d5921965-b1ee-4ae4-83cd-59e7b91b746f service nova] Acquiring lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:37:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-25b271a2-1c8e-4ec4-9c82-92482796280a req-d5921965-b1ee-4ae4-83cd-59e7b91b746f service nova] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:37:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-25b271a2-1c8e-4ec4-9c82-92482796280a req-d5921965-b1ee-4ae4-83cd-59e7b91b746f service nova] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:37:34 user nova-compute[71321]: DEBUG nova.compute.manager [req-25b271a2-1c8e-4ec4-9c82-92482796280a req-d5921965-b1ee-4ae4-83cd-59e7b91b746f service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] No waiting events found dispatching network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:37:34 user nova-compute[71321]: WARNING nova.compute.manager [req-25b271a2-1c8e-4ec4-9c82-92482796280a req-d5921965-b1ee-4ae4-83cd-59e7b91b746f service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received unexpected event network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 for instance with vm_state active and task_state resize_finish.
Apr 12 12:37:35 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Removed pending event for 546c0c08-35f1-4043-ac30-56d49bc86af1 due to event {{(pid=71321) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 12:37:35 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303055.0353017, 546c0c08-35f1-4043-ac30-56d49bc86af1 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:37:35 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] VM Resumed (Lifecycle Event)
Apr 12 12:37:35 user nova-compute[71321]: DEBUG nova.compute.manager [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:37:35 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Instance running successfully.
Apr 12 12:37:35 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Failed to set time: agent not configured {{(pid=71321) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 12 12:37:35 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] finish_migration finished successfully. {{(pid=71321) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 12 12:37:35 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:37:35 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:37:35 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 12 12:37:35 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303055.0372534, 546c0c08-35f1-4043-ac30-56d49bc86af1 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:37:35 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] VM Started (Lifecycle Event)
Apr 12 12:37:35 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:37:35 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:37:35 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 12 12:37:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "68378ff4-9b1d-4fa5-9b83-8f6c27541c63" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:37:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "68378ff4-9b1d-4fa5-9b83-8f6c27541c63" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:37:36 user nova-compute[71321]: DEBUG nova.compute.manager [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:37:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:37:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:37:37 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:37:37 user nova-compute[71321]: INFO nova.compute.claims [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Claim successful on node user
Apr 12 12:37:37 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:37:37 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:37:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.548s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:37:37 user nova-compute[71321]: DEBUG nova.compute.manager [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:37:37 user nova-compute[71321]: DEBUG nova.compute.manager [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:37:37 user nova-compute[71321]: DEBUG nova.network.neutron [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:37:37 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:37:37 user nova-compute[71321]: DEBUG nova.compute.manager [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:37:37 user nova-compute[71321]: INFO nova.virt.block_device [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Booting with volume b02750fc-665e-4715-9399-bb359cf6b1a5 at /dev/vda
Apr 12 12:37:37 user nova-compute[71321]: DEBUG nova.policy [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '076e65b43f664765ad1d48be6e814f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ada441da2124adda751365952320e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:37:37 user nova-compute[71321]: DEBUG os_brick.utils [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:37:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d95fc3-8d07-4e85-927f-c856eb645f4a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:38 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e95e685-ba39-4507-8285-3253bf7e1e0b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.192s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:38 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[749c1947-d3f8-4359-a764-00c3db586438]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:38 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d2ddcf-6ed2-4b01-8212-48dcf6bb5017]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:37:38 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:37:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:37:38 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:37:38 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be59f01-f0c1-445c-a509-4a9de5103561]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:38 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:37:38 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:37:38 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:37:38 user nova-compute[71321]: DEBUG os_brick.utils [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] <== get_connector_properties: return (316ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:37:38 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Updating existing volume attachment record: 7e81cfd2-249d-47c5-baf1-b847caec51ef {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:37:39 user nova-compute[71321]: DEBUG nova.network.neutron [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Successfully created port: de8600c4-82e7-466e-88fc-6d625c2c0898 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:37:39 user nova-compute[71321]: DEBUG nova.network.neutron [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Successfully updated port: de8600c4-82e7-466e-88fc-6d625c2c0898 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:37:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "refresh_cache-68378ff4-9b1d-4fa5-9b83-8f6c27541c63" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:37:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquired lock "refresh_cache-68378ff4-9b1d-4fa5-9b83-8f6c27541c63" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:37:39 user nova-compute[71321]: DEBUG nova.network.neutron [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:37:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-5117ffee-9c9f-4db2-82a6-2f9c9ff11145 req-7eb4e016-7fb6-4984-ab1d-9ef5c4852b10 service nova] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Received event network-changed-de8600c4-82e7-466e-88fc-6d625c2c0898 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:37:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-5117ffee-9c9f-4db2-82a6-2f9c9ff11145 req-7eb4e016-7fb6-4984-ab1d-9ef5c4852b10 service nova] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Refreshing instance network info cache due to event network-changed-de8600c4-82e7-466e-88fc-6d625c2c0898. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:37:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-5117ffee-9c9f-4db2-82a6-2f9c9ff11145 req-7eb4e016-7fb6-4984-ab1d-9ef5c4852b10 service nova] Acquiring lock "refresh_cache-68378ff4-9b1d-4fa5-9b83-8f6c27541c63" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:37:39 user nova-compute[71321]: DEBUG nova.network.neutron [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:37:39 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:40 user nova-compute[71321]: DEBUG nova.network.neutron [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Updating instance_info_cache with network_info: [{"id": "de8600c4-82e7-466e-88fc-6d625c2c0898", "address": "fa:16:3e:6e:fb:93", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde8600c4-82", "ovs_interfaceid": "de8600c4-82e7-466e-88fc-6d625c2c0898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:37:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Releasing lock "refresh_cache-68378ff4-9b1d-4fa5-9b83-8f6c27541c63" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:37:40 user nova-compute[71321]: DEBUG nova.compute.manager [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Instance network_info: |[{"id": "de8600c4-82e7-466e-88fc-6d625c2c0898", "address": "fa:16:3e:6e:fb:93", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde8600c4-82", "ovs_interfaceid": "de8600c4-82e7-466e-88fc-6d625c2c0898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:37:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-5117ffee-9c9f-4db2-82a6-2f9c9ff11145 req-7eb4e016-7fb6-4984-ab1d-9ef5c4852b10 service nova] Acquired lock "refresh_cache-68378ff4-9b1d-4fa5-9b83-8f6c27541c63" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:37:40 user nova-compute[71321]: DEBUG nova.network.neutron [req-5117ffee-9c9f-4db2-82a6-2f9c9ff11145 req-7eb4e016-7fb6-4984-ab1d-9ef5c4852b10 service nova] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Refreshing network info cache for port de8600c4-82e7-466e-88fc-6d625c2c0898 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:37:40 user nova-compute[71321]: DEBUG nova.network.neutron [req-5117ffee-9c9f-4db2-82a6-2f9c9ff11145 req-7eb4e016-7fb6-4984-ab1d-9ef5c4852b10 service nova] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Updated VIF entry in instance network info cache for port de8600c4-82e7-466e-88fc-6d625c2c0898. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:37:40 user nova-compute[71321]: DEBUG nova.network.neutron [req-5117ffee-9c9f-4db2-82a6-2f9c9ff11145 req-7eb4e016-7fb6-4984-ab1d-9ef5c4852b10 service nova] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Updating instance_info_cache with network_info: [{"id": "de8600c4-82e7-466e-88fc-6d625c2c0898", "address": "fa:16:3e:6e:fb:93", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde8600c4-82", "ovs_interfaceid": "de8600c4-82e7-466e-88fc-6d625c2c0898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:37:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-5117ffee-9c9f-4db2-82a6-2f9c9ff11145 req-7eb4e016-7fb6-4984-ab1d-9ef5c4852b10 service nova] Releasing lock "refresh_cache-68378ff4-9b1d-4fa5-9b83-8f6c27541c63" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:37:41 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG nova.compute.manager [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:37:43 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Creating image(s)
Apr 12 12:37:43 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Did not create local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Ensure instance console log exists: /opt/stack/data/nova/instances/68378ff4-9b1d-4fa5-9b83-8f6c27541c63/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Start _get_guest_xml network_info=[{"id": "de8600c4-82e7-466e-88fc-6d625c2c0898", "address": "fa:16:3e:6e:fb:93", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde8600c4-82", "ovs_interfaceid": "de8600c4-82e7-466e-88fc-6d625c2c0898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '7e81cfd2-249d-47c5-baf1-b847caec51ef', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qYwGFrzb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '68378ff4-9b1d-4fa5-9b83-8f6c27541c63', 'attached_at': '', 'detached_at': '', 'volume_id': 'b02750fc-665e-4715-9399-bb359cf6b1a5', 'serial': 'b02750fc-665e-4715-9399-bb359cf6b1a5'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:37:43 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:37:43 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:37:43 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qYwGFrzb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:37:43 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:37:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:37:43 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:37:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:37:43 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabc5b6d-cfe1-4b85-b8ce-38d3fb404245]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:37:43 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[620bb25a-e9f5-4069-ae6a-d5faf4255933]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5] added
Apr 12 12:37:43 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d6fcbc-54a5-4de9-ba0d-f10c5921d258]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2ecc5e-4a52-46f8-8ae0-f525e916fc10]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qYwGFrzb {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qYwGFrzb" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[04de1e98-98d8-40f4-816a-0b85de7b9483]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qYwGFrzb'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3b7d21-ee8b-4798-8e1e-11688d9a9785]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[432f822a-63ee-4f79-9333-22cc09139746]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 (non-flash)
Apr 12 12:37:43 user nova-compute[71321]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)
Apr 12 12:37:43 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 (non-flash)
Apr 12 12:37:43 user nova-compute[71321]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)
Apr 12 12:37:43 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[388ad262-751c-467e-8893-6455d55f9033]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5, portal: 172.16.0.220,3260]
Apr 12 12:37:43 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5, portal: 172.16.0.220,3260] successful.
Apr 12 12:37:43 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ae6536-9e4c-4837-be6c-047d07a6cdc3]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b63c57a-1388-4c9a-9d3e-e6cb9972e894]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 (non-flash)
Apr 12 12:37:43 user nova-compute[71321]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)
Apr 12 12:37:43 user nova-compute[71321]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:37:43 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 (non-flash)
Apr 12 12:37:43 user nova-compute[71321]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)
Apr 12 12:37:43 user nova-compute[71321]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:37:43 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43b651c-1013-44ea-af9a-849ec8456fa0]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:37:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qYwGFrzb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:37:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:37:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '26363393730646266', 'path': '/dev/sdd'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:37:44 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363393730646266', 'path': '/dev/sdd'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:37:44 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:37:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1229089641',display_name='tempest-TestVolumeBootPattern-server-1229089641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1229089641',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsgnjp9DU7mhDKOnejfarx74lKPsdA7XFVVac0IXQsHunQgmiZdnkpBnb9o+2GfDpfLr3Vtu/GonERs5AS6wpKwmtd3eb4XJchkGev4GCvYiSWT7o/Zl3+nrrnYoAMm1w==',key_name='tempest-TestVolumeBootPattern-1044387718',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ada441da2124adda751365952320e81',ramdisk_id='',reservation_id='r-okzypnmt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-310589135',owner_user_name='tempest-TestVolumeBootPattern-310589135-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:37:38Z,user_data=None,user_id='076e65b43f664765ad1d48be6e814f40',uuid=68378ff4-9b1d-4fa5-9b83-8f6c27541c63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de8600c4-82e7-466e-88fc-6d625c2c0898", "address": "fa:16:3e:6e:fb:93", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde8600c4-82", "ovs_interfaceid": "de8600c4-82e7-466e-88fc-6d625c2c0898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:37:44 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converting VIF {"id": "de8600c4-82e7-466e-88fc-6d625c2c0898", "address": "fa:16:3e:6e:fb:93", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde8600c4-82", "ovs_interfaceid": "de8600c4-82e7-466e-88fc-6d625c2c0898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:37:44 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:fb:93,bridge_name='br-int',has_traffic_filtering=True,id=de8600c4-82e7-466e-88fc-6d625c2c0898,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde8600c4-82') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:37:44 user nova-compute[71321]: DEBUG nova.objects.instance [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lazy-loading 'pci_devices' on Instance uuid 68378ff4-9b1d-4fa5-9b83-8f6c27541c63 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:37:44 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:37:44 user nova-compute[71321]:   <uuid>68378ff4-9b1d-4fa5-9b83-8f6c27541c63</uuid>
Apr 12 12:37:44 user nova-compute[71321]:   <name>instance-00000019</name>
Apr 12 12:37:44 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:37:44 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:37:44 user nova-compute[71321]:   <metadata>
Apr 12 12:37:44 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:37:44 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:37:44 user nova-compute[71321]:       <nova:name>tempest-TestVolumeBootPattern-server-1229089641</nova:name>
Apr 12 12:37:44 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:37:43</nova:creationTime>
Apr 12 12:37:44 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:37:44 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:37:44 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:37:44 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:37:44 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:37:44 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:37:44 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:37:44 user nova-compute[71321]:       <nova:owner>
Apr 12 12:37:44 user nova-compute[71321]:         <nova:user uuid="076e65b43f664765ad1d48be6e814f40">tempest-TestVolumeBootPattern-310589135-project-member</nova:user>
Apr 12 12:37:44 user nova-compute[71321]:         <nova:project uuid="5ada441da2124adda751365952320e81">tempest-TestVolumeBootPattern-310589135</nova:project>
Apr 12 12:37:44 user nova-compute[71321]:       </nova:owner>
Apr 12 12:37:44 user nova-compute[71321]:       <nova:ports>
Apr 12 12:37:44 user nova-compute[71321]:         <nova:port uuid="de8600c4-82e7-466e-88fc-6d625c2c0898">
Apr 12 12:37:44 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 12:37:44 user nova-compute[71321]:         </nova:port>
Apr 12 12:37:44 user nova-compute[71321]:       </nova:ports>
Apr 12 12:37:44 user nova-compute[71321]:     </nova:instance>
Apr 12 12:37:44 user nova-compute[71321]:   </metadata>
Apr 12 12:37:44 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:37:44 user nova-compute[71321]:     <system>
Apr 12 12:37:44 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:37:44 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:37:44 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:37:44 user nova-compute[71321]:       <entry name="serial">68378ff4-9b1d-4fa5-9b83-8f6c27541c63</entry>
Apr 12 12:37:44 user nova-compute[71321]:       <entry name="uuid">68378ff4-9b1d-4fa5-9b83-8f6c27541c63</entry>
Apr 12 12:37:44 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:37:44 user nova-compute[71321]:     </system>
Apr 12 12:37:44 user nova-compute[71321]:   </sysinfo>
Apr 12 12:37:44 user nova-compute[71321]:   <os>
Apr 12 12:37:44 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:37:44 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:37:44 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:37:44 user nova-compute[71321]:   </os>
Apr 12 12:37:44 user nova-compute[71321]:   <features>
Apr 12 12:37:44 user nova-compute[71321]:     <acpi/>
Apr 12 12:37:44 user nova-compute[71321]:     <apic/>
Apr 12 12:37:44 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:37:44 user nova-compute[71321]:   </features>
Apr 12 12:37:44 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:37:44 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:37:44 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:37:44 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:37:44 user nova-compute[71321]:   </clock>
Apr 12 12:37:44 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:37:44 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:37:44 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:37:44 user nova-compute[71321]:   </cpu>
Apr 12 12:37:44 user nova-compute[71321]:   <devices>
Apr 12 12:37:44 user nova-compute[71321]:     <disk type="block" device="disk">
Apr 12 12:37:44 user nova-compute[71321]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:37:44 user nova-compute[71321]:       <source dev="/dev/sdd"/>
Apr 12 12:37:44 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:37:44 user nova-compute[71321]:       <serial>b02750fc-665e-4715-9399-bb359cf6b1a5</serial>
Apr 12 12:37:44 user nova-compute[71321]:     </disk>
Apr 12 12:37:44 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:37:44 user nova-compute[71321]:       <mac address="fa:16:3e:6e:fb:93"/>
Apr 12 12:37:44 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:37:44 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:37:44 user nova-compute[71321]:       <target dev="tapde8600c4-82"/>
Apr 12 12:37:44 user nova-compute[71321]:     </interface>
Apr 12 12:37:44 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:37:44 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/68378ff4-9b1d-4fa5-9b83-8f6c27541c63/console.log" append="off"/>
Apr 12 12:37:44 user nova-compute[71321]:     </serial>
Apr 12 12:37:44 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:37:44 user nova-compute[71321]:     <video>
Apr 12 12:37:44 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:37:44 user nova-compute[71321]:     </video>
Apr 12 12:37:44 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:37:44 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:37:44 user nova-compute[71321]:     </rng>
Apr 12 12:37:44 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:37:44 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:37:44 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:37:44 user nova-compute[71321]:     </memballoon>
Apr 12 12:37:44 user nova-compute[71321]:   </devices>
Apr 12 12:37:44 user nova-compute[71321]: </domain>
Apr 12 12:37:44 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:37:44 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:37:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1229089641',display_name='tempest-TestVolumeBootPattern-server-1229089641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1229089641',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsgnjp9DU7mhDKOnejfarx74lKPsdA7XFVVac0IXQsHunQgmiZdnkpBnb9o+2GfDpfLr3Vtu/GonERs5AS6wpKwmtd3eb4XJchkGev4GCvYiSWT7o/Zl3+nrrnYoAMm1w==',key_name='tempest-TestVolumeBootPattern-1044387718',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ada441da2124adda751365952320e81',ramdisk_id='',reservation_id='r-okzypnmt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-310589135',owner_user_name='tempest-TestVolumeBootPattern-310589135-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:37:38Z,user_data=None,user_id='076e65b43f664765ad1d48be6e814f40',uuid=68378ff4-9b1d-4fa5-9b83-8f6c27541c63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de8600c4-82e7-466e-88fc-6d625c2c0898", "address": "fa:16:3e:6e:fb:93", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde8600c4-82", "ovs_interfaceid": "de8600c4-82e7-466e-88fc-6d625c2c0898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:37:44 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converting VIF {"id": "de8600c4-82e7-466e-88fc-6d625c2c0898", "address": "fa:16:3e:6e:fb:93", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde8600c4-82", "ovs_interfaceid": "de8600c4-82e7-466e-88fc-6d625c2c0898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:37:44 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:fb:93,bridge_name='br-int',has_traffic_filtering=True,id=de8600c4-82e7-466e-88fc-6d625c2c0898,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde8600c4-82') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:37:44 user nova-compute[71321]: DEBUG os_vif [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:fb:93,bridge_name='br-int',has_traffic_filtering=True,id=de8600c4-82e7-466e-88fc-6d625c2c0898,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde8600c4-82') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:37:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:37:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:37:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde8600c4-82, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:37:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapde8600c4-82, col_values=(('external_ids', {'iface-id': 'de8600c4-82e7-466e-88fc-6d625c2c0898', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:fb:93', 'vm-uuid': '68378ff4-9b1d-4fa5-9b83-8f6c27541c63'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:37:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:37:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:44 user nova-compute[71321]: INFO os_vif [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:fb:93,bridge_name='br-int',has_traffic_filtering=True,id=de8600c4-82e7-466e-88fc-6d625c2c0898,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde8600c4-82')
Apr 12 12:37:44 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:37:44 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] No VIF found with MAC fa:16:3e:6e:fb:93, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:37:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:46 user nova-compute[71321]: DEBUG nova.compute.manager [req-091b1f02-f4f8-4d07-8743-65eb3e76a683 req-40cbb971-5eb0-4a4d-8abc-4b9b9b4d0ca6 service nova] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Received event network-vif-plugged-de8600c4-82e7-466e-88fc-6d625c2c0898 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:37:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-091b1f02-f4f8-4d07-8743-65eb3e76a683 req-40cbb971-5eb0-4a4d-8abc-4b9b9b4d0ca6 service nova] Acquiring lock "68378ff4-9b1d-4fa5-9b83-8f6c27541c63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:37:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-091b1f02-f4f8-4d07-8743-65eb3e76a683 req-40cbb971-5eb0-4a4d-8abc-4b9b9b4d0ca6 service nova] Lock "68378ff4-9b1d-4fa5-9b83-8f6c27541c63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:37:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-091b1f02-f4f8-4d07-8743-65eb3e76a683 req-40cbb971-5eb0-4a4d-8abc-4b9b9b4d0ca6 service nova] Lock "68378ff4-9b1d-4fa5-9b83-8f6c27541c63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:37:46 user nova-compute[71321]: DEBUG nova.compute.manager [req-091b1f02-f4f8-4d07-8743-65eb3e76a683 req-40cbb971-5eb0-4a4d-8abc-4b9b9b4d0ca6 service nova] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] No waiting events found dispatching network-vif-plugged-de8600c4-82e7-466e-88fc-6d625c2c0898 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:37:46 user nova-compute[71321]: WARNING nova.compute.manager [req-091b1f02-f4f8-4d07-8743-65eb3e76a683 req-40cbb971-5eb0-4a4d-8abc-4b9b9b4d0ca6 service nova] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Received unexpected event network-vif-plugged-de8600c4-82e7-466e-88fc-6d625c2c0898 for instance with vm_state building and task_state spawning.
Apr 12 12:37:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:48 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303068.3121314, 68378ff4-9b1d-4fa5-9b83-8f6c27541c63 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:37:48 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] VM Resumed (Lifecycle Event)
Apr 12 12:37:48 user nova-compute[71321]: DEBUG nova.compute.manager [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:37:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:37:48 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Instance spawned successfully.
Apr 12 12:37:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:37:48 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:37:48 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:37:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:37:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:37:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:37:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:37:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:37:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:37:48 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:37:48 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303068.313415, 68378ff4-9b1d-4fa5-9b83-8f6c27541c63 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:37:48 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] VM Started (Lifecycle Event)
Apr 12 12:37:48 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:37:48 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:37:48 user nova-compute[71321]: INFO nova.compute.manager [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Took 5.18 seconds to spawn the instance on the hypervisor.
Apr 12 12:37:48 user nova-compute[71321]: DEBUG nova.compute.manager [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:37:48 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:37:48 user nova-compute[71321]: DEBUG nova.compute.manager [req-cef61e6f-b064-4ec5-894a-510633a181bf req-33f6a73d-3f1b-410b-9262-5adea70ab0aa service nova] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Received event network-vif-plugged-de8600c4-82e7-466e-88fc-6d625c2c0898 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:37:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-cef61e6f-b064-4ec5-894a-510633a181bf req-33f6a73d-3f1b-410b-9262-5adea70ab0aa service nova] Acquiring lock "68378ff4-9b1d-4fa5-9b83-8f6c27541c63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:37:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-cef61e6f-b064-4ec5-894a-510633a181bf req-33f6a73d-3f1b-410b-9262-5adea70ab0aa service nova] Lock "68378ff4-9b1d-4fa5-9b83-8f6c27541c63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:37:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-cef61e6f-b064-4ec5-894a-510633a181bf req-33f6a73d-3f1b-410b-9262-5adea70ab0aa service nova] Lock "68378ff4-9b1d-4fa5-9b83-8f6c27541c63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:37:48 user nova-compute[71321]: DEBUG nova.compute.manager [req-cef61e6f-b064-4ec5-894a-510633a181bf req-33f6a73d-3f1b-410b-9262-5adea70ab0aa service nova] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] No waiting events found dispatching network-vif-plugged-de8600c4-82e7-466e-88fc-6d625c2c0898 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:37:48 user nova-compute[71321]: WARNING nova.compute.manager [req-cef61e6f-b064-4ec5-894a-510633a181bf req-33f6a73d-3f1b-410b-9262-5adea70ab0aa service nova] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Received unexpected event network-vif-plugged-de8600c4-82e7-466e-88fc-6d625c2c0898 for instance with vm_state building and task_state spawning.
Apr 12 12:37:48 user nova-compute[71321]: INFO nova.compute.manager [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Took 11.51 seconds to build instance.
Apr 12 12:37:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "68378ff4-9b1d-4fa5-9b83-8f6c27541c63" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.916s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:37:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:37:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d6dcc941-d6af-4660-940e-c8d1dd16a4cf tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "c5b9b1bb-a3d9-4073-8d49-70360dae6f29" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:38:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d6dcc941-d6af-4660-940e-c8d1dd16a4cf tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "c5b9b1bb-a3d9-4073-8d49-70360dae6f29" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:38:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d6dcc941-d6af-4660-940e-c8d1dd16a4cf tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "c5b9b1bb-a3d9-4073-8d49-70360dae6f29-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:38:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d6dcc941-d6af-4660-940e-c8d1dd16a4cf tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "c5b9b1bb-a3d9-4073-8d49-70360dae6f29-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:38:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d6dcc941-d6af-4660-940e-c8d1dd16a4cf tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "c5b9b1bb-a3d9-4073-8d49-70360dae6f29-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:38:00 user nova-compute[71321]: INFO nova.compute.manager [None req-d6dcc941-d6af-4660-940e-c8d1dd16a4cf tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Terminating instance
Apr 12 12:38:00 user nova-compute[71321]: DEBUG nova.compute.manager [None req-d6dcc941-d6af-4660-940e-c8d1dd16a4cf tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:38:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:01 user nova-compute[71321]: DEBUG nova.compute.manager [req-9c9ba4e2-2f47-486a-95c0-58ac9bba8ab7 req-b1bd39d1-0021-4d49-9e96-0a23bf66dc94 service nova] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Received event network-vif-unplugged-33441356-cd95-4247-86bb-3f49f00d8e81 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:38:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9c9ba4e2-2f47-486a-95c0-58ac9bba8ab7 req-b1bd39d1-0021-4d49-9e96-0a23bf66dc94 service nova] Acquiring lock "c5b9b1bb-a3d9-4073-8d49-70360dae6f29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:38:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9c9ba4e2-2f47-486a-95c0-58ac9bba8ab7 req-b1bd39d1-0021-4d49-9e96-0a23bf66dc94 service nova] Lock "c5b9b1bb-a3d9-4073-8d49-70360dae6f29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:38:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9c9ba4e2-2f47-486a-95c0-58ac9bba8ab7 req-b1bd39d1-0021-4d49-9e96-0a23bf66dc94 service nova] Lock "c5b9b1bb-a3d9-4073-8d49-70360dae6f29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:38:01 user nova-compute[71321]: DEBUG nova.compute.manager [req-9c9ba4e2-2f47-486a-95c0-58ac9bba8ab7 req-b1bd39d1-0021-4d49-9e96-0a23bf66dc94 service nova] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] No waiting events found dispatching network-vif-unplugged-33441356-cd95-4247-86bb-3f49f00d8e81 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:38:01 user nova-compute[71321]: DEBUG nova.compute.manager [req-9c9ba4e2-2f47-486a-95c0-58ac9bba8ab7 req-b1bd39d1-0021-4d49-9e96-0a23bf66dc94 service nova] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Received event network-vif-unplugged-33441356-cd95-4247-86bb-3f49f00d8e81 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:38:01 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Instance destroyed successfully.
Apr 12 12:38:01 user nova-compute[71321]: DEBUG nova.objects.instance [None req-d6dcc941-d6af-4660-940e-c8d1dd16a4cf tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lazy-loading 'resources' on Instance uuid c5b9b1bb-a3d9-4073-8d49-70360dae6f29 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:38:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-d6dcc941-d6af-4660-940e-c8d1dd16a4cf tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1385172831',display_name='tempest-VolumesAdminNegativeTest-server-1385172831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1385172831',id=15,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwfNw+fvD7X4C2arQ/IOvs3K4y/lgQ5Pq3fO+j5VSF5Rg09hb2/k2StMjL05qEGcPBIk8YLKdGWWdEzgPlfvaKjg/N0ZO7tOTPs9daq6f05+grV+GuA4jxUJKEMKKnlXA==',key_name='tempest-keypair-323125528',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:32:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d607e0aed1f47129540181261c6ebc7',ramdisk_id='',reservation_id='r-nch0ks96',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-714206228',owner_user_name='tempest-VolumesAdminNegativeTest-714206228-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:32:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3a887c10bf74974a648e3ec048fcdd7',uuid=c5b9b1bb-a3d9-4073-8d49-70360dae6f29,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33441356-cd95-4247-86bb-3f49f00d8e81", "address": "fa:16:3e:9a:89:f9", "network": {"id": "6e43ca53-1563-43b0-84cc-d3f759c61c37", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-908305790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d607e0aed1f47129540181261c6ebc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33441356-cd", "ovs_interfaceid": "33441356-cd95-4247-86bb-3f49f00d8e81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:38:01 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-d6dcc941-d6af-4660-940e-c8d1dd16a4cf tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Converting VIF {"id": "33441356-cd95-4247-86bb-3f49f00d8e81", "address": "fa:16:3e:9a:89:f9", "network": {"id": "6e43ca53-1563-43b0-84cc-d3f759c61c37", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-908305790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d607e0aed1f47129540181261c6ebc7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33441356-cd", "ovs_interfaceid": "33441356-cd95-4247-86bb-3f49f00d8e81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:38:01 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-d6dcc941-d6af-4660-940e-c8d1dd16a4cf tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:89:f9,bridge_name='br-int',has_traffic_filtering=True,id=33441356-cd95-4247-86bb-3f49f00d8e81,network=Network(6e43ca53-1563-43b0-84cc-d3f759c61c37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33441356-cd') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:38:01 user nova-compute[71321]: DEBUG os_vif [None req-d6dcc941-d6af-4660-940e-c8d1dd16a4cf tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:89:f9,bridge_name='br-int',has_traffic_filtering=True,id=33441356-cd95-4247-86bb-3f49f00d8e81,network=Network(6e43ca53-1563-43b0-84cc-d3f759c61c37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33441356-cd') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:38:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33441356-cd, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:38:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:38:01 user nova-compute[71321]: INFO os_vif [None req-d6dcc941-d6af-4660-940e-c8d1dd16a4cf tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:89:f9,bridge_name='br-int',has_traffic_filtering=True,id=33441356-cd95-4247-86bb-3f49f00d8e81,network=Network(6e43ca53-1563-43b0-84cc-d3f759c61c37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33441356-cd')
Apr 12 12:38:01 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-d6dcc941-d6af-4660-940e-c8d1dd16a4cf tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Deleting instance files /opt/stack/data/nova/instances/c5b9b1bb-a3d9-4073-8d49-70360dae6f29_del
Apr 12 12:38:01 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-d6dcc941-d6af-4660-940e-c8d1dd16a4cf tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Deletion of /opt/stack/data/nova/instances/c5b9b1bb-a3d9-4073-8d49-70360dae6f29_del complete
Apr 12 12:38:01 user nova-compute[71321]: INFO nova.compute.manager [None req-d6dcc941-d6af-4660-940e-c8d1dd16a4cf tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Took 1.01 seconds to destroy the instance on the hypervisor.
Apr 12 12:38:01 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-d6dcc941-d6af-4660-940e-c8d1dd16a4cf tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:38:01 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:38:01 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:38:02 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:38:02 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Took 0.72 seconds to deallocate network for instance.
Apr 12 12:38:02 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d6dcc941-d6af-4660-940e-c8d1dd16a4cf tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:38:02 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d6dcc941-d6af-4660-940e-c8d1dd16a4cf tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:38:02 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-d6dcc941-d6af-4660-940e-c8d1dd16a4cf tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:38:02 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-d6dcc941-d6af-4660-940e-c8d1dd16a4cf tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:38:02 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d6dcc941-d6af-4660-940e-c8d1dd16a4cf tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:38:02 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-d6dcc941-d6af-4660-940e-c8d1dd16a4cf tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Deleted allocations for instance c5b9b1bb-a3d9-4073-8d49-70360dae6f29
Apr 12 12:38:02 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d6dcc941-d6af-4660-940e-c8d1dd16a4cf tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "c5b9b1bb-a3d9-4073-8d49-70360dae6f29" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.233s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:38:03 user nova-compute[71321]: DEBUG nova.compute.manager [req-dbb0a7fb-e53c-4f75-a05c-206409474091 req-7005e032-9800-4887-b5bb-f1c26edda3a4 service nova] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Received event network-vif-plugged-33441356-cd95-4247-86bb-3f49f00d8e81 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:38:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-dbb0a7fb-e53c-4f75-a05c-206409474091 req-7005e032-9800-4887-b5bb-f1c26edda3a4 service nova] Acquiring lock "c5b9b1bb-a3d9-4073-8d49-70360dae6f29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:38:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-dbb0a7fb-e53c-4f75-a05c-206409474091 req-7005e032-9800-4887-b5bb-f1c26edda3a4 service nova] Lock "c5b9b1bb-a3d9-4073-8d49-70360dae6f29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:38:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-dbb0a7fb-e53c-4f75-a05c-206409474091 req-7005e032-9800-4887-b5bb-f1c26edda3a4 service nova] Lock "c5b9b1bb-a3d9-4073-8d49-70360dae6f29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:38:03 user nova-compute[71321]: DEBUG nova.compute.manager [req-dbb0a7fb-e53c-4f75-a05c-206409474091 req-7005e032-9800-4887-b5bb-f1c26edda3a4 service nova] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] No waiting events found dispatching network-vif-plugged-33441356-cd95-4247-86bb-3f49f00d8e81 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:38:03 user nova-compute[71321]: WARNING nova.compute.manager [req-dbb0a7fb-e53c-4f75-a05c-206409474091 req-7005e032-9800-4887-b5bb-f1c26edda3a4 service nova] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Received unexpected event network-vif-plugged-33441356-cd95-4247-86bb-3f49f00d8e81 for instance with vm_state deleted and task_state None.
Apr 12 12:38:03 user nova-compute[71321]: DEBUG nova.compute.manager [req-dbb0a7fb-e53c-4f75-a05c-206409474091 req-7005e032-9800-4887-b5bb-f1c26edda3a4 service nova] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Received event network-vif-deleted-33441356-cd95-4247-86bb-3f49f00d8e81 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:38:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:16 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681303081.4066553, c5b9b1bb-a3d9-4073-8d49-70360dae6f29 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:38:16 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] VM Stopped (Lifecycle Event)
Apr 12 12:38:16 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:38:16 user nova-compute[71321]: DEBUG nova.compute.manager [None req-0e3146b2-6af3-43af-86bb-8a3b22ef7e30 None None] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:38:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:18 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:38:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:38:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:38:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:38:18 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:38:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "9439468d-7a45-443b-87ce-106907761a56" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:38:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "9439468d-7a45-443b-87ce-106907761a56" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:38:20 user nova-compute[71321]: INFO nova.compute.manager [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Detaching volume b9c08f12-a467-4152-a8fb-00aef87ac9c9
Apr 12 12:38:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:38:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:38:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:20 user nova-compute[71321]: INFO nova.virt.block_device [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Attempting to driver detach volume b9c08f12-a467-4152-a8fb-00aef87ac9c9 from mountpoint /dev/vdc
Apr 12 12:38:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Attempting to detach device vdc from instance 9439468d-7a45-443b-87ce-106907761a56 from the persistent domain config. {{(pid=71321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 12:38:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:38:20 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:38:20 user nova-compute[71321]:   <source dev="/dev/sdb"/>
Apr 12 12:38:20 user nova-compute[71321]:   <target dev="vdc" bus="virtio"/>
Apr 12 12:38:20 user nova-compute[71321]:   <serial>b9c08f12-a467-4152-a8fb-00aef87ac9c9</serial>
Apr 12 12:38:20 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 12:38:20 user nova-compute[71321]: </disk>
Apr 12 12:38:20 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:38:20 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Successfully detached device vdc from instance 9439468d-7a45-443b-87ce-106907761a56 from the persistent domain config.
Apr 12 12:38:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 9439468d-7a45-443b-87ce-106907761a56 from the live domain config. {{(pid=71321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 12:38:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:38:20 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:38:20 user nova-compute[71321]:   <source dev="/dev/sdb"/>
Apr 12 12:38:20 user nova-compute[71321]:   <target dev="vdc" bus="virtio"/>
Apr 12 12:38:20 user nova-compute[71321]:   <serial>b9c08f12-a467-4152-a8fb-00aef87ac9c9</serial>
Apr 12 12:38:20 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 12:38:20 user nova-compute[71321]: </disk>
Apr 12 12:38:20 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:38:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:38:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Received event <DeviceRemovedEvent: 1681303100.613974, 9439468d-7a45-443b-87ce-106907761a56 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 12:38:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 9439468d-7a45-443b-87ce-106907761a56 {{(pid=71321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 12:38:20 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Successfully detached device vdc from instance 9439468d-7a45-443b-87ce-106907761a56 from the live domain config.
Apr 12 12:38:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:38:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fTvwiPuO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:38:20 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:38:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:38:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:38:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b53715-4c29-4c1d-a009-69d340e07c66]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:38:20 user nova-compute[71321]: No targets found.
Apr 12 12:38:20 user nova-compute[71321]: iSNS:
Apr 12 12:38:20 user nova-compute[71321]: No targets found.
Apr 12 12:38:20 user nova-compute[71321]: STATIC:
Apr 12 12:38:20 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9
Apr 12 12:38:20 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:38:20 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:38:20 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f
Apr 12 12:38:20 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:38:20 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:38:20 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5
Apr 12 12:38:20 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:38:20 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:38:20 user nova-compute[71321]: FIRMWARE:
Apr 12 12:38:20 user nova-compute[71321]: No targets found.
Apr 12 12:38:20 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:38:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:38:20 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:38:20 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:38:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:38:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[34dff11f-4939-4e4f-b262-860cd6be131d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:21 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:38:21 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:38:21 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=7972MB free_disk=26.43252944946289GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d1e303-d3ae-4b1f-a207-10784fdce4ab]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 (non-flash)
Apr 12 12:38:21 user nova-compute[71321]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)
Apr 12 12:38:21 user nova-compute[71321]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:38:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 (non-flash)
Apr 12 12:38:21 user nova-compute[71321]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)
Apr 12 12:38:21 user nova-compute[71321]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:38:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef7c333910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9'): ({'sdb'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Removing single pathed devices sdb {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c787d55-ebdf-477e-97d3-29ae78cd2103]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8130f9-b952-449e-b715-d34dfbf304d3]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Flushing IO for device /dev/sdb {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1e2f61-143a-4806-a74c-47c25c67e338]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Applying migration context for instance 546c0c08-35f1-4043-ac30-56d49bc86af1 as it has an incoming, in-progress migration 13fdba50-49cb-4806-a103-10b8c219a3de. Migration status is finished {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 12 12:38:21 user nova-compute[71321]: INFO nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Updating resource usage from migration 13fdba50-49cb-4806-a103-10b8c219a3de
Apr 12 12:38:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ff4051-0784-4dea-b994-9a5294b1f733]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] SCSI volumes sdb have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 10116da0-785c-41cf-96bb-95721af863db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance a4107f2d-88e4-4846-9ece-cb16ad7ecd02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 8403a098-a141-4feb-9eed-3731e2c7c152 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 9439468d-7a45-443b-87ce-106907761a56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Migration 13fdba50-49cb-4806-a103-10b8c219a3de is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 68378ff4-9b1d-4fa5-9b83-8f6c27541c63 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=1600MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[13359758-7b70-466d-b86d-12018b832c7e]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cee05f-a21c-4a48-aaf5-ef0f6c0fab40]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9, portal: 172.16.0.220,3260]
Apr 12 12:38:21 user nova-compute[71321]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9, portal: 172.16.0.220,3260] successful.
Apr 12 12:38:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9c08f12-a467-4152-a8fb-00aef87ac9c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b666c756-e977-4351-a133-f782643451ba]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.683s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] <== disconnect_volume: return (686ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:38:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.416s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:38:22 user nova-compute[71321]: DEBUG nova.objects.instance [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lazy-loading 'flavor' on Instance uuid 9439468d-7a45-443b-87ce-106907761a56 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:38:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "9439468d-7a45-443b-87ce-106907761a56" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.139s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:38:23 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:38:23 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:38:23 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:38:23 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:38:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-9439468d-7a45-443b-87ce-106907761a56" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:38:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-9439468d-7a45-443b-87ce-106907761a56" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:38:23 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 9439468d-7a45-443b-87ce-106907761a56] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 12:38:24 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 9439468d-7a45-443b-87ce-106907761a56] Updating instance_info_cache with network_info: [{"id": "67b56c74-fc25-4bc8-875e-8a134830124b", "address": "fa:16:3e:14:ba:2c", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b56c74-fc", "ovs_interfaceid": "67b56c74-fc25-4bc8-875e-8a134830124b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:38:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-9439468d-7a45-443b-87ce-106907761a56" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:38:24 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 9439468d-7a45-443b-87ce-106907761a56] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 12:38:24 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:38:24 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:38:24 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:38:24 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:25 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:38:25 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:38:26 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:38:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:38:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:38 user nova-compute[71321]: DEBUG nova.compute.manager [req-edd23fa6-633a-4537-a3f6-0069026b791d req-85f0af68-6ac6-430f-90d8-624e8ddd7798 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received event network-changed-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:38:38 user nova-compute[71321]: DEBUG nova.compute.manager [req-edd23fa6-633a-4537-a3f6-0069026b791d req-85f0af68-6ac6-430f-90d8-624e8ddd7798 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Refreshing instance network info cache due to event network-changed-c3155961-f301-4a26-a599-1d648d2500b0. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:38:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-edd23fa6-633a-4537-a3f6-0069026b791d req-85f0af68-6ac6-430f-90d8-624e8ddd7798 service nova] Acquiring lock "refresh_cache-89cc5f86-c387-4966-8bbf-a64d42d30db7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:38:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-edd23fa6-633a-4537-a3f6-0069026b791d req-85f0af68-6ac6-430f-90d8-624e8ddd7798 service nova] Acquired lock "refresh_cache-89cc5f86-c387-4966-8bbf-a64d42d30db7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:38:38 user nova-compute[71321]: DEBUG nova.network.neutron [req-edd23fa6-633a-4537-a3f6-0069026b791d req-85f0af68-6ac6-430f-90d8-624e8ddd7798 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Refreshing network info cache for port c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:38:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "89cc5f86-c387-4966-8bbf-a64d42d30db7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:38:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:38:38 user nova-compute[71321]: DEBUG nova.objects.instance [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'flavor' on Instance uuid 89cc5f86-c387-4966-8bbf-a64d42d30db7 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:38:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:38:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "89cc5f86-c387-4966-8bbf-a64d42d30db7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:38:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:38:38 user nova-compute[71321]: INFO nova.compute.manager [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Attaching volume 2695aae0-2bb7-41a8-9f06-dd2df4aba06b to /dev/vdb
Apr 12 12:38:38 user nova-compute[71321]: DEBUG os_brick.utils [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:38:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:38 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84a1927-6f2c-46aa-836d-d0a114addfde]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:38 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef056dee-4930-446e-be4c-449369ee08c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:38 user nova-compute[71321]: DEBUG nova.network.neutron [req-edd23fa6-633a-4537-a3f6-0069026b791d req-85f0af68-6ac6-430f-90d8-624e8ddd7798 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Updated VIF entry in instance network info cache for port c3155961-f301-4a26-a599-1d648d2500b0. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:38:38 user nova-compute[71321]: DEBUG nova.network.neutron [req-edd23fa6-633a-4537-a3f6-0069026b791d req-85f0af68-6ac6-430f-90d8-624e8ddd7798 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Updating instance_info_cache with network_info: [{"id": "c3155961-f301-4a26-a599-1d648d2500b0", "address": "fa:16:3e:75:3a:c1", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3155961-f3", "ovs_interfaceid": "c3155961-f301-4a26-a599-1d648d2500b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:38:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:38 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5fec78-4966-420c-95b4-1012d447b406]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:38 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[498e1b9c-b541-496e-8cc3-47dfa1cb5faa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:38:38 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:38:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-edd23fa6-633a-4537-a3f6-0069026b791d req-85f0af68-6ac6-430f-90d8-624e8ddd7798 service nova] Releasing lock "refresh_cache-89cc5f86-c387-4966-8bbf-a64d42d30db7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:38:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:38:38 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:38:38 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb75a7e9-6930-4602-ab74-da01cb5a2637]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:38 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:38:38 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:38:38 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:38:38 user nova-compute[71321]: DEBUG os_brick.utils [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:38:38 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Updating existing volume attachment record: 892bb724-c48a-43d2-ab11-e282eb08f776 {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:38:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:41 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZGHsSNtk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:38:43 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:38:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:38:43 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:38:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:38:43 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:38:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1672c0f-b3bf-4d3c-8aca-8e464ec54604]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:38:43 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0030d0-9d2a-4eb3-980e-e493da61ebc9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b] added
Apr 12 12:38:43 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1a13ee-9bac-49df-b551-bd6c089360bd]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[49da0c7e-7da8-4269-8830-0e92d36a6725]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZGHsSNtk {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZGHsSNtk" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8419da-0f3c-4bc6-8564-b8737db9558f]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZGHsSNtk'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8014e0-2ee1-47cd-b7ba-a0312fbfed14]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a3850a-25f0-44b0-a8b0-fbee9c1859fd]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)
Apr 12 12:38:43 user nova-compute[71321]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:38:43 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)
Apr 12 12:38:43 user nova-compute[71321]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:38:43 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0f5964-6b56-4aa9-b157-0de7a303e3d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b, portal: 172.16.0.220,3260]
Apr 12 12:38:43 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b, portal: 172.16.0.220,3260] successful.
Apr 12 12:38:43 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[da31dbc3-d647-4cf8-99b6-9e88a525a6b1]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed12d045-3f48-4838-b23f-e2f7b674b9f6]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)
Apr 12 12:38:43 user nova-compute[71321]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:38:43 user nova-compute[71321]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)
Apr 12 12:38:43 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)
Apr 12 12:38:43 user nova-compute[71321]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:38:43 user nova-compute[71321]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)
Apr 12 12:38:43 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4c6442-e4d3-42e1-881c-37840ce13efc]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:38:43 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZGHsSNtk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:38:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "fa011231-049f-40c3-89c0-53447a35752f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:38:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "fa011231-049f-40c3-89c0-53447a35752f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:38:44 user nova-compute[71321]: INFO nova.compute.manager [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Unshelving
Apr 12 12:38:44 user nova-compute[71321]: INFO nova.virt.block_device [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Booting with volume 5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 at /dev/vda
Apr 12 12:38:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:38:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23962366534366537', 'path': '/dev/sdb'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:38:44 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962366534366537', 'path': '/dev/sdb'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:38:44 user nova-compute[71321]: DEBUG nova.objects.instance [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'flavor' on Instance uuid 89cc5f86-c387-4966-8bbf-a64d42d30db7 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:38:44 user nova-compute[71321]: DEBUG os_brick.utils [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:38:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:44 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 12:38:44 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:38:44 user nova-compute[71321]:   <source dev="/dev/sdb"/>
Apr 12 12:38:44 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:38:44 user nova-compute[71321]:   <serial>2695aae0-2bb7-41a8-9f06-dd2df4aba06b</serial>
Apr 12 12:38:44 user nova-compute[71321]: </disk>
Apr 12 12:38:44 user nova-compute[71321]:  {{(pid=71321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 12:38:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e23e00f-872a-41d6-a3d9-9d1e51ae1818]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccaab82-4d39-4583-82b6-8f9f2ea616cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4219d25-20f5-4423-8437-baccc4c4785f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cfb750-e1ba-4d7a-9896-159e3faf86d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:38:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:38:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:38:44 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:38:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78500ff-3865-402a-9f66-ef2fe0f17c03]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:38:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:38:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:38:44 user nova-compute[71321]: DEBUG os_brick.utils [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:38:44 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Updating existing volume attachment record: bea512c8-1df1-4870-a9f8-08a552f5a9ef {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:38:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:45 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:38:45 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:38:45 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] No VIF found with MAC fa:16:3e:75:3a:c1, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:38:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.459s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:38:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:46 user nova-compute[71321]: INFO nova.compute.manager [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Rescuing
Apr 12 12:38:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "refresh_cache-89cc5f86-c387-4966-8bbf-a64d42d30db7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:38:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquired lock "refresh_cache-89cc5f86-c387-4966-8bbf-a64d42d30db7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:38:46 user nova-compute[71321]: DEBUG nova.network.neutron [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:38:46 user nova-compute[71321]: DEBUG nova.network.neutron [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Updating instance_info_cache with network_info: [{"id": "c3155961-f301-4a26-a599-1d648d2500b0", "address": "fa:16:3e:75:3a:c1", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3155961-f3", "ovs_interfaceid": "c3155961-f301-4a26-a599-1d648d2500b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:38:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Releasing lock "refresh_cache-89cc5f86-c387-4966-8bbf-a64d42d30db7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:38:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:47 user nova-compute[71321]: DEBUG nova.compute.manager [req-0f51ff9b-45ae-4430-9ef7-402e334aa9d1 req-a1915606-721d-49d3-bc1b-699ece3bc2e2 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received event network-vif-unplugged-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:38:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0f51ff9b-45ae-4430-9ef7-402e334aa9d1 req-a1915606-721d-49d3-bc1b-699ece3bc2e2 service nova] Acquiring lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:38:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0f51ff9b-45ae-4430-9ef7-402e334aa9d1 req-a1915606-721d-49d3-bc1b-699ece3bc2e2 service nova] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:38:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0f51ff9b-45ae-4430-9ef7-402e334aa9d1 req-a1915606-721d-49d3-bc1b-699ece3bc2e2 service nova] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:38:47 user nova-compute[71321]: DEBUG nova.compute.manager [req-0f51ff9b-45ae-4430-9ef7-402e334aa9d1 req-a1915606-721d-49d3-bc1b-699ece3bc2e2 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] No waiting events found dispatching network-vif-unplugged-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:38:47 user nova-compute[71321]: WARNING nova.compute.manager [req-0f51ff9b-45ae-4430-9ef7-402e334aa9d1 req-a1915606-721d-49d3-bc1b-699ece3bc2e2 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received unexpected event network-vif-unplugged-c3155961-f301-4a26-a599-1d648d2500b0 for instance with vm_state active and task_state rescuing.
Apr 12 12:38:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:47 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Instance destroyed successfully.
Apr 12 12:38:47 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Attempting rescue
Apr 12 12:38:47 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71321) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 12:38:47 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Instance directory exists: not creating {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 12:38:47 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Creating image(s)
Apr 12 12:38:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "/opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:38:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "/opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:38:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "/opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:38:47 user nova-compute[71321]: DEBUG nova.objects.instance [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'trusted_certs' on Instance uuid 89cc5f86-c387-4966-8bbf-a64d42d30db7 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:38:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:38:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:38:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.142s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk.rescue {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk.rescue" returned: 0 in 0.048s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:38:48 user nova-compute[71321]: DEBUG nova.objects.instance [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'migration_context' on Instance uuid 89cc5f86-c387-4966-8bbf-a64d42d30db7 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:38:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:38:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Start _get_guest_xml network_info=[{"id": "c3155961-f301-4a26-a599-1d648d2500b0", "address": "fa:16:3e:75:3a:c1", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "vif_mac": "fa:16:3e:75:3a:c1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3155961-f3", "ovs_interfaceid": "c3155961-f301-4a26-a599-1d648d2500b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:38:48 user nova-compute[71321]: DEBUG nova.objects.instance [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'resources' on Instance uuid 89cc5f86-c387-4966-8bbf-a64d42d30db7 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:38:48 user nova-compute[71321]: DEBUG nova.objects.instance [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'numa_topology' on Instance uuid 89cc5f86-c387-4966-8bbf-a64d42d30db7 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:38:48 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:38:48 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:38:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:38:48 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:38:48 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:38:48 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:38:48 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:38:48 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:38:48 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:38:48 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:38:48 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:38:48 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:38:48 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:38:48 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:38:48 user nova-compute[71321]: DEBUG nova.objects.instance [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'vcpu_model' on Instance uuid 89cc5f86-c387-4966-8bbf-a64d42d30db7 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:38:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:36:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1426605846',display_name='tempest-ServerRescueNegativeTestJSON-server-1426605846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1426605846',id=24,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoCyqzs+8zrj4h6uGdmSsuDYdl4XZy4hARXsIlRPh7dRZ2tEg+K3UMhHPOf8n5+xfHG0dd1ftUcbN4N2gdcb3nvuvPgtvGBh8vkaOa3CldqRPPAwwxfvBWjOglZdUPChQ==',key_name='tempest-keypair-856573039',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:36:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9ec9671123c4a00a2880de4b4df8d3e',ramdisk_id='',reservation_id='r-mdc0x69g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1979263125',owner_user_name='tempest-ServerRescueNegativeTestJSON-1979263125-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:36:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1db0203a6e6f4cc3bccbf19577a0c82f',uuid=89cc5f86-c387-4966-8bbf-a64d42d30db7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3155961-f301-4a26-a599-1d648d2500b0", "address": "fa:16:3e:75:3a:c1", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "vif_mac": "fa:16:3e:75:3a:c1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3155961-f3", "ovs_interfaceid": "c3155961-f301-4a26-a599-1d648d2500b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:38:48 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Converting VIF {"id": "c3155961-f301-4a26-a599-1d648d2500b0", "address": "fa:16:3e:75:3a:c1", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "vif_mac": "fa:16:3e:75:3a:c1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3155961-f3", "ovs_interfaceid": "c3155961-f301-4a26-a599-1d648d2500b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:38:48 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:3a:c1,bridge_name='br-int',has_traffic_filtering=True,id=c3155961-f301-4a26-a599-1d648d2500b0,network=Network(0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3155961-f3') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:38:48 user nova-compute[71321]: DEBUG nova.objects.instance [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'pci_devices' on Instance uuid 89cc5f86-c387-4966-8bbf-a64d42d30db7 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:38:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:38:48 user nova-compute[71321]:   <uuid>89cc5f86-c387-4966-8bbf-a64d42d30db7</uuid>
Apr 12 12:38:48 user nova-compute[71321]:   <name>instance-00000018</name>
Apr 12 12:38:48 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:38:48 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:38:48 user nova-compute[71321]:   <metadata>
Apr 12 12:38:48 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:38:48 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:38:48 user nova-compute[71321]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1426605846</nova:name>
Apr 12 12:38:48 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:38:48</nova:creationTime>
Apr 12 12:38:48 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:38:48 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:38:48 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:38:48 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:38:48 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:38:48 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:38:48 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:38:48 user nova-compute[71321]:       <nova:owner>
Apr 12 12:38:48 user nova-compute[71321]:         <nova:user uuid="1db0203a6e6f4cc3bccbf19577a0c82f">tempest-ServerRescueNegativeTestJSON-1979263125-project-member</nova:user>
Apr 12 12:38:48 user nova-compute[71321]:         <nova:project uuid="f9ec9671123c4a00a2880de4b4df8d3e">tempest-ServerRescueNegativeTestJSON-1979263125</nova:project>
Apr 12 12:38:48 user nova-compute[71321]:       </nova:owner>
Apr 12 12:38:48 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:38:48 user nova-compute[71321]:       <nova:ports>
Apr 12 12:38:48 user nova-compute[71321]:         <nova:port uuid="c3155961-f301-4a26-a599-1d648d2500b0">
Apr 12 12:38:48 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 12:38:48 user nova-compute[71321]:         </nova:port>
Apr 12 12:38:48 user nova-compute[71321]:       </nova:ports>
Apr 12 12:38:48 user nova-compute[71321]:     </nova:instance>
Apr 12 12:38:48 user nova-compute[71321]:   </metadata>
Apr 12 12:38:48 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:38:48 user nova-compute[71321]:     <system>
Apr 12 12:38:48 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:38:48 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:38:48 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:38:48 user nova-compute[71321]:       <entry name="serial">89cc5f86-c387-4966-8bbf-a64d42d30db7</entry>
Apr 12 12:38:48 user nova-compute[71321]:       <entry name="uuid">89cc5f86-c387-4966-8bbf-a64d42d30db7</entry>
Apr 12 12:38:48 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:38:48 user nova-compute[71321]:     </system>
Apr 12 12:38:48 user nova-compute[71321]:   </sysinfo>
Apr 12 12:38:48 user nova-compute[71321]:   <os>
Apr 12 12:38:48 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:38:48 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:38:48 user nova-compute[71321]:   </os>
Apr 12 12:38:48 user nova-compute[71321]:   <features>
Apr 12 12:38:48 user nova-compute[71321]:     <acpi/>
Apr 12 12:38:48 user nova-compute[71321]:     <apic/>
Apr 12 12:38:48 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:38:48 user nova-compute[71321]:   </features>
Apr 12 12:38:48 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:38:48 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:38:48 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:38:48 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:38:48 user nova-compute[71321]:   </clock>
Apr 12 12:38:48 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:38:48 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:38:48 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:38:48 user nova-compute[71321]:   </cpu>
Apr 12 12:38:48 user nova-compute[71321]:   <devices>
Apr 12 12:38:48 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:38:48 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:38:48 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk.rescue"/>
Apr 12 12:38:48 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:38:48 user nova-compute[71321]:     </disk>
Apr 12 12:38:48 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:38:48 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:38:48 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk"/>
Apr 12 12:38:48 user nova-compute[71321]:       <target dev="vdb" bus="virtio"/>
Apr 12 12:38:48 user nova-compute[71321]:     </disk>
Apr 12 12:38:48 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:38:48 user nova-compute[71321]:       <mac address="fa:16:3e:75:3a:c1"/>
Apr 12 12:38:48 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:38:48 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:38:48 user nova-compute[71321]:       <target dev="tapc3155961-f3"/>
Apr 12 12:38:48 user nova-compute[71321]:     </interface>
Apr 12 12:38:48 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:38:48 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/console.log" append="off"/>
Apr 12 12:38:48 user nova-compute[71321]:     </serial>
Apr 12 12:38:48 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:38:48 user nova-compute[71321]:     <video>
Apr 12 12:38:48 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:38:48 user nova-compute[71321]:     </video>
Apr 12 12:38:48 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:38:48 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:38:48 user nova-compute[71321]:     </rng>
Apr 12 12:38:48 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:38:48 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:38:48 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:38:48 user nova-compute[71321]:     </memballoon>
Apr 12 12:38:48 user nova-compute[71321]:   </devices>
Apr 12 12:38:48 user nova-compute[71321]: </domain>
Apr 12 12:38:48 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:38:48 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Instance destroyed successfully.
Apr 12 12:38:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:38:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:38:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] No VIF found with MAC fa:16:3e:75:3a:c1, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:38:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:38:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:38:49 user nova-compute[71321]: DEBUG nova.objects.instance [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lazy-loading 'pci_requests' on Instance uuid fa011231-049f-40c3-89c0-53447a35752f {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:38:49 user nova-compute[71321]: DEBUG nova.objects.instance [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lazy-loading 'numa_topology' on Instance uuid fa011231-049f-40c3-89c0-53447a35752f {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:38:49 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:38:49 user nova-compute[71321]: INFO nova.compute.claims [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Claim successful on node user
Apr 12 12:38:49 user nova-compute[71321]: DEBUG nova.compute.manager [req-e2c7347a-8511-4773-b719-84387d105b18 req-ab5ed423-111b-4e0c-9ddf-9232a97fd663 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received event network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:38:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e2c7347a-8511-4773-b719-84387d105b18 req-ab5ed423-111b-4e0c-9ddf-9232a97fd663 service nova] Acquiring lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:38:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e2c7347a-8511-4773-b719-84387d105b18 req-ab5ed423-111b-4e0c-9ddf-9232a97fd663 service nova] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:38:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e2c7347a-8511-4773-b719-84387d105b18 req-ab5ed423-111b-4e0c-9ddf-9232a97fd663 service nova] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:38:49 user nova-compute[71321]: DEBUG nova.compute.manager [req-e2c7347a-8511-4773-b719-84387d105b18 req-ab5ed423-111b-4e0c-9ddf-9232a97fd663 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] No waiting events found dispatching network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:38:49 user nova-compute[71321]: WARNING nova.compute.manager [req-e2c7347a-8511-4773-b719-84387d105b18 req-ab5ed423-111b-4e0c-9ddf-9232a97fd663 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received unexpected event network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 for instance with vm_state active and task_state rescuing.
Apr 12 12:38:49 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:38:49 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:38:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.394s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:38:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:49 user nova-compute[71321]: INFO nova.network.neutron [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Updating port 8243f136-fe60-498f-80e1-27a598c434a3 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 12 12:38:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "refresh_cache-fa011231-049f-40c3-89c0-53447a35752f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquired lock "refresh_cache-fa011231-049f-40c3-89c0-53447a35752f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG nova.network.neutron [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG nova.compute.manager [req-01a0e2e3-e95a-4b14-bf61-9cbeb24a017d req-d4a7aacc-bd68-4a44-9a6d-93d4c3b95685 service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Received event network-changed-8243f136-fe60-498f-80e1-27a598c434a3 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG nova.compute.manager [req-01a0e2e3-e95a-4b14-bf61-9cbeb24a017d req-d4a7aacc-bd68-4a44-9a6d-93d4c3b95685 service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Refreshing instance network info cache due to event network-changed-8243f136-fe60-498f-80e1-27a598c434a3. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-01a0e2e3-e95a-4b14-bf61-9cbeb24a017d req-d4a7aacc-bd68-4a44-9a6d-93d4c3b95685 service nova] Acquiring lock "refresh_cache-fa011231-049f-40c3-89c0-53447a35752f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG nova.network.neutron [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Updating instance_info_cache with network_info: [{"id": "8243f136-fe60-498f-80e1-27a598c434a3", "address": "fa:16:3e:2f:02:41", "network": {"id": "34ecf1c9-50ff-4168-8650-a5277102ccaa", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730184159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a894beccbd45af9d4486772fccb949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8243f136-fe", "ovs_interfaceid": "8243f136-fe60-498f-80e1-27a598c434a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Releasing lock "refresh_cache-fa011231-049f-40c3-89c0-53447a35752f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:38:50 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Creating image(s)
Apr 12 12:38:50 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Did not create local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Ensure instance console log exists: /opt/stack/data/nova/instances/fa011231-049f-40c3-89c0-53447a35752f/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Start _get_guest_xml network_info=[{"id": "8243f136-fe60-498f-80e1-27a598c434a3", "address": "fa:16:3e:2f:02:41", "network": {"id": "34ecf1c9-50ff-4168-8650-a5277102ccaa", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730184159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a894beccbd45af9d4486772fccb949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8243f136-fe", "ovs_interfaceid": "8243f136-fe60-498f-80e1-27a598c434a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'bea512c8-1df1-4870-a9f8-08a552f5a9ef', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MJbBXUwj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fa011231-049f-40c3-89c0-53447a35752f', 'attached_at': '', 'detached_at': '', 'volume_id': '5edf56f8-c348-40e5-a9e0-d0b3a7fc7945', 'serial': '5edf56f8-c348-40e5-a9e0-d0b3a7fc7945'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-01a0e2e3-e95a-4b14-bf61-9cbeb24a017d req-d4a7aacc-bd68-4a44-9a6d-93d4c3b95685 service nova] Acquired lock "refresh_cache-fa011231-049f-40c3-89c0-53447a35752f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG nova.network.neutron [req-01a0e2e3-e95a-4b14-bf61-9cbeb24a017d req-d4a7aacc-bd68-4a44-9a6d-93d4c3b95685 service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Refreshing network info cache for port 8243f136-fe60-498f-80e1-27a598c434a3 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:38:50 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:38:50 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:38:50 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG nova.objects.instance [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lazy-loading 'vcpu_model' on Instance uuid fa011231-049f-40c3-89c0-53447a35752f {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MJbBXUwj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:38:50 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:38:50 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:38:50 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:38:50 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:38:50 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:38:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[24887021-3569-4d12-b087-ce4b8ad8d48f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:38:50 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:38:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafb2ba6-a956-4ce3-ab7b-97d0ca083a0c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945] added
Apr 12 12:38:51 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73b3783-7c00-4831-a14d-3aa95251e8d6]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b82b0ea-fe03-4872-9a80-31134377537a]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MJbBXUwj {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MJbBXUwj" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8370fcfc-283c-4ef6-9267-7201d75bfba8]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MJbBXUwj'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8932e9d8-1844-44d0-806f-7f212706c927]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d2aa1e-c1e4-4553-808a-380bcf54145d]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)
Apr 12 12:38:51 user nova-compute[71321]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:38:51 user nova-compute[71321]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)
Apr 12 12:38:51 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)
Apr 12 12:38:51 user nova-compute[71321]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:38:51 user nova-compute[71321]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)
Apr 12 12:38:51 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec43c0c8-45ea-45b1-a319-f7a9d8b1a342]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945, portal: 172.16.0.220,3260]
Apr 12 12:38:51 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945, portal: 172.16.0.220,3260] successful.
Apr 12 12:38:51 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0bd708-392b-4340-a9bf-e44d339c38fe]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[627b4359-8649-4ff4-8362-6e9409f8c064]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)
Apr 12 12:38:51 user nova-compute[71321]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:38:51 user nova-compute[71321]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)
Apr 12 12:38:51 user nova-compute[71321]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:38:51 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)
Apr 12 12:38:51 user nova-compute[71321]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:38:51 user nova-compute[71321]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)
Apr 12 12:38:51 user nova-compute[71321]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:38:51 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[019a0b94-8100-4acc-aeea-f9b6b75be366]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MJbBXUwj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG nova.network.neutron [req-01a0e2e3-e95a-4b14-bf61-9cbeb24a017d req-d4a7aacc-bd68-4a44-9a6d-93d4c3b95685 service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Updated VIF entry in instance network info cache for port 8243f136-fe60-498f-80e1-27a598c434a3. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG nova.network.neutron [req-01a0e2e3-e95a-4b14-bf61-9cbeb24a017d req-d4a7aacc-bd68-4a44-9a6d-93d4c3b95685 service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Updating instance_info_cache with network_info: [{"id": "8243f136-fe60-498f-80e1-27a598c434a3", "address": "fa:16:3e:2f:02:41", "network": {"id": "34ecf1c9-50ff-4168-8650-a5277102ccaa", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730184159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a894beccbd45af9d4486772fccb949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8243f136-fe", "ovs_interfaceid": "8243f136-fe60-498f-80e1-27a598c434a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-01a0e2e3-e95a-4b14-bf61-9cbeb24a017d req-d4a7aacc-bd68-4a44-9a6d-93d4c3b95685 service nova] Releasing lock "refresh_cache-fa011231-049f-40c3-89c0-53447a35752f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG nova.compute.manager [req-065ff361-ba26-4b33-b71a-3b53ffda859f req-6a2dbcc4-bd02-4802-8769-aa2c10b5627a service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received event network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-065ff361-ba26-4b33-b71a-3b53ffda859f req-6a2dbcc4-bd02-4802-8769-aa2c10b5627a service nova] Acquiring lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-065ff361-ba26-4b33-b71a-3b53ffda859f req-6a2dbcc4-bd02-4802-8769-aa2c10b5627a service nova] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-065ff361-ba26-4b33-b71a-3b53ffda859f req-6a2dbcc4-bd02-4802-8769-aa2c10b5627a service nova] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG nova.compute.manager [req-065ff361-ba26-4b33-b71a-3b53ffda859f req-6a2dbcc4-bd02-4802-8769-aa2c10b5627a service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] No waiting events found dispatching network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:38:51 user nova-compute[71321]: WARNING nova.compute.manager [req-065ff361-ba26-4b33-b71a-3b53ffda859f req-6a2dbcc4-bd02-4802-8769-aa2c10b5627a service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received unexpected event network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 for instance with vm_state active and task_state rescuing.
Apr 12 12:38:51 user nova-compute[71321]: DEBUG nova.compute.manager [req-065ff361-ba26-4b33-b71a-3b53ffda859f req-6a2dbcc4-bd02-4802-8769-aa2c10b5627a service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received event network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-065ff361-ba26-4b33-b71a-3b53ffda859f req-6a2dbcc4-bd02-4802-8769-aa2c10b5627a service nova] Acquiring lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-065ff361-ba26-4b33-b71a-3b53ffda859f req-6a2dbcc4-bd02-4802-8769-aa2c10b5627a service nova] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-065ff361-ba26-4b33-b71a-3b53ffda859f req-6a2dbcc4-bd02-4802-8769-aa2c10b5627a service nova] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG nova.compute.manager [req-065ff361-ba26-4b33-b71a-3b53ffda859f req-6a2dbcc4-bd02-4802-8769-aa2c10b5627a service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] No waiting events found dispatching network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:38:51 user nova-compute[71321]: WARNING nova.compute.manager [req-065ff361-ba26-4b33-b71a-3b53ffda859f req-6a2dbcc4-bd02-4802-8769-aa2c10b5627a service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received unexpected event network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 for instance with vm_state active and task_state rescuing.
Apr 12 12:38:51 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Removed pending event for 89cc5f86-c387-4966-8bbf-a64d42d30db7 due to event {{(pid=71321) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303131.7675674, 89cc5f86-c387-4966-8bbf-a64d42d30db7 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:38:51 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] VM Resumed (Lifecycle Event)
Apr 12 12:38:51 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:38:51 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 12:38:51 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303131.768784, 89cc5f86-c387-4966-8bbf-a64d42d30db7 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:38:51 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] VM Started (Lifecycle Event)
Apr 12 12:38:51 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:38:51 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:38:52 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:38:52 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23066653636626465', 'path': '/dev/sde'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:38:52 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066653636626465', 'path': '/dev/sde'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:38:52 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T12:34:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-224414802',display_name='tempest-TestShelveInstance-server-224414802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-224414802',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-568010420',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:35:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='99a894beccbd45af9d4486772fccb949',ramdisk_id='',reservation_id='r-e0ge4cua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1585323339',owner_user_name='tempest-TestShelveInstance-1585323339-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:38:45Z,user_data=None,user_id='b4b62db7ef8e4ae4bc11ff520c6afcd8',uuid=fa011231-049f-40c3-89c0-53447a35752f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8243f136-fe60-498f-80e1-27a598c434a3", "address": "fa:16:3e:2f:02:41", "network": {"id": "34ecf1c9-50ff-4168-8650-a5277102ccaa", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730184159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a894beccbd45af9d4486772fccb949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8243f136-fe", "ovs_interfaceid": "8243f136-fe60-498f-80e1-27a598c434a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:38:52 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Converting VIF {"id": "8243f136-fe60-498f-80e1-27a598c434a3", "address": "fa:16:3e:2f:02:41", "network": {"id": "34ecf1c9-50ff-4168-8650-a5277102ccaa", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730184159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a894beccbd45af9d4486772fccb949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8243f136-fe", "ovs_interfaceid": "8243f136-fe60-498f-80e1-27a598c434a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:38:52 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:02:41,bridge_name='br-int',has_traffic_filtering=True,id=8243f136-fe60-498f-80e1-27a598c434a3,network=Network(34ecf1c9-50ff-4168-8650-a5277102ccaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8243f136-fe') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:38:52 user nova-compute[71321]: DEBUG nova.objects.instance [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lazy-loading 'pci_devices' on Instance uuid fa011231-049f-40c3-89c0-53447a35752f {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:38:52 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:38:52 user nova-compute[71321]:   <uuid>fa011231-049f-40c3-89c0-53447a35752f</uuid>
Apr 12 12:38:52 user nova-compute[71321]:   <name>instance-00000016</name>
Apr 12 12:38:52 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:38:52 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:38:52 user nova-compute[71321]:   <metadata>
Apr 12 12:38:52 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:38:52 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:38:52 user nova-compute[71321]:       <nova:name>tempest-TestShelveInstance-server-224414802</nova:name>
Apr 12 12:38:52 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:38:50</nova:creationTime>
Apr 12 12:38:52 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:38:52 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:38:52 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:38:52 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:38:52 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:38:52 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:38:52 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:38:52 user nova-compute[71321]:       <nova:owner>
Apr 12 12:38:52 user nova-compute[71321]:         <nova:user uuid="b4b62db7ef8e4ae4bc11ff520c6afcd8">tempest-TestShelveInstance-1585323339-project-member</nova:user>
Apr 12 12:38:52 user nova-compute[71321]:         <nova:project uuid="99a894beccbd45af9d4486772fccb949">tempest-TestShelveInstance-1585323339</nova:project>
Apr 12 12:38:52 user nova-compute[71321]:       </nova:owner>
Apr 12 12:38:52 user nova-compute[71321]:       <nova:ports>
Apr 12 12:38:52 user nova-compute[71321]:         <nova:port uuid="8243f136-fe60-498f-80e1-27a598c434a3">
Apr 12 12:38:52 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 12:38:52 user nova-compute[71321]:         </nova:port>
Apr 12 12:38:52 user nova-compute[71321]:       </nova:ports>
Apr 12 12:38:52 user nova-compute[71321]:     </nova:instance>
Apr 12 12:38:52 user nova-compute[71321]:   </metadata>
Apr 12 12:38:52 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:38:52 user nova-compute[71321]:     <system>
Apr 12 12:38:52 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:38:52 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:38:52 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:38:52 user nova-compute[71321]:       <entry name="serial">fa011231-049f-40c3-89c0-53447a35752f</entry>
Apr 12 12:38:52 user nova-compute[71321]:       <entry name="uuid">fa011231-049f-40c3-89c0-53447a35752f</entry>
Apr 12 12:38:52 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:38:52 user nova-compute[71321]:     </system>
Apr 12 12:38:52 user nova-compute[71321]:   </sysinfo>
Apr 12 12:38:52 user nova-compute[71321]:   <os>
Apr 12 12:38:52 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:38:52 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:38:52 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:38:52 user nova-compute[71321]:   </os>
Apr 12 12:38:52 user nova-compute[71321]:   <features>
Apr 12 12:38:52 user nova-compute[71321]:     <acpi/>
Apr 12 12:38:52 user nova-compute[71321]:     <apic/>
Apr 12 12:38:52 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:38:52 user nova-compute[71321]:   </features>
Apr 12 12:38:52 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:38:52 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:38:52 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:38:52 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:38:52 user nova-compute[71321]:   </clock>
Apr 12 12:38:52 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:38:52 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:38:52 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:38:52 user nova-compute[71321]:   </cpu>
Apr 12 12:38:52 user nova-compute[71321]:   <devices>
Apr 12 12:38:52 user nova-compute[71321]:     <disk type="block" device="disk">
Apr 12 12:38:52 user nova-compute[71321]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:38:52 user nova-compute[71321]:       <source dev="/dev/sde"/>
Apr 12 12:38:52 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:38:52 user nova-compute[71321]:       <serial>5edf56f8-c348-40e5-a9e0-d0b3a7fc7945</serial>
Apr 12 12:38:52 user nova-compute[71321]:     </disk>
Apr 12 12:38:52 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:38:52 user nova-compute[71321]:       <mac address="fa:16:3e:2f:02:41"/>
Apr 12 12:38:52 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:38:52 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:38:52 user nova-compute[71321]:       <target dev="tap8243f136-fe"/>
Apr 12 12:38:52 user nova-compute[71321]:     </interface>
Apr 12 12:38:52 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:38:52 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/fa011231-049f-40c3-89c0-53447a35752f/console.log" append="off"/>
Apr 12 12:38:52 user nova-compute[71321]:     </serial>
Apr 12 12:38:52 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:38:52 user nova-compute[71321]:     <video>
Apr 12 12:38:52 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:38:52 user nova-compute[71321]:     </video>
Apr 12 12:38:52 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:38:52 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:38:52 user nova-compute[71321]:     </rng>
Apr 12 12:38:52 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:38:52 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:38:52 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:38:52 user nova-compute[71321]:     </memballoon>
Apr 12 12:38:52 user nova-compute[71321]:   </devices>
Apr 12 12:38:52 user nova-compute[71321]: </domain>
Apr 12 12:38:52 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:38:52 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T12:34:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-224414802',display_name='tempest-TestShelveInstance-server-224414802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-224414802',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-568010420',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:35:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='99a894beccbd45af9d4486772fccb949',ramdisk_id='',reservation_id='r-e0ge4cua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1585323339',owner_user_name='tempest-TestShelveInstance-1585323339-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:38:45Z,user_data=None,user_id='b4b62db7ef8e4ae4bc11ff520c6afcd8',uuid=fa011231-049f-40c3-89c0-53447a35752f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8243f136-fe60-498f-80e1-27a598c434a3", "address": "fa:16:3e:2f:02:41", "network": {"id": "34ecf1c9-50ff-4168-8650-a5277102ccaa", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730184159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a894beccbd45af9d4486772fccb949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8243f136-fe", "ovs_interfaceid": "8243f136-fe60-498f-80e1-27a598c434a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:38:52 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Converting VIF {"id": "8243f136-fe60-498f-80e1-27a598c434a3", "address": "fa:16:3e:2f:02:41", "network": {"id": "34ecf1c9-50ff-4168-8650-a5277102ccaa", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730184159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a894beccbd45af9d4486772fccb949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8243f136-fe", "ovs_interfaceid": "8243f136-fe60-498f-80e1-27a598c434a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:38:52 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:02:41,bridge_name='br-int',has_traffic_filtering=True,id=8243f136-fe60-498f-80e1-27a598c434a3,network=Network(34ecf1c9-50ff-4168-8650-a5277102ccaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8243f136-fe') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:38:52 user nova-compute[71321]: DEBUG os_vif [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:02:41,bridge_name='br-int',has_traffic_filtering=True,id=8243f136-fe60-498f-80e1-27a598c434a3,network=Network(34ecf1c9-50ff-4168-8650-a5277102ccaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8243f136-fe') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:38:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:38:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:38:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8243f136-fe, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:38:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8243f136-fe, col_values=(('external_ids', {'iface-id': '8243f136-fe60-498f-80e1-27a598c434a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:02:41', 'vm-uuid': 'fa011231-049f-40c3-89c0-53447a35752f'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:38:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:38:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:52 user nova-compute[71321]: INFO os_vif [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:02:41,bridge_name='br-int',has_traffic_filtering=True,id=8243f136-fe60-498f-80e1-27a598c434a3,network=Network(34ecf1c9-50ff-4168-8650-a5277102ccaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8243f136-fe')
Apr 12 12:38:52 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:38:52 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] No VIF found with MAC fa:16:3e:2f:02:41, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:38:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:54 user nova-compute[71321]: DEBUG nova.compute.manager [req-61460d17-0249-4cff-b708-7ef6f879af98 req-9cd456bb-f16d-46fd-9b64-82d329ceb6df service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Received event network-vif-plugged-8243f136-fe60-498f-80e1-27a598c434a3 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:38:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-61460d17-0249-4cff-b708-7ef6f879af98 req-9cd456bb-f16d-46fd-9b64-82d329ceb6df service nova] Acquiring lock "fa011231-049f-40c3-89c0-53447a35752f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:38:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-61460d17-0249-4cff-b708-7ef6f879af98 req-9cd456bb-f16d-46fd-9b64-82d329ceb6df service nova] Lock "fa011231-049f-40c3-89c0-53447a35752f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:38:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-61460d17-0249-4cff-b708-7ef6f879af98 req-9cd456bb-f16d-46fd-9b64-82d329ceb6df service nova] Lock "fa011231-049f-40c3-89c0-53447a35752f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:38:54 user nova-compute[71321]: DEBUG nova.compute.manager [req-61460d17-0249-4cff-b708-7ef6f879af98 req-9cd456bb-f16d-46fd-9b64-82d329ceb6df service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] No waiting events found dispatching network-vif-plugged-8243f136-fe60-498f-80e1-27a598c434a3 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:38:54 user nova-compute[71321]: WARNING nova.compute.manager [req-61460d17-0249-4cff-b708-7ef6f879af98 req-9cd456bb-f16d-46fd-9b64-82d329ceb6df service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Received unexpected event network-vif-plugged-8243f136-fe60-498f-80e1-27a598c434a3 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 12:38:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:56 user nova-compute[71321]: DEBUG nova.compute.manager [req-b5b4aaa2-3e3e-4059-a40e-27a8e22e2dc9 req-94b78c0e-a053-4360-ac21-e5f68b0edb2a service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Received event network-vif-plugged-8243f136-fe60-498f-80e1-27a598c434a3 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:38:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b5b4aaa2-3e3e-4059-a40e-27a8e22e2dc9 req-94b78c0e-a053-4360-ac21-e5f68b0edb2a service nova] Acquiring lock "fa011231-049f-40c3-89c0-53447a35752f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:38:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b5b4aaa2-3e3e-4059-a40e-27a8e22e2dc9 req-94b78c0e-a053-4360-ac21-e5f68b0edb2a service nova] Lock "fa011231-049f-40c3-89c0-53447a35752f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:38:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b5b4aaa2-3e3e-4059-a40e-27a8e22e2dc9 req-94b78c0e-a053-4360-ac21-e5f68b0edb2a service nova] Lock "fa011231-049f-40c3-89c0-53447a35752f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:38:56 user nova-compute[71321]: DEBUG nova.compute.manager [req-b5b4aaa2-3e3e-4059-a40e-27a8e22e2dc9 req-94b78c0e-a053-4360-ac21-e5f68b0edb2a service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] No waiting events found dispatching network-vif-plugged-8243f136-fe60-498f-80e1-27a598c434a3 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:38:56 user nova-compute[71321]: WARNING nova.compute.manager [req-b5b4aaa2-3e3e-4059-a40e-27a8e22e2dc9 req-94b78c0e-a053-4360-ac21-e5f68b0edb2a service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Received unexpected event network-vif-plugged-8243f136-fe60-498f-80e1-27a598c434a3 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 12:38:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:38:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:38:56 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303136.0808005, fa011231-049f-40c3-89c0-53447a35752f => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:38:56 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: fa011231-049f-40c3-89c0-53447a35752f] VM Resumed (Lifecycle Event)
Apr 12 12:38:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: fa011231-049f-40c3-89c0-53447a35752f] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:38:56 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: fa011231-049f-40c3-89c0-53447a35752f] Instance spawned successfully.
Apr 12 12:38:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:38:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: fa011231-049f-40c3-89c0-53447a35752f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:38:56 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: fa011231-049f-40c3-89c0-53447a35752f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:38:56 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303136.0815718, fa011231-049f-40c3-89c0-53447a35752f => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:38:56 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: fa011231-049f-40c3-89c0-53447a35752f] VM Started (Lifecycle Event)
Apr 12 12:38:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: fa011231-049f-40c3-89c0-53447a35752f] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:38:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: fa011231-049f-40c3-89c0-53447a35752f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:38:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "fa011231-049f-40c3-89c0-53447a35752f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.692s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:38:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:38:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:08 user nova-compute[71321]: DEBUG nova.network.neutron [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Port 6f21df63-1895-4500-b119-c4670a7f3569 binding to destination host user is already ACTIVE {{(pid=71321) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 12 12:39:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "refresh_cache-546c0c08-35f1-4043-ac30-56d49bc86af1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:39:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquired lock "refresh_cache-546c0c08-35f1-4043-ac30-56d49bc86af1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:39:08 user nova-compute[71321]: DEBUG nova.network.neutron [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:39:08 user nova-compute[71321]: DEBUG nova.network.neutron [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Updating instance_info_cache with network_info: [{"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:39:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Releasing lock "refresh_cache-546c0c08-35f1-4043-ac30-56d49bc86af1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:39:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Creating tmpfile /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/tmpz75rg5cs to verify with other compute node that the instance is on the same shared storage. {{(pid=71321) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9595}}
Apr 12 12:39:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:08 user nova-compute[71321]: DEBUG nova.compute.manager [req-e1a2c7e0-50fa-4e29-b492-67e34222219f req-44b1a82a-9715-4ae8-b22f-8a470046e1f7 service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received event network-vif-unplugged-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:39:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e1a2c7e0-50fa-4e29-b492-67e34222219f req-44b1a82a-9715-4ae8-b22f-8a470046e1f7 service nova] Acquiring lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:39:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e1a2c7e0-50fa-4e29-b492-67e34222219f req-44b1a82a-9715-4ae8-b22f-8a470046e1f7 service nova] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:39:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e1a2c7e0-50fa-4e29-b492-67e34222219f req-44b1a82a-9715-4ae8-b22f-8a470046e1f7 service nova] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:39:08 user nova-compute[71321]: DEBUG nova.compute.manager [req-e1a2c7e0-50fa-4e29-b492-67e34222219f req-44b1a82a-9715-4ae8-b22f-8a470046e1f7 service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] No waiting events found dispatching network-vif-unplugged-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:39:08 user nova-compute[71321]: WARNING nova.compute.manager [req-e1a2c7e0-50fa-4e29-b492-67e34222219f req-44b1a82a-9715-4ae8-b22f-8a470046e1f7 service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received unexpected event network-vif-unplugged-6f21df63-1895-4500-b119-c4670a7f3569 for instance with vm_state resized and task_state resize_reverting.
Apr 12 12:39:09 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71321) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 12:39:09 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Instance destroyed successfully.
Apr 12 12:39:09 user nova-compute[71321]: DEBUG nova.objects.instance [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lazy-loading 'resources' on Instance uuid 546c0c08-35f1-4043-ac30-56d49bc86af1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T12:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1139912608',display_name='tempest-ServerActionsTestJSON-server-548854806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1139912608',id=4,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9e64miZ/iyVASS4OS8AZthMPT8KBHm0byN/8NFP7U1AgI9/hOw/R+BSPozX14usgKt+VEqTE1BPs7aRGcfyuCZ/K0LBkD7enTbPYgw3NHHlO3PWScCWY1ae7IFb2uJEw==',key_name='tempest-keypair-1245622558',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:37:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ba5375005114c8594e0ae86b2f19093',ramdisk_id='',reservation_id='r-kvv9k7th',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1233797030',owner_user_name='tempest-ServerActionsTestJSON-1233797030-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:37:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29f7f46d32f4465ba3e8b504c645c22f',uuid=546c0c08-35f1-4043-ac30-56d49bc86af1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converting VIF {"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f21df63-1895-4500-b119-c4670a7f3569,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21df63-18') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG os_vif [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f21df63-1895-4500-b119-c4670a7f3569,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21df63-18') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f21df63-18, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:09 user nova-compute[71321]: INFO os_vif [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f21df63-1895-4500-b119-c4670a7f3569,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21df63-18')
Apr 12 12:39:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TonhIRZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:39:09 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:39:09 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b509f25-a7b9-498a-b969-18a838d7fea3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:39:09 user nova-compute[71321]: No targets found.
Apr 12 12:39:09 user nova-compute[71321]: iSNS:
Apr 12 12:39:09 user nova-compute[71321]: No targets found.
Apr 12 12:39:09 user nova-compute[71321]: STATIC:
Apr 12 12:39:09 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945
Apr 12 12:39:09 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:39:09 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:39:09 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f
Apr 12 12:39:09 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:39:09 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:39:09 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5
Apr 12 12:39:09 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:39:09 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:39:09 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b
Apr 12 12:39:09 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:39:09 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:39:09 user nova-compute[71321]: FIRMWARE:
Apr 12 12:39:09 user nova-compute[71321]: No targets found.
Apr 12 12:39:09 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:39:09 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:39:09 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c5e53d-2cbb-41c0-bf3a-e06e602787a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a227e3fc-8b26-4601-81c3-6930e34994ab]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)
Apr 12 12:39:09 user nova-compute[71321]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:39:09 user nova-compute[71321]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)
Apr 12 12:39:09 user nova-compute[71321]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:39:09 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)
Apr 12 12:39:09 user nova-compute[71321]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:39:09 user nova-compute[71321]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)
Apr 12 12:39:09 user nova-compute[71321]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:39:09 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef44265bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f'): ({'sdc'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Removing single pathed devices sdc {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1520f99-2d67-430c-ae13-1a0728a460aa]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7d15b6-8cd6-49ed-9e7f-4b2f541013d1]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Flushing IO for device /dev/sdc {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fc6da7-3335-47d9-8f2e-4b2268831afa]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10c9d3f-d9c5-4c2a-a662-bef0c3b4e172]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] SCSI volumes sdc have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6482ba-f2af-4aac-b0f7-8980b919f7a3]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa141aa-2e16-4ec2-82cb-90052f453405]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f, portal: 172.16.0.220,3260]
Apr 12 12:39:09 user nova-compute[71321]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f, portal: 172.16.0.220,3260] successful.
Apr 12 12:39:09 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a31090-ce31-45a9-a5d9-6d5d2b537dc6]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] <== disconnect_volume: return (335ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:39:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:39:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-67d0b5aa-5a86-46ac-85b0-410bc10176aa tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "9439468d-7a45-443b-87ce-106907761a56" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:39:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-67d0b5aa-5a86-46ac-85b0-410bc10176aa tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "9439468d-7a45-443b-87ce-106907761a56" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:39:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-67d0b5aa-5a86-46ac-85b0-410bc10176aa tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "9439468d-7a45-443b-87ce-106907761a56-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:39:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-67d0b5aa-5a86-46ac-85b0-410bc10176aa tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "9439468d-7a45-443b-87ce-106907761a56-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:39:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-67d0b5aa-5a86-46ac-85b0-410bc10176aa tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "9439468d-7a45-443b-87ce-106907761a56-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:39:10 user nova-compute[71321]: INFO nova.compute.manager [None req-67d0b5aa-5a86-46ac-85b0-410bc10176aa tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Terminating instance
Apr 12 12:39:10 user nova-compute[71321]: DEBUG nova.compute.manager [None req-67d0b5aa-5a86-46ac-85b0-410bc10176aa tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:39:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:39:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:39:10 user nova-compute[71321]: DEBUG nova.objects.instance [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lazy-loading 'migration_context' on Instance uuid 546c0c08-35f1-4043-ac30-56d49bc86af1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:39:10 user nova-compute[71321]: DEBUG nova.compute.manager [req-714a3eb7-263f-4495-a1f8-f9add6f06eeb req-daee5de1-a089-496d-839c-338e4a9a465e service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received event network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:39:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-714a3eb7-263f-4495-a1f8-f9add6f06eeb req-daee5de1-a089-496d-839c-338e4a9a465e service nova] Acquiring lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:39:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-714a3eb7-263f-4495-a1f8-f9add6f06eeb req-daee5de1-a089-496d-839c-338e4a9a465e service nova] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:39:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-714a3eb7-263f-4495-a1f8-f9add6f06eeb req-daee5de1-a089-496d-839c-338e4a9a465e service nova] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:39:10 user nova-compute[71321]: DEBUG nova.compute.manager [req-714a3eb7-263f-4495-a1f8-f9add6f06eeb req-daee5de1-a089-496d-839c-338e4a9a465e service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] No waiting events found dispatching network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:39:10 user nova-compute[71321]: WARNING nova.compute.manager [req-714a3eb7-263f-4495-a1f8-f9add6f06eeb req-daee5de1-a089-496d-839c-338e4a9a465e service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received unexpected event network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 for instance with vm_state resized and task_state resize_reverting.
Apr 12 12:39:10 user nova-compute[71321]: DEBUG nova.compute.manager [req-714a3eb7-263f-4495-a1f8-f9add6f06eeb req-daee5de1-a089-496d-839c-338e4a9a465e service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Received event network-vif-unplugged-67b56c74-fc25-4bc8-875e-8a134830124b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:39:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-714a3eb7-263f-4495-a1f8-f9add6f06eeb req-daee5de1-a089-496d-839c-338e4a9a465e service nova] Acquiring lock "9439468d-7a45-443b-87ce-106907761a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:39:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-714a3eb7-263f-4495-a1f8-f9add6f06eeb req-daee5de1-a089-496d-839c-338e4a9a465e service nova] Lock "9439468d-7a45-443b-87ce-106907761a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:39:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-714a3eb7-263f-4495-a1f8-f9add6f06eeb req-daee5de1-a089-496d-839c-338e4a9a465e service nova] Lock "9439468d-7a45-443b-87ce-106907761a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:39:10 user nova-compute[71321]: DEBUG nova.compute.manager [req-714a3eb7-263f-4495-a1f8-f9add6f06eeb req-daee5de1-a089-496d-839c-338e4a9a465e service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] No waiting events found dispatching network-vif-unplugged-67b56c74-fc25-4bc8-875e-8a134830124b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:39:10 user nova-compute[71321]: DEBUG nova.compute.manager [req-714a3eb7-263f-4495-a1f8-f9add6f06eeb req-daee5de1-a089-496d-839c-338e4a9a465e service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Received event network-vif-unplugged-67b56c74-fc25-4bc8-875e-8a134830124b for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:39:10 user nova-compute[71321]: DEBUG nova.compute.manager [req-714a3eb7-263f-4495-a1f8-f9add6f06eeb req-daee5de1-a089-496d-839c-338e4a9a465e service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Received event network-vif-plugged-67b56c74-fc25-4bc8-875e-8a134830124b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:39:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-714a3eb7-263f-4495-a1f8-f9add6f06eeb req-daee5de1-a089-496d-839c-338e4a9a465e service nova] Acquiring lock "9439468d-7a45-443b-87ce-106907761a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:39:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-714a3eb7-263f-4495-a1f8-f9add6f06eeb req-daee5de1-a089-496d-839c-338e4a9a465e service nova] Lock "9439468d-7a45-443b-87ce-106907761a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:39:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-714a3eb7-263f-4495-a1f8-f9add6f06eeb req-daee5de1-a089-496d-839c-338e4a9a465e service nova] Lock "9439468d-7a45-443b-87ce-106907761a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:39:10 user nova-compute[71321]: DEBUG nova.compute.manager [req-714a3eb7-263f-4495-a1f8-f9add6f06eeb req-daee5de1-a089-496d-839c-338e4a9a465e service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] No waiting events found dispatching network-vif-plugged-67b56c74-fc25-4bc8-875e-8a134830124b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:39:10 user nova-compute[71321]: WARNING nova.compute.manager [req-714a3eb7-263f-4495-a1f8-f9add6f06eeb req-daee5de1-a089-496d-839c-338e4a9a465e service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Received unexpected event network-vif-plugged-67b56c74-fc25-4bc8-875e-8a134830124b for instance with vm_state active and task_state deleting.
Apr 12 12:39:11 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 9439468d-7a45-443b-87ce-106907761a56] Instance destroyed successfully.
Apr 12 12:39:11 user nova-compute[71321]: DEBUG nova.objects.instance [None req-67d0b5aa-5a86-46ac-85b0-410bc10176aa tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lazy-loading 'resources' on Instance uuid 9439468d-7a45-443b-87ce-106907761a56 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:39:11 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-67d0b5aa-5a86-46ac-85b0-410bc10176aa tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T12:32:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-806455308',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-806455308',id=16,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1ZrjP9KAJCgyaL5zcIDkfonF0SjjghGFN4rxSk+Gs/fi7zbEzghBorK6ScclR6/kTKn5pVT08v7lhEUGdgEMCcBQsph3fKqP0aQS3e3cPR0dYvUMVDLU1ho++DwuWEcA==',key_name='tempest-keypair-250399543',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:36:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fec0c6dc7ab46b0b6b0a580252f40e3',ramdisk_id='',reservation_id='r-d9g2es3z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2036744628',owner_user_name='tempest-AttachVolumeShelveTestJSON-2036744628-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:36:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e4935eed324b868477f8e88918364a',uuid=9439468d-7a45-443b-87ce-106907761a56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67b56c74-fc25-4bc8-875e-8a134830124b", "address": "fa:16:3e:14:ba:2c", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b56c74-fc", "ovs_interfaceid": "67b56c74-fc25-4bc8-875e-8a134830124b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:39:11 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-67d0b5aa-5a86-46ac-85b0-410bc10176aa tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Converting VIF {"id": "67b56c74-fc25-4bc8-875e-8a134830124b", "address": "fa:16:3e:14:ba:2c", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b56c74-fc", "ovs_interfaceid": "67b56c74-fc25-4bc8-875e-8a134830124b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:39:11 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-67d0b5aa-5a86-46ac-85b0-410bc10176aa tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:ba:2c,bridge_name='br-int',has_traffic_filtering=True,id=67b56c74-fc25-4bc8-875e-8a134830124b,network=Network(4ba97279-e122-4c2b-b931-dde33e1d71df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b56c74-fc') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:39:11 user nova-compute[71321]: DEBUG os_vif [None req-67d0b5aa-5a86-46ac-85b0-410bc10176aa tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:ba:2c,bridge_name='br-int',has_traffic_filtering=True,id=67b56c74-fc25-4bc8-875e-8a134830124b,network=Network(4ba97279-e122-4c2b-b931-dde33e1d71df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b56c74-fc') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:39:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67b56c74-fc, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:39:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:39:11 user nova-compute[71321]: INFO os_vif [None req-67d0b5aa-5a86-46ac-85b0-410bc10176aa tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:ba:2c,bridge_name='br-int',has_traffic_filtering=True,id=67b56c74-fc25-4bc8-875e-8a134830124b,network=Network(4ba97279-e122-4c2b-b931-dde33e1d71df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b56c74-fc')
Apr 12 12:39:11 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-67d0b5aa-5a86-46ac-85b0-410bc10176aa tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Deleting instance files /opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56_del
Apr 12 12:39:11 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-67d0b5aa-5a86-46ac-85b0-410bc10176aa tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Deletion of /opt/stack/data/nova/instances/9439468d-7a45-443b-87ce-106907761a56_del complete
Apr 12 12:39:11 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:39:11 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:39:11 user nova-compute[71321]: INFO nova.compute.manager [None req-67d0b5aa-5a86-46ac-85b0-410bc10176aa tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 12 12:39:11 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-67d0b5aa-5a86-46ac-85b0-410bc10176aa tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:39:11 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: 9439468d-7a45-443b-87ce-106907761a56] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:39:11 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 9439468d-7a45-443b-87ce-106907761a56] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:39:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.397s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:39:11 user nova-compute[71321]: INFO nova.compute.manager [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Swapping old allocation on dict_keys(['7ca624fd-d5cc-42af-93e3-9d62256fa231']) held by migration 13fdba50-49cb-4806-a103-10b8c219a3de for instance
Apr 12 12:39:11 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Overwriting current allocation {'allocations': {'7ca624fd-d5cc-42af-93e3-9d62256fa231': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 31}}, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'consumer_generation': 1} on consumer 546c0c08-35f1-4043-ac30-56d49bc86af1 {{(pid=71321) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Apr 12 12:39:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "refresh_cache-546c0c08-35f1-4043-ac30-56d49bc86af1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:39:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquired lock "refresh_cache-546c0c08-35f1-4043-ac30-56d49bc86af1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:39:11 user nova-compute[71321]: DEBUG nova.network.neutron [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:39:12 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 9439468d-7a45-443b-87ce-106907761a56] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:39:12 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 9439468d-7a45-443b-87ce-106907761a56] Took 1.05 seconds to deallocate network for instance.
Apr 12 12:39:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-67d0b5aa-5a86-46ac-85b0-410bc10176aa tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:39:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-67d0b5aa-5a86-46ac-85b0-410bc10176aa tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:39:12 user nova-compute[71321]: DEBUG nova.network.neutron [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Updating instance_info_cache with network_info: [{"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:39:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Releasing lock "refresh_cache-546c0c08-35f1-4043-ac30-56d49bc86af1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:39:12 user nova-compute[71321]: DEBUG os_brick.utils [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:39:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:12 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab8fbef-a1c5-4070-afed-1283ba5907b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:12 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cda92de-c22d-4473-9121-c62b5b94a4af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:12 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[310dad5f-f294-42e1-a676-39357b2e3f56]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:12 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d5fa0e-4888-4b66-a0f9-36160e59b949]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:39:12 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:39:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:39:12 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:39:12 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[98040885-bb07-4bbe-b14f-a37c543ccf0f]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:12 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:39:12 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:39:12 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:39:12 user nova-compute[71321]: DEBUG os_brick.utils [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:39:12 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-67d0b5aa-5a86-46ac-85b0-410bc10176aa tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:39:12 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-67d0b5aa-5a86-46ac-85b0-410bc10176aa tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:39:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-67d0b5aa-5a86-46ac-85b0-410bc10176aa tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.643s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:39:12 user nova-compute[71321]: DEBUG nova.compute.manager [req-f19fe4f6-ecec-4e03-b998-c1c29217ac5e req-46633f5e-c824-4732-9f39-47bd2304bedc service nova] [instance: 9439468d-7a45-443b-87ce-106907761a56] Received event network-vif-deleted-67b56c74-fc25-4bc8-875e-8a134830124b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:39:12 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-67d0b5aa-5a86-46ac-85b0-410bc10176aa tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Deleted allocations for instance 9439468d-7a45-443b-87ce-106907761a56
Apr 12 12:39:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-67d0b5aa-5a86-46ac-85b0-410bc10176aa tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "9439468d-7a45-443b-87ce-106907761a56" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.785s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:39:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Starting finish_revert_migration {{(pid=71321) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11792}}
Apr 12 12:39:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Start _get_guest_xml network_info=[{"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2f37caef-7703-4b42-9349-f2dd0f2df733', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TonhIRZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '546c0c08-35f1-4043-ac30-56d49bc86af1', 'attached_at': '2023-04-12T12:39:17.000000', 'detached_at': '', 'volume_id': '285a2e71-c724-427a-94a8-d0f646e9083f', 'serial': '285a2e71-c724-427a-94a8-d0f646e9083f'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:39:16 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:39:16 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:39:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:39:16 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:39:16 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:39:16 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:39:16 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:39:16 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:39:16 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:39:16 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:39:16 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:39:16 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:39:16 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:39:16 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:39:16 user nova-compute[71321]: DEBUG nova.objects.instance [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lazy-loading 'vcpu_model' on Instance uuid 546c0c08-35f1-4043-ac30-56d49bc86af1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TonhIRZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:39:17 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:39:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:39:17 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:39:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:39:17 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2672b9e-55d0-4f8d-8e76-426ac1cb7104]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:39:17 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9420e32-c32d-44a1-9b86-d7313e66c704]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f] added
Apr 12 12:39:17 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbfd289-6c4a-404e-8dfc-1b4277f1c587]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ebb3c4-fc92-47ba-aec8-f96823229af5]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TonhIRZC {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TonhIRZC" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dd14d2-d0ae-4736-90c7-1a6178a52f42]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TonhIRZC'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a5497c-f7fd-4fd0-902b-b81fc5663e9b]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ce864d-0aaf-4099-9258-3d9db02e6254]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:39:17 user nova-compute[71321]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)
Apr 12 12:39:17 user nova-compute[71321]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:39:17 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:39:17 user nova-compute[71321]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)
Apr 12 12:39:17 user nova-compute[71321]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:39:17 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3aca89-14a1-4af1-b5ab-a0aac764329c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f, portal: 172.16.0.220,3260]
Apr 12 12:39:17 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f, portal: 172.16.0.220,3260] successful.
Apr 12 12:39:17 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb3cd40-1fc9-4159-a70e-16df10a0947f]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23eae93-728d-4d8c-b4e6-da03042199c2]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:39:17 user nova-compute[71321]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)
Apr 12 12:39:17 user nova-compute[71321]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:39:17 user nova-compute[71321]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)
Apr 12 12:39:17 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:39:17 user nova-compute[71321]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)
Apr 12 12:39:17 user nova-compute[71321]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:39:17 user nova-compute[71321]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)
Apr 12 12:39:17 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c227ba-a997-4f31-9956-4796cac24c77]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: None {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:39:17 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:39:18 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:39:18 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TonhIRZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:39:18 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:39:18 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23962363634316665', 'path': '/dev/sdc'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:39:18 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962363634316665', 'path': '/dev/sdc'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:39:18 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T12:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1139912608',display_name='tempest-ServerActionsTestJSON-server-548854806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1139912608',id=4,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9e64miZ/iyVASS4OS8AZthMPT8KBHm0byN/8NFP7U1AgI9/hOw/R+BSPozX14usgKt+VEqTE1BPs7aRGcfyuCZ/K0LBkD7enTbPYgw3NHHlO3PWScCWY1ae7IFb2uJEw==',key_name='tempest-keypair-1245622558',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:37:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7ba5375005114c8594e0ae86b2f19093',ramdisk_id='',reservation_id='r-kvv9k7th',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1233797030',owner_user_name='tempest-ServerActionsTestJSON-1233797030-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:39:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29f7f46d32f4465ba3e8b504c645c22f',uuid=546c0c08-35f1-4043-ac30-56d49bc86af1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:39:18 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converting VIF {"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:39:18 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f21df63-1895-4500-b119-c4670a7f3569,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21df63-18') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:39:18 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:39:18 user nova-compute[71321]:   <uuid>546c0c08-35f1-4043-ac30-56d49bc86af1</uuid>
Apr 12 12:39:18 user nova-compute[71321]:   <name>instance-00000004</name>
Apr 12 12:39:18 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:39:18 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:39:18 user nova-compute[71321]:   <metadata>
Apr 12 12:39:18 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:39:18 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:39:18 user nova-compute[71321]:       <nova:name>tempest-ServerActionsTestJSON-server-548854806</nova:name>
Apr 12 12:39:18 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:39:16</nova:creationTime>
Apr 12 12:39:18 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:39:18 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:39:18 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:39:18 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:39:18 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:39:18 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:39:18 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:39:18 user nova-compute[71321]:       <nova:owner>
Apr 12 12:39:18 user nova-compute[71321]:         <nova:user uuid="29f7f46d32f4465ba3e8b504c645c22f">tempest-ServerActionsTestJSON-1233797030-project-member</nova:user>
Apr 12 12:39:18 user nova-compute[71321]:         <nova:project uuid="7ba5375005114c8594e0ae86b2f19093">tempest-ServerActionsTestJSON-1233797030</nova:project>
Apr 12 12:39:18 user nova-compute[71321]:       </nova:owner>
Apr 12 12:39:18 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:39:18 user nova-compute[71321]:       <nova:ports>
Apr 12 12:39:18 user nova-compute[71321]:         <nova:port uuid="6f21df63-1895-4500-b119-c4670a7f3569">
Apr 12 12:39:18 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 12:39:18 user nova-compute[71321]:         </nova:port>
Apr 12 12:39:18 user nova-compute[71321]:       </nova:ports>
Apr 12 12:39:18 user nova-compute[71321]:     </nova:instance>
Apr 12 12:39:18 user nova-compute[71321]:   </metadata>
Apr 12 12:39:18 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:39:18 user nova-compute[71321]:     <system>
Apr 12 12:39:18 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:39:18 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:39:18 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:39:18 user nova-compute[71321]:       <entry name="serial">546c0c08-35f1-4043-ac30-56d49bc86af1</entry>
Apr 12 12:39:18 user nova-compute[71321]:       <entry name="uuid">546c0c08-35f1-4043-ac30-56d49bc86af1</entry>
Apr 12 12:39:18 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:39:18 user nova-compute[71321]:     </system>
Apr 12 12:39:18 user nova-compute[71321]:   </sysinfo>
Apr 12 12:39:18 user nova-compute[71321]:   <os>
Apr 12 12:39:18 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:39:18 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:39:18 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:39:18 user nova-compute[71321]:   </os>
Apr 12 12:39:18 user nova-compute[71321]:   <features>
Apr 12 12:39:18 user nova-compute[71321]:     <acpi/>
Apr 12 12:39:18 user nova-compute[71321]:     <apic/>
Apr 12 12:39:18 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:39:18 user nova-compute[71321]:   </features>
Apr 12 12:39:18 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:39:18 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:39:18 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:39:18 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:39:18 user nova-compute[71321]:   </clock>
Apr 12 12:39:18 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:39:18 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:39:18 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:39:18 user nova-compute[71321]:   </cpu>
Apr 12 12:39:18 user nova-compute[71321]:   <devices>
Apr 12 12:39:18 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:39:18 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:39:18 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk"/>
Apr 12 12:39:18 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:39:18 user nova-compute[71321]:     </disk>
Apr 12 12:39:18 user nova-compute[71321]:     <disk type="block" device="disk">
Apr 12 12:39:18 user nova-compute[71321]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:39:18 user nova-compute[71321]:       <source dev="/dev/sdc"/>
Apr 12 12:39:18 user nova-compute[71321]:       <target dev="vdb" bus="virtio"/>
Apr 12 12:39:18 user nova-compute[71321]:       <serial>285a2e71-c724-427a-94a8-d0f646e9083f</serial>
Apr 12 12:39:18 user nova-compute[71321]:     </disk>
Apr 12 12:39:18 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:39:18 user nova-compute[71321]:       <mac address="fa:16:3e:14:16:c4"/>
Apr 12 12:39:18 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:39:18 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:39:18 user nova-compute[71321]:       <target dev="tap6f21df63-18"/>
Apr 12 12:39:18 user nova-compute[71321]:     </interface>
Apr 12 12:39:18 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:39:18 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/console.log" append="off"/>
Apr 12 12:39:18 user nova-compute[71321]:     </serial>
Apr 12 12:39:18 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:39:18 user nova-compute[71321]:     <video>
Apr 12 12:39:18 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:39:18 user nova-compute[71321]:     </video>
Apr 12 12:39:18 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:39:18 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:39:18 user nova-compute[71321]:     </rng>
Apr 12 12:39:18 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:39:18 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:39:18 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:39:18 user nova-compute[71321]:     </memballoon>
Apr 12 12:39:18 user nova-compute[71321]:   </devices>
Apr 12 12:39:18 user nova-compute[71321]: </domain>
Apr 12 12:39:18 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:39:18 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T12:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1139912608',display_name='tempest-ServerActionsTestJSON-server-548854806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1139912608',id=4,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9e64miZ/iyVASS4OS8AZthMPT8KBHm0byN/8NFP7U1AgI9/hOw/R+BSPozX14usgKt+VEqTE1BPs7aRGcfyuCZ/K0LBkD7enTbPYgw3NHHlO3PWScCWY1ae7IFb2uJEw==',key_name='tempest-keypair-1245622558',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:37:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7ba5375005114c8594e0ae86b2f19093',ramdisk_id='',reservation_id='r-kvv9k7th',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1233797030',owner_user_name='tempest-ServerActionsTestJSON-1233797030-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:39:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29f7f46d32f4465ba3e8b504c645c22f',uuid=546c0c08-35f1-4043-ac30-56d49bc86af1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:39:18 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converting VIF {"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:39:18 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f21df63-1895-4500-b119-c4670a7f3569,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21df63-18') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:39:18 user nova-compute[71321]: DEBUG os_vif [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f21df63-1895-4500-b119-c4670a7f3569,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21df63-18') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:39:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:39:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:39:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f21df63-18, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:39:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6f21df63-18, col_values=(('external_ids', {'iface-id': '6f21df63-1895-4500-b119-c4670a7f3569', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:16:c4', 'vm-uuid': '546c0c08-35f1-4043-ac30-56d49bc86af1'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:39:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:39:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:18 user nova-compute[71321]: INFO os_vif [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f21df63-1895-4500-b119-c4670a7f3569,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21df63-18')
Apr 12 12:39:19 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:39:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:39:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:39:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:39:19 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:39:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:19 user nova-compute[71321]: DEBUG nova.compute.manager [req-99b03eb1-fbd6-4c4a-a215-95f4cb6f0a75 req-6acf79af-9eeb-4bb2-b61b-48b16dcded15 service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received event network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:39:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-99b03eb1-fbd6-4c4a-a215-95f4cb6f0a75 req-6acf79af-9eeb-4bb2-b61b-48b16dcded15 service nova] Acquiring lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:39:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-99b03eb1-fbd6-4c4a-a215-95f4cb6f0a75 req-6acf79af-9eeb-4bb2-b61b-48b16dcded15 service nova] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:39:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-99b03eb1-fbd6-4c4a-a215-95f4cb6f0a75 req-6acf79af-9eeb-4bb2-b61b-48b16dcded15 service nova] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:39:19 user nova-compute[71321]: DEBUG nova.compute.manager [req-99b03eb1-fbd6-4c4a-a215-95f4cb6f0a75 req-6acf79af-9eeb-4bb2-b61b-48b16dcded15 service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] No waiting events found dispatching network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:39:19 user nova-compute[71321]: WARNING nova.compute.manager [req-99b03eb1-fbd6-4c4a-a215-95f4cb6f0a75 req-6acf79af-9eeb-4bb2-b61b-48b16dcded15 service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received unexpected event network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 for instance with vm_state resized and task_state resize_reverting.
Apr 12 12:39:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk (vdb) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:39:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:21 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:39:21 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:39:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:21 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:39:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:22 user nova-compute[71321]: DEBUG nova.compute.manager [req-323c5836-5061-4dc5-8ddf-fc1a1a49ce36 req-adec483c-367f-49ad-b6f6-35ce277330a8 service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received event network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:39:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-323c5836-5061-4dc5-8ddf-fc1a1a49ce36 req-adec483c-367f-49ad-b6f6-35ce277330a8 service nova] Acquiring lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:39:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-323c5836-5061-4dc5-8ddf-fc1a1a49ce36 req-adec483c-367f-49ad-b6f6-35ce277330a8 service nova] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:39:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-323c5836-5061-4dc5-8ddf-fc1a1a49ce36 req-adec483c-367f-49ad-b6f6-35ce277330a8 service nova] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:39:22 user nova-compute[71321]: DEBUG nova.compute.manager [req-323c5836-5061-4dc5-8ddf-fc1a1a49ce36 req-adec483c-367f-49ad-b6f6-35ce277330a8 service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] No waiting events found dispatching network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:39:22 user nova-compute[71321]: WARNING nova.compute.manager [req-323c5836-5061-4dc5-8ddf-fc1a1a49ce36 req-adec483c-367f-49ad-b6f6-35ce277330a8 service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received unexpected event network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 for instance with vm_state resized and task_state resize_reverting.
Apr 12 12:39:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:22 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Removed pending event for 546c0c08-35f1-4043-ac30-56d49bc86af1 due to event {{(pid=71321) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 12:39:22 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303162.1092563, 546c0c08-35f1-4043-ac30-56d49bc86af1 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:39:22 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] VM Resumed (Lifecycle Event)
Apr 12 12:39:22 user nova-compute[71321]: DEBUG nova.compute.manager [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:39:22 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Instance running successfully.
Apr 12 12:39:22 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] finish_revert_migration finished successfully. {{(pid=71321) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11836}}
Apr 12 12:39:22 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:39:22 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:39:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:22 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 12 12:39:22 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303162.117196, 546c0c08-35f1-4043-ac30-56d49bc86af1 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:39:22 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] VM Started (Lifecycle Event)
Apr 12 12:39:22 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:39:22 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:39:22 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:39:22 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=7952MB free_disk=26.448627471923828GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:39:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:39:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:39:22 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:39:22 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 12 12:39:22 user nova-compute[71321]: INFO nova.compute.manager [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Updating instance to original state: 'active'
Apr 12 12:39:22 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 10116da0-785c-41cf-96bb-95721af863db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:39:22 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance a4107f2d-88e4-4846-9ece-cb16ad7ecd02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:39:22 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 8403a098-a141-4feb-9eed-3731e2c7c152 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:39:22 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:39:22 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:39:22 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 68378ff4-9b1d-4fa5-9b83-8f6c27541c63 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:39:22 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance fa011231-049f-40c3-89c0-53447a35752f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:39:22 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:39:22 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:39:22 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:39:23 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:39:23 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:39:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.363s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:39:23 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:39:23 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Cleaning up deleted instances {{(pid=71321) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 12:39:23 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] There are 0 instances to clean {{(pid=71321) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 12:39:23 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:26 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:39:26 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:39:26 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:39:26 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681303151.0667696, 9439468d-7a45-443b-87ce-106907761a56 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:39:26 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 9439468d-7a45-443b-87ce-106907761a56] VM Stopped (Lifecycle Event)
Apr 12 12:39:26 user nova-compute[71321]: DEBUG nova.compute.manager [None req-918294ef-c18d-4857-bd97-16b229c7365e None None] [instance: 9439468d-7a45-443b-87ce-106907761a56] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:39:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-8403a098-a141-4feb-9eed-3731e2c7c152" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:39:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-8403a098-a141-4feb-9eed-3731e2c7c152" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:39:26 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 12:39:26 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Updating instance_info_cache with network_info: [{"id": "12dd9e3e-1713-4f14-8893-3084e8140f87", "address": "fa:16:3e:4c:01:43", "network": {"id": "963759e8-808d-494c-9dea-0efa9f78804a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-684057570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ab04e4f968f4c07af43f3fe6651713a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12dd9e3e-17", "ovs_interfaceid": "12dd9e3e-1713-4f14-8893-3084e8140f87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:39:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-8403a098-a141-4feb-9eed-3731e2c7c152" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:39:26 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 12:39:26 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:39:26 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:39:26 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:39:26 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:39:26 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:39:28 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:28 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:39:29 user nova-compute[71321]: DEBUG nova.compute.manager [req-29b891a8-14c6-4025-b617-45e15348c6c3 req-733d94bd-770b-45c1-a46d-4939f4be7158 service nova] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Received event network-changed-de8600c4-82e7-466e-88fc-6d625c2c0898 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:39:29 user nova-compute[71321]: DEBUG nova.compute.manager [req-29b891a8-14c6-4025-b617-45e15348c6c3 req-733d94bd-770b-45c1-a46d-4939f4be7158 service nova] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Refreshing instance network info cache due to event network-changed-de8600c4-82e7-466e-88fc-6d625c2c0898. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:39:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-29b891a8-14c6-4025-b617-45e15348c6c3 req-733d94bd-770b-45c1-a46d-4939f4be7158 service nova] Acquiring lock "refresh_cache-68378ff4-9b1d-4fa5-9b83-8f6c27541c63" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:39:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-29b891a8-14c6-4025-b617-45e15348c6c3 req-733d94bd-770b-45c1-a46d-4939f4be7158 service nova] Acquired lock "refresh_cache-68378ff4-9b1d-4fa5-9b83-8f6c27541c63" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:39:29 user nova-compute[71321]: DEBUG nova.network.neutron [req-29b891a8-14c6-4025-b617-45e15348c6c3 req-733d94bd-770b-45c1-a46d-4939f4be7158 service nova] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Refreshing network info cache for port de8600c4-82e7-466e-88fc-6d625c2c0898 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:39:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "68378ff4-9b1d-4fa5-9b83-8f6c27541c63" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:39:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "68378ff4-9b1d-4fa5-9b83-8f6c27541c63" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:39:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "68378ff4-9b1d-4fa5-9b83-8f6c27541c63-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:39:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "68378ff4-9b1d-4fa5-9b83-8f6c27541c63-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:39:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "68378ff4-9b1d-4fa5-9b83-8f6c27541c63-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:39:29 user nova-compute[71321]: INFO nova.compute.manager [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Terminating instance
Apr 12 12:39:29 user nova-compute[71321]: DEBUG nova.compute.manager [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:39:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:29 user nova-compute[71321]: DEBUG nova.network.neutron [req-29b891a8-14c6-4025-b617-45e15348c6c3 req-733d94bd-770b-45c1-a46d-4939f4be7158 service nova] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Updated VIF entry in instance network info cache for port de8600c4-82e7-466e-88fc-6d625c2c0898. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:39:29 user nova-compute[71321]: DEBUG nova.network.neutron [req-29b891a8-14c6-4025-b617-45e15348c6c3 req-733d94bd-770b-45c1-a46d-4939f4be7158 service nova] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Updating instance_info_cache with network_info: [{"id": "de8600c4-82e7-466e-88fc-6d625c2c0898", "address": "fa:16:3e:6e:fb:93", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde8600c4-82", "ovs_interfaceid": "de8600c4-82e7-466e-88fc-6d625c2c0898", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-29b891a8-14c6-4025-b617-45e15348c6c3 req-733d94bd-770b-45c1-a46d-4939f4be7158 service nova] Releasing lock "refresh_cache-68378ff4-9b1d-4fa5-9b83-8f6c27541c63" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG nova.compute.manager [req-10b98e46-1e04-4182-8294-94e44b55abb7 req-2a08372b-5d62-4dce-bd97-783e13ff49e9 service nova] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Received event network-vif-unplugged-de8600c4-82e7-466e-88fc-6d625c2c0898 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-10b98e46-1e04-4182-8294-94e44b55abb7 req-2a08372b-5d62-4dce-bd97-783e13ff49e9 service nova] Acquiring lock "68378ff4-9b1d-4fa5-9b83-8f6c27541c63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-10b98e46-1e04-4182-8294-94e44b55abb7 req-2a08372b-5d62-4dce-bd97-783e13ff49e9 service nova] Lock "68378ff4-9b1d-4fa5-9b83-8f6c27541c63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-10b98e46-1e04-4182-8294-94e44b55abb7 req-2a08372b-5d62-4dce-bd97-783e13ff49e9 service nova] Lock "68378ff4-9b1d-4fa5-9b83-8f6c27541c63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG nova.compute.manager [req-10b98e46-1e04-4182-8294-94e44b55abb7 req-2a08372b-5d62-4dce-bd97-783e13ff49e9 service nova] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] No waiting events found dispatching network-vif-unplugged-de8600c4-82e7-466e-88fc-6d625c2c0898 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG nova.compute.manager [req-10b98e46-1e04-4182-8294-94e44b55abb7 req-2a08372b-5d62-4dce-bd97-783e13ff49e9 service nova] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Received event network-vif-unplugged-de8600c4-82e7-466e-88fc-6d625c2c0898 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:39:30 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Instance destroyed successfully.
Apr 12 12:39:30 user nova-compute[71321]: DEBUG nova.objects.instance [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lazy-loading 'resources' on Instance uuid 68378ff4-9b1d-4fa5-9b83-8f6c27541c63 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:37:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1229089641',display_name='tempest-TestVolumeBootPattern-server-1229089641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1229089641',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsgnjp9DU7mhDKOnejfarx74lKPsdA7XFVVac0IXQsHunQgmiZdnkpBnb9o+2GfDpfLr3Vtu/GonERs5AS6wpKwmtd3eb4XJchkGev4GCvYiSWT7o/Zl3+nrrnYoAMm1w==',key_name='tempest-TestVolumeBootPattern-1044387718',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:37:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ada441da2124adda751365952320e81',ramdisk_id='',reservation_id='r-okzypnmt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-310589135',owner_user_name='tempest-TestVolumeBootPattern-310589135-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:37:48Z,user_data=None,user_id='076e65b43f664765ad1d48be6e814f40',uuid=68378ff4-9b1d-4fa5-9b83-8f6c27541c63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de8600c4-82e7-466e-88fc-6d625c2c0898", "address": "fa:16:3e:6e:fb:93", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde8600c4-82", "ovs_interfaceid": "de8600c4-82e7-466e-88fc-6d625c2c0898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converting VIF {"id": "de8600c4-82e7-466e-88fc-6d625c2c0898", "address": "fa:16:3e:6e:fb:93", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde8600c4-82", "ovs_interfaceid": "de8600c4-82e7-466e-88fc-6d625c2c0898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:fb:93,bridge_name='br-int',has_traffic_filtering=True,id=de8600c4-82e7-466e-88fc-6d625c2c0898,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde8600c4-82') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG os_vif [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:fb:93,bridge_name='br-int',has_traffic_filtering=True,id=de8600c4-82e7-466e-88fc-6d625c2c0898,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde8600c4-82') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde8600c4-82, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:39:30 user nova-compute[71321]: INFO os_vif [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:fb:93,bridge_name='br-int',has_traffic_filtering=True,id=de8600c4-82e7-466e-88fc-6d625c2c0898,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde8600c4-82')
Apr 12 12:39:30 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qYwGFrzb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:39:30 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:39:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c4a5d5-1f2b-4ef3-b55f-dcaab5cbfc99]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:39:30 user nova-compute[71321]: No targets found.
Apr 12 12:39:30 user nova-compute[71321]: iSNS:
Apr 12 12:39:30 user nova-compute[71321]: No targets found.
Apr 12 12:39:30 user nova-compute[71321]: STATIC:
Apr 12 12:39:30 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945
Apr 12 12:39:30 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:39:30 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:39:30 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f
Apr 12 12:39:30 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:39:30 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:39:30 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5
Apr 12 12:39:30 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:39:30 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:39:30 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b
Apr 12 12:39:30 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:39:30 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:39:30 user nova-compute[71321]: FIRMWARE:
Apr 12 12:39:30 user nova-compute[71321]: No targets found.
Apr 12 12:39:30 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:39:30 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:39:30 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7500f4c-ca1e-4d85-ad91-c7c22f99e438]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f49af71-f2b4-457c-acce-259417f294cb]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:39:30 user nova-compute[71321]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)
Apr 12 12:39:30 user nova-compute[71321]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:39:30 user nova-compute[71321]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)
Apr 12 12:39:30 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:39:30 user nova-compute[71321]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)
Apr 12 12:39:30 user nova-compute[71321]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:39:30 user nova-compute[71321]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)
Apr 12 12:39:30 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef7c3baf80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5'): ({'sdd'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Removing single pathed devices sdd {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3b300c-4559-45ba-a1eb-f3db665b82a8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e95c1f1-70c8-4547-b650-376a4520432c]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Flushing IO for device /dev/sdd {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[186da04e-6be0-4f6f-a894-1db36845498d]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[64526080-0b47-4186-84df-f172648419a2]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] SCSI volumes sdd have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b36d94f-9b19-4e56-bdb9-a2c1532d892e]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7020991b-db9d-4693-882c-312947729a98]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5, portal: 172.16.0.220,3260]
Apr 12 12:39:30 user nova-compute[71321]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5, portal: 172.16.0.220,3260] successful.
Apr 12 12:39:30 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[625b0df9-b2dd-4f0b-aa87-1c872d2fb5fd]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] <== disconnect_volume: return (319ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:39:30 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Deleting instance files /opt/stack/data/nova/instances/68378ff4-9b1d-4fa5-9b83-8f6c27541c63_del
Apr 12 12:39:30 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Deletion of /opt/stack/data/nova/instances/68378ff4-9b1d-4fa5-9b83-8f6c27541c63_del complete
Apr 12 12:39:30 user nova-compute[71321]: INFO nova.compute.manager [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Took 1.22 seconds to destroy the instance on the hypervisor.
Apr 12 12:39:30 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:39:30 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:39:31 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:39:31 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Took 1.00 seconds to deallocate network for instance.
Apr 12 12:39:31 user nova-compute[71321]: DEBUG nova.compute.manager [req-9bf5ab80-611f-4392-a3e1-9ea5e17cf5bc req-1d96c89f-f927-4019-ad06-6a80b32c5a30 service nova] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Received event network-vif-deleted-de8600c4-82e7-466e-88fc-6d625c2c0898 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:39:32 user nova-compute[71321]: DEBUG nova.compute.manager [req-b34f533d-5b27-4971-af49-42f26cb7418c req-727e7ff2-592d-4de6-a1e6-bf5011481edd service nova] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Received event network-vif-plugged-de8600c4-82e7-466e-88fc-6d625c2c0898 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:39:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b34f533d-5b27-4971-af49-42f26cb7418c req-727e7ff2-592d-4de6-a1e6-bf5011481edd service nova] Acquiring lock "68378ff4-9b1d-4fa5-9b83-8f6c27541c63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:39:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b34f533d-5b27-4971-af49-42f26cb7418c req-727e7ff2-592d-4de6-a1e6-bf5011481edd service nova] Lock "68378ff4-9b1d-4fa5-9b83-8f6c27541c63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:39:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b34f533d-5b27-4971-af49-42f26cb7418c req-727e7ff2-592d-4de6-a1e6-bf5011481edd service nova] Lock "68378ff4-9b1d-4fa5-9b83-8f6c27541c63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:39:32 user nova-compute[71321]: DEBUG nova.compute.manager [req-b34f533d-5b27-4971-af49-42f26cb7418c req-727e7ff2-592d-4de6-a1e6-bf5011481edd service nova] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] No waiting events found dispatching network-vif-plugged-de8600c4-82e7-466e-88fc-6d625c2c0898 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:39:32 user nova-compute[71321]: WARNING nova.compute.manager [req-b34f533d-5b27-4971-af49-42f26cb7418c req-727e7ff2-592d-4de6-a1e6-bf5011481edd service nova] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Received unexpected event network-vif-plugged-de8600c4-82e7-466e-88fc-6d625c2c0898 for instance with vm_state active and task_state deleting.
Apr 12 12:39:32 user nova-compute[71321]: INFO nova.compute.manager [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Took 0.80 seconds to detach 1 volumes for instance.
Apr 12 12:39:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:39:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:39:33 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:39:33 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:39:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.267s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:39:33 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Deleted allocations for instance 68378ff4-9b1d-4fa5-9b83-8f6c27541c63
Apr 12 12:39:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "68378ff4-9b1d-4fa5-9b83-8f6c27541c63" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.474s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:39:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:45 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681303170.4847977, 68378ff4-9b1d-4fa5-9b83-8f6c27541c63 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:39:45 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] VM Stopped (Lifecycle Event)
Apr 12 12:39:45 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7eb04ea9-5529-4d9b-9058-57afb635f6fc None None] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:39:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:39:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:40:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:40:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:40:04 user nova-compute[71321]: DEBUG nova.compute.manager [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:40:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:40:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:40:04 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:40:04 user nova-compute[71321]: INFO nova.compute.claims [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Claim successful on node user
Apr 12 12:40:04 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Refreshing inventories for resource provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 12:40:04 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Updating ProviderTree inventory for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 12:40:04 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Updating inventory in ProviderTree for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 12:40:04 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Refreshing aggregate associations for resource provider 7ca624fd-d5cc-42af-93e3-9d62256fa231, aggregates: None {{(pid=71321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 12:40:04 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Refreshing trait associations for resource provider 7ca624fd-d5cc-42af-93e3-9d62256fa231, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=71321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 12:40:05 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:40:05 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:40:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.446s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:40:05 user nova-compute[71321]: DEBUG nova.compute.manager [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:40:05 user nova-compute[71321]: DEBUG nova.compute.manager [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:40:05 user nova-compute[71321]: DEBUG nova.network.neutron [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:40:05 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:40:05 user nova-compute[71321]: DEBUG nova.compute.manager [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:40:05 user nova-compute[71321]: DEBUG nova.compute.manager [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:40:05 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:40:05 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Creating image(s)
Apr 12 12:40:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "/opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:40:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "/opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:40:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "/opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:40:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:05 user nova-compute[71321]: DEBUG nova.policy [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:40:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.129s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:40:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:40:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:40:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.128s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk 1073741824" returned: 0 in 0.061s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:40:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.129s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:05 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Checking if we can resize image /opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:40:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:05 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Cannot resize image /opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:40:05 user nova-compute[71321]: DEBUG nova.objects.instance [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lazy-loading 'migration_context' on Instance uuid 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:40:05 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:40:05 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Ensure instance console log exists: /opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:40:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:40:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:40:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:40:06 user nova-compute[71321]: DEBUG nova.network.neutron [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Successfully created port: 7e54d3ba-dd94-4d8c-adca-16b108135e54 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:40:06 user nova-compute[71321]: DEBUG nova.network.neutron [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Successfully updated port: 7e54d3ba-dd94-4d8c-adca-16b108135e54 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:40:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "refresh_cache-08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:40:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquired lock "refresh_cache-08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:40:06 user nova-compute[71321]: DEBUG nova.network.neutron [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:40:06 user nova-compute[71321]: DEBUG nova.compute.manager [req-a7418eef-6dbd-4135-95e9-bc4941209dd4 req-a4ff4499-4644-454f-8579-08000b79e1a9 service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Received event network-changed-7e54d3ba-dd94-4d8c-adca-16b108135e54 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:40:06 user nova-compute[71321]: DEBUG nova.compute.manager [req-a7418eef-6dbd-4135-95e9-bc4941209dd4 req-a4ff4499-4644-454f-8579-08000b79e1a9 service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Refreshing instance network info cache due to event network-changed-7e54d3ba-dd94-4d8c-adca-16b108135e54. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:40:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a7418eef-6dbd-4135-95e9-bc4941209dd4 req-a4ff4499-4644-454f-8579-08000b79e1a9 service nova] Acquiring lock "refresh_cache-08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:40:06 user nova-compute[71321]: DEBUG nova.network.neutron [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG nova.network.neutron [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Updating instance_info_cache with network_info: [{"id": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "address": "fa:16:3e:bc:a8:83", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e54d3ba-dd", "ovs_interfaceid": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Releasing lock "refresh_cache-08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG nova.compute.manager [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Instance network_info: |[{"id": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "address": "fa:16:3e:bc:a8:83", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e54d3ba-dd", "ovs_interfaceid": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a7418eef-6dbd-4135-95e9-bc4941209dd4 req-a4ff4499-4644-454f-8579-08000b79e1a9 service nova] Acquired lock "refresh_cache-08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG nova.network.neutron [req-a7418eef-6dbd-4135-95e9-bc4941209dd4 req-a4ff4499-4644-454f-8579-08000b79e1a9 service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Refreshing network info cache for port 7e54d3ba-dd94-4d8c-adca-16b108135e54 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Start _get_guest_xml network_info=[{"id": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "address": "fa:16:3e:bc:a8:83", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e54d3ba-dd", "ovs_interfaceid": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:40:07 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:40:07 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:40:07 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:40:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-615902404',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-615902404',id=26,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEkOEoNk45Nbu+gKXPJrgeuFyxP14yDmjujq5KBzAf1jdooM7if7PjnwRiQIghyJu3/D7EhyMQG3CM2jiTOS6YDsVIzsRhBe/9QtuVP0Mga6D+4x7iy56z4kNHaQEC8tg==',key_name='tempest-keypair-2116396079',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fec0c6dc7ab46b0b6b0a580252f40e3',ramdisk_id='',reservation_id='r-hw62w5cz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2036744628',owner_user_name='tempest-AttachVolumeShelveTestJSON-2036744628-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:40:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e4935eed324b868477f8e88918364a',uuid=08f95333-8c01-4fb1-a2cb-4501e6b0d2a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "address": "fa:16:3e:bc:a8:83", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e54d3ba-dd", "ovs_interfaceid": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Converting VIF {"id": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "address": "fa:16:3e:bc:a8:83", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e54d3ba-dd", "ovs_interfaceid": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:a8:83,bridge_name='br-int',has_traffic_filtering=True,id=7e54d3ba-dd94-4d8c-adca-16b108135e54,network=Network(4ba97279-e122-4c2b-b931-dde33e1d71df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e54d3ba-dd') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG nova.objects.instance [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lazy-loading 'pci_devices' on Instance uuid 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:40:07 user nova-compute[71321]:   <uuid>08f95333-8c01-4fb1-a2cb-4501e6b0d2a5</uuid>
Apr 12 12:40:07 user nova-compute[71321]:   <name>instance-0000001a</name>
Apr 12 12:40:07 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:40:07 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:40:07 user nova-compute[71321]:   <metadata>
Apr 12 12:40:07 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:40:07 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:40:07 user nova-compute[71321]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-615902404</nova:name>
Apr 12 12:40:07 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:40:07</nova:creationTime>
Apr 12 12:40:07 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:40:07 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:40:07 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:40:07 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:40:07 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:40:07 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:40:07 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:40:07 user nova-compute[71321]:       <nova:owner>
Apr 12 12:40:07 user nova-compute[71321]:         <nova:user uuid="46e4935eed324b868477f8e88918364a">tempest-AttachVolumeShelveTestJSON-2036744628-project-member</nova:user>
Apr 12 12:40:07 user nova-compute[71321]:         <nova:project uuid="5fec0c6dc7ab46b0b6b0a580252f40e3">tempest-AttachVolumeShelveTestJSON-2036744628</nova:project>
Apr 12 12:40:07 user nova-compute[71321]:       </nova:owner>
Apr 12 12:40:07 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:40:07 user nova-compute[71321]:       <nova:ports>
Apr 12 12:40:07 user nova-compute[71321]:         <nova:port uuid="7e54d3ba-dd94-4d8c-adca-16b108135e54">
Apr 12 12:40:07 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 12:40:07 user nova-compute[71321]:         </nova:port>
Apr 12 12:40:07 user nova-compute[71321]:       </nova:ports>
Apr 12 12:40:07 user nova-compute[71321]:     </nova:instance>
Apr 12 12:40:07 user nova-compute[71321]:   </metadata>
Apr 12 12:40:07 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:40:07 user nova-compute[71321]:     <system>
Apr 12 12:40:07 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:40:07 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:40:07 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:40:07 user nova-compute[71321]:       <entry name="serial">08f95333-8c01-4fb1-a2cb-4501e6b0d2a5</entry>
Apr 12 12:40:07 user nova-compute[71321]:       <entry name="uuid">08f95333-8c01-4fb1-a2cb-4501e6b0d2a5</entry>
Apr 12 12:40:07 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:40:07 user nova-compute[71321]:     </system>
Apr 12 12:40:07 user nova-compute[71321]:   </sysinfo>
Apr 12 12:40:07 user nova-compute[71321]:   <os>
Apr 12 12:40:07 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:40:07 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:40:07 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:40:07 user nova-compute[71321]:   </os>
Apr 12 12:40:07 user nova-compute[71321]:   <features>
Apr 12 12:40:07 user nova-compute[71321]:     <acpi/>
Apr 12 12:40:07 user nova-compute[71321]:     <apic/>
Apr 12 12:40:07 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:40:07 user nova-compute[71321]:   </features>
Apr 12 12:40:07 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:40:07 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:40:07 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:40:07 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:40:07 user nova-compute[71321]:   </clock>
Apr 12 12:40:07 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:40:07 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:40:07 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:40:07 user nova-compute[71321]:   </cpu>
Apr 12 12:40:07 user nova-compute[71321]:   <devices>
Apr 12 12:40:07 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:40:07 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:40:07 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk"/>
Apr 12 12:40:07 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:40:07 user nova-compute[71321]:     </disk>
Apr 12 12:40:07 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:40:07 user nova-compute[71321]:       <mac address="fa:16:3e:bc:a8:83"/>
Apr 12 12:40:07 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:40:07 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:40:07 user nova-compute[71321]:       <target dev="tap7e54d3ba-dd"/>
Apr 12 12:40:07 user nova-compute[71321]:     </interface>
Apr 12 12:40:07 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:40:07 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/console.log" append="off"/>
Apr 12 12:40:07 user nova-compute[71321]:     </serial>
Apr 12 12:40:07 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:40:07 user nova-compute[71321]:     <video>
Apr 12 12:40:07 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:40:07 user nova-compute[71321]:     </video>
Apr 12 12:40:07 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:40:07 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:40:07 user nova-compute[71321]:     </rng>
Apr 12 12:40:07 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:40:07 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:40:07 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:40:07 user nova-compute[71321]:     </memballoon>
Apr 12 12:40:07 user nova-compute[71321]:   </devices>
Apr 12 12:40:07 user nova-compute[71321]: </domain>
Apr 12 12:40:07 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:40:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-615902404',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-615902404',id=26,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEkOEoNk45Nbu+gKXPJrgeuFyxP14yDmjujq5KBzAf1jdooM7if7PjnwRiQIghyJu3/D7EhyMQG3CM2jiTOS6YDsVIzsRhBe/9QtuVP0Mga6D+4x7iy56z4kNHaQEC8tg==',key_name='tempest-keypair-2116396079',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fec0c6dc7ab46b0b6b0a580252f40e3',ramdisk_id='',reservation_id='r-hw62w5cz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2036744628',owner_user_name='tempest-AttachVolumeShelveTestJSON-2036744628-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:40:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e4935eed324b868477f8e88918364a',uuid=08f95333-8c01-4fb1-a2cb-4501e6b0d2a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "address": "fa:16:3e:bc:a8:83", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e54d3ba-dd", "ovs_interfaceid": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Converting VIF {"id": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "address": "fa:16:3e:bc:a8:83", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e54d3ba-dd", "ovs_interfaceid": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:a8:83,bridge_name='br-int',has_traffic_filtering=True,id=7e54d3ba-dd94-4d8c-adca-16b108135e54,network=Network(4ba97279-e122-4c2b-b931-dde33e1d71df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e54d3ba-dd') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG os_vif [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:a8:83,bridge_name='br-int',has_traffic_filtering=True,id=7e54d3ba-dd94-4d8c-adca-16b108135e54,network=Network(4ba97279-e122-4c2b-b931-dde33e1d71df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e54d3ba-dd') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e54d3ba-dd, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e54d3ba-dd, col_values=(('external_ids', {'iface-id': '7e54d3ba-dd94-4d8c-adca-16b108135e54', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:a8:83', 'vm-uuid': '08f95333-8c01-4fb1-a2cb-4501e6b0d2a5'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:07 user nova-compute[71321]: INFO os_vif [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:a8:83,bridge_name='br-int',has_traffic_filtering=True,id=7e54d3ba-dd94-4d8c-adca-16b108135e54,network=Network(4ba97279-e122-4c2b-b931-dde33e1d71df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e54d3ba-dd')
Apr 12 12:40:07 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] No VIF found with MAC fa:16:3e:bc:a8:83, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG nova.network.neutron [req-a7418eef-6dbd-4135-95e9-bc4941209dd4 req-a4ff4499-4644-454f-8579-08000b79e1a9 service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Updated VIF entry in instance network info cache for port 7e54d3ba-dd94-4d8c-adca-16b108135e54. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG nova.network.neutron [req-a7418eef-6dbd-4135-95e9-bc4941209dd4 req-a4ff4499-4644-454f-8579-08000b79e1a9 service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Updating instance_info_cache with network_info: [{"id": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "address": "fa:16:3e:bc:a8:83", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e54d3ba-dd", "ovs_interfaceid": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:40:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a7418eef-6dbd-4135-95e9-bc4941209dd4 req-a4ff4499-4644-454f-8579-08000b79e1a9 service nova] Releasing lock "refresh_cache-08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:40:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:08 user nova-compute[71321]: DEBUG nova.compute.manager [req-a6ceed6c-b756-4511-a3dc-c737ae909610 req-a138f639-d6f3-47d2-a242-ccf6317e7b33 service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Received event network-vif-plugged-7e54d3ba-dd94-4d8c-adca-16b108135e54 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:40:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a6ceed6c-b756-4511-a3dc-c737ae909610 req-a138f639-d6f3-47d2-a242-ccf6317e7b33 service nova] Acquiring lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:40:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a6ceed6c-b756-4511-a3dc-c737ae909610 req-a138f639-d6f3-47d2-a242-ccf6317e7b33 service nova] Lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:40:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a6ceed6c-b756-4511-a3dc-c737ae909610 req-a138f639-d6f3-47d2-a242-ccf6317e7b33 service nova] Lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:40:08 user nova-compute[71321]: DEBUG nova.compute.manager [req-a6ceed6c-b756-4511-a3dc-c737ae909610 req-a138f639-d6f3-47d2-a242-ccf6317e7b33 service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] No waiting events found dispatching network-vif-plugged-7e54d3ba-dd94-4d8c-adca-16b108135e54 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:40:08 user nova-compute[71321]: WARNING nova.compute.manager [req-a6ceed6c-b756-4511-a3dc-c737ae909610 req-a138f639-d6f3-47d2-a242-ccf6317e7b33 service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Received unexpected event network-vif-plugged-7e54d3ba-dd94-4d8c-adca-16b108135e54 for instance with vm_state building and task_state spawning.
Apr 12 12:40:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:10 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303210.739998, 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:40:10 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] VM Resumed (Lifecycle Event)
Apr 12 12:40:10 user nova-compute[71321]: DEBUG nova.compute.manager [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:40:10 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:40:10 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Instance spawned successfully.
Apr 12 12:40:10 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:40:10 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:40:10 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:40:10 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:40:10 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:40:10 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:40:10 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:40:10 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:40:10 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:40:10 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:40:10 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303210.7471507, 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:40:10 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] VM Started (Lifecycle Event)
Apr 12 12:40:10 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:40:10 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:40:10 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:40:10 user nova-compute[71321]: INFO nova.compute.manager [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Took 5.53 seconds to spawn the instance on the hypervisor.
Apr 12 12:40:10 user nova-compute[71321]: DEBUG nova.compute.manager [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:40:10 user nova-compute[71321]: INFO nova.compute.manager [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Took 6.40 seconds to build instance.
Apr 12 12:40:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.491s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:40:11 user nova-compute[71321]: DEBUG nova.compute.manager [req-e894bdb2-9edf-4ddb-b11f-43d081ca8fae req-9d643e65-17f4-4285-80f9-c1fa4116f1fe service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Received event network-vif-plugged-7e54d3ba-dd94-4d8c-adca-16b108135e54 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:40:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e894bdb2-9edf-4ddb-b11f-43d081ca8fae req-9d643e65-17f4-4285-80f9-c1fa4116f1fe service nova] Acquiring lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:40:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e894bdb2-9edf-4ddb-b11f-43d081ca8fae req-9d643e65-17f4-4285-80f9-c1fa4116f1fe service nova] Lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:40:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e894bdb2-9edf-4ddb-b11f-43d081ca8fae req-9d643e65-17f4-4285-80f9-c1fa4116f1fe service nova] Lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:40:11 user nova-compute[71321]: DEBUG nova.compute.manager [req-e894bdb2-9edf-4ddb-b11f-43d081ca8fae req-9d643e65-17f4-4285-80f9-c1fa4116f1fe service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] No waiting events found dispatching network-vif-plugged-7e54d3ba-dd94-4d8c-adca-16b108135e54 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:40:11 user nova-compute[71321]: WARNING nova.compute.manager [req-e894bdb2-9edf-4ddb-b11f-43d081ca8fae req-9d643e65-17f4-4285-80f9-c1fa4116f1fe service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Received unexpected event network-vif-plugged-7e54d3ba-dd94-4d8c-adca-16b108135e54 for instance with vm_state active and task_state None.
Apr 12 12:40:12 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:18 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:40:19 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:40:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:40:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:40:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:40:19 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:40:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:19 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk (vdb) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:40:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:21 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:40:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:40:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:40:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:21 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:40:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:21 user nova-compute[71321]: DEBUG nova.compute.manager [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:40:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:40:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:40:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:21 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:40:21 user nova-compute[71321]: INFO nova.compute.claims [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Claim successful on node user
Apr 12 12:40:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:22 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:40:22 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:40:22 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8017MB free_disk=26.435749053955078GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.039s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG nova.compute.manager [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.229s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG nova.compute.manager [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG nova.network.neutron [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:40:22 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:40:22 user nova-compute[71321]: DEBUG nova.compute.manager [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 10116da0-785c-41cf-96bb-95721af863db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance a4107f2d-88e4-4846-9ece-cb16ad7ecd02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 8403a098-a141-4feb-9eed-3731e2c7c152 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance fa011231-049f-40c3-89c0-53447a35752f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:40:22 user nova-compute[71321]: INFO nova.virt.block_device [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Booting with volume b02750fc-665e-4715-9399-bb359cf6b1a5 at /dev/vda
Apr 12 12:40:22 user nova-compute[71321]: DEBUG os_brick.utils [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63e10ad-4558-42fe-b766-8bfd5d6748b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17a4a79-170c-4237-8da6-fdabe1ea07da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaeb7a22-d630-4d4d-b348-e8c9974392ad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1b3910-8f17-4b1a-aa08-dca69c368e2c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:40:22 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:40:22 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cae7a0-a889-401f-96e1-97a507249e54]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG os_brick.utils [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Updating existing volume attachment record: a682abf8-f6f0-43c1-9799-7706ecc774cb {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:40:22 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:40:23 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:40:23 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:40:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.440s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:40:23 user nova-compute[71321]: DEBUG nova.policy [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '076e65b43f664765ad1d48be6e814f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ada441da2124adda751365952320e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:40:23 user nova-compute[71321]: DEBUG nova.network.neutron [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Successfully created port: f6d914f7-c468-4bda-80d4-b6f37e3bea3c {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:40:24 user nova-compute[71321]: DEBUG nova.network.neutron [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Successfully updated port: f6d914f7-c468-4bda-80d4-b6f37e3bea3c {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:40:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "refresh_cache-2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:40:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquired lock "refresh_cache-2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:40:24 user nova-compute[71321]: DEBUG nova.network.neutron [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:40:24 user nova-compute[71321]: DEBUG nova.compute.manager [req-de08c9c6-8d7e-4cee-845b-d76be236e9fa req-959258a3-2582-4312-aff9-39886644291e service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Received event network-changed-f6d914f7-c468-4bda-80d4-b6f37e3bea3c {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:40:24 user nova-compute[71321]: DEBUG nova.compute.manager [req-de08c9c6-8d7e-4cee-845b-d76be236e9fa req-959258a3-2582-4312-aff9-39886644291e service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Refreshing instance network info cache due to event network-changed-f6d914f7-c468-4bda-80d4-b6f37e3bea3c. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:40:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-de08c9c6-8d7e-4cee-845b-d76be236e9fa req-959258a3-2582-4312-aff9-39886644291e service nova] Acquiring lock "refresh_cache-2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:40:24 user nova-compute[71321]: DEBUG nova.network.neutron [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:40:25 user nova-compute[71321]: DEBUG nova.network.neutron [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Updating instance_info_cache with network_info: [{"id": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c", "address": "fa:16:3e:ab:22:27", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d914f7-c4", "ovs_interfaceid": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:40:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Releasing lock "refresh_cache-2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:40:25 user nova-compute[71321]: DEBUG nova.compute.manager [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Instance network_info: |[{"id": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c", "address": "fa:16:3e:ab:22:27", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d914f7-c4", "ovs_interfaceid": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:40:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-de08c9c6-8d7e-4cee-845b-d76be236e9fa req-959258a3-2582-4312-aff9-39886644291e service nova] Acquired lock "refresh_cache-2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:40:25 user nova-compute[71321]: DEBUG nova.network.neutron [req-de08c9c6-8d7e-4cee-845b-d76be236e9fa req-959258a3-2582-4312-aff9-39886644291e service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Refreshing network info cache for port f6d914f7-c468-4bda-80d4-b6f37e3bea3c {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:40:25 user nova-compute[71321]: DEBUG nova.network.neutron [req-de08c9c6-8d7e-4cee-845b-d76be236e9fa req-959258a3-2582-4312-aff9-39886644291e service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Updated VIF entry in instance network info cache for port f6d914f7-c468-4bda-80d4-b6f37e3bea3c. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:40:25 user nova-compute[71321]: DEBUG nova.network.neutron [req-de08c9c6-8d7e-4cee-845b-d76be236e9fa req-959258a3-2582-4312-aff9-39886644291e service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Updating instance_info_cache with network_info: [{"id": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c", "address": "fa:16:3e:ab:22:27", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d914f7-c4", "ovs_interfaceid": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:40:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-de08c9c6-8d7e-4cee-845b-d76be236e9fa req-959258a3-2582-4312-aff9-39886644291e service nova] Releasing lock "refresh_cache-2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:40:26 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:40:26 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:40:26 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:40:26 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:40:26 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Didn't find any instances for network info cache update. {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 12:40:26 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:40:26 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:40:26 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:40:26 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:40:26 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG nova.compute.manager [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:40:27 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Creating image(s)
Apr 12 12:40:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Did not create local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Ensure instance console log exists: /opt/stack/data/nova/instances/2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Start _get_guest_xml network_info=[{"id": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c", "address": "fa:16:3e:ab:22:27", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d914f7-c4", "ovs_interfaceid": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a682abf8-f6f0-43c1-9799-7706ecc774cb', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qYwGFrzb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67', 'attached_at': '', 'detached_at': '', 'volume_id': 'b02750fc-665e-4715-9399-bb359cf6b1a5', 'serial': 'b02750fc-665e-4715-9399-bb359cf6b1a5'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:40:27 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:40:27 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:40:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qYwGFrzb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:40:27 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:40:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:40:27 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:40:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:40:27 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:40:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f17923-d679-4941-b3e5-2997b65819e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:40:27 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b456593f-50cc-4d10-948c-6e2989097bd9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5] added
Apr 12 12:40:27 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[553b0243-a669-4dac-9e32-ef4824221cdc]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6a543e-f005-4a3a-ac7b-aaf83581aa20]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qYwGFrzb {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qYwGFrzb" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c6f12b-dab9-4272-bac5-c44b958ceee4]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qYwGFrzb'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cffbc52-eb8b-422d-bc33-b98f0873ef69]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[23dfbb06-4d44-4a89-b5df-e481e05a57bf]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)
Apr 12 12:40:27 user nova-compute[71321]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:40:27 user nova-compute[71321]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)
Apr 12 12:40:27 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)
Apr 12 12:40:27 user nova-compute[71321]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:40:27 user nova-compute[71321]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)
Apr 12 12:40:27 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec69b23c-e5fa-4acc-98be-09495a38e0fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5, portal: 172.16.0.220,3260]
Apr 12 12:40:27 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5, portal: 172.16.0.220,3260] successful.
Apr 12 12:40:27 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0ed7e1-4b90-4831-a544-c7c1f1481a26]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[384235e3-0606-41f4-a736-3cbdec18daed]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)
Apr 12 12:40:27 user nova-compute[71321]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:40:27 user nova-compute[71321]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)
Apr 12 12:40:27 user nova-compute[71321]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:40:27 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)
Apr 12 12:40:27 user nova-compute[71321]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:40:27 user nova-compute[71321]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)
Apr 12 12:40:27 user nova-compute[71321]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:40:27 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:40:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:28 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be08c51-1b6b-4655-96a8-b9ca2c099c22]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:40:28 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:40:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qYwGFrzb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:40:28 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:40:29 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:40:29 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26363393730646266', 'path': '/dev/sdd'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:40:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363393730646266', 'path': '/dev/sdd'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:40:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:40:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1424711161',display_name='tempest-TestVolumeBootPattern-server-1424711161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1424711161',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsgnjp9DU7mhDKOnejfarx74lKPsdA7XFVVac0IXQsHunQgmiZdnkpBnb9o+2GfDpfLr3Vtu/GonERs5AS6wpKwmtd3eb4XJchkGev4GCvYiSWT7o/Zl3+nrrnYoAMm1w==',key_name='tempest-TestVolumeBootPattern-1044387718',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ada441da2124adda751365952320e81',ramdisk_id='',reservation_id='r-8oedf15o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-310589135',owner_user_name='tempest-TestVolumeBootPattern-310589135-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:40:23Z,user_data=None,user_id='076e65b43f664765ad1d48be6e814f40',uuid=2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c", "address": "fa:16:3e:ab:22:27", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d914f7-c4", "ovs_interfaceid": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:40:29 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converting VIF {"id": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c", "address": "fa:16:3e:ab:22:27", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d914f7-c4", "ovs_interfaceid": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:40:29 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:22:27,bridge_name='br-int',has_traffic_filtering=True,id=f6d914f7-c468-4bda-80d4-b6f37e3bea3c,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6d914f7-c4') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:40:29 user nova-compute[71321]: DEBUG nova.objects.instance [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:40:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:40:29 user nova-compute[71321]:   <uuid>2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67</uuid>
Apr 12 12:40:29 user nova-compute[71321]:   <name>instance-0000001b</name>
Apr 12 12:40:29 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:40:29 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:40:29 user nova-compute[71321]:   <metadata>
Apr 12 12:40:29 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:40:29 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:40:29 user nova-compute[71321]:       <nova:name>tempest-TestVolumeBootPattern-server-1424711161</nova:name>
Apr 12 12:40:29 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:40:27</nova:creationTime>
Apr 12 12:40:29 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:40:29 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:40:29 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:40:29 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:40:29 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:40:29 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:40:29 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:40:29 user nova-compute[71321]:       <nova:owner>
Apr 12 12:40:29 user nova-compute[71321]:         <nova:user uuid="076e65b43f664765ad1d48be6e814f40">tempest-TestVolumeBootPattern-310589135-project-member</nova:user>
Apr 12 12:40:29 user nova-compute[71321]:         <nova:project uuid="5ada441da2124adda751365952320e81">tempest-TestVolumeBootPattern-310589135</nova:project>
Apr 12 12:40:29 user nova-compute[71321]:       </nova:owner>
Apr 12 12:40:29 user nova-compute[71321]:       <nova:ports>
Apr 12 12:40:29 user nova-compute[71321]:         <nova:port uuid="f6d914f7-c468-4bda-80d4-b6f37e3bea3c">
Apr 12 12:40:29 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 12:40:29 user nova-compute[71321]:         </nova:port>
Apr 12 12:40:29 user nova-compute[71321]:       </nova:ports>
Apr 12 12:40:29 user nova-compute[71321]:     </nova:instance>
Apr 12 12:40:29 user nova-compute[71321]:   </metadata>
Apr 12 12:40:29 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:40:29 user nova-compute[71321]:     <system>
Apr 12 12:40:29 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:40:29 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:40:29 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:40:29 user nova-compute[71321]:       <entry name="serial">2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67</entry>
Apr 12 12:40:29 user nova-compute[71321]:       <entry name="uuid">2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67</entry>
Apr 12 12:40:29 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:40:29 user nova-compute[71321]:     </system>
Apr 12 12:40:29 user nova-compute[71321]:   </sysinfo>
Apr 12 12:40:29 user nova-compute[71321]:   <os>
Apr 12 12:40:29 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:40:29 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:40:29 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:40:29 user nova-compute[71321]:   </os>
Apr 12 12:40:29 user nova-compute[71321]:   <features>
Apr 12 12:40:29 user nova-compute[71321]:     <acpi/>
Apr 12 12:40:29 user nova-compute[71321]:     <apic/>
Apr 12 12:40:29 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:40:29 user nova-compute[71321]:   </features>
Apr 12 12:40:29 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:40:29 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:40:29 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:40:29 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:40:29 user nova-compute[71321]:   </clock>
Apr 12 12:40:29 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:40:29 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:40:29 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:40:29 user nova-compute[71321]:   </cpu>
Apr 12 12:40:29 user nova-compute[71321]:   <devices>
Apr 12 12:40:29 user nova-compute[71321]:     <disk type="block" device="disk">
Apr 12 12:40:29 user nova-compute[71321]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:40:29 user nova-compute[71321]:       <source dev="/dev/sdd"/>
Apr 12 12:40:29 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:40:29 user nova-compute[71321]:       <serial>b02750fc-665e-4715-9399-bb359cf6b1a5</serial>
Apr 12 12:40:29 user nova-compute[71321]:     </disk>
Apr 12 12:40:29 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:40:29 user nova-compute[71321]:       <mac address="fa:16:3e:ab:22:27"/>
Apr 12 12:40:29 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:40:29 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:40:29 user nova-compute[71321]:       <target dev="tapf6d914f7-c4"/>
Apr 12 12:40:29 user nova-compute[71321]:     </interface>
Apr 12 12:40:29 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:40:29 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67/console.log" append="off"/>
Apr 12 12:40:29 user nova-compute[71321]:     </serial>
Apr 12 12:40:29 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:40:29 user nova-compute[71321]:     <video>
Apr 12 12:40:29 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:40:29 user nova-compute[71321]:     </video>
Apr 12 12:40:29 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:40:29 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:40:29 user nova-compute[71321]:     </rng>
Apr 12 12:40:29 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:40:29 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:40:29 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:40:29 user nova-compute[71321]:     </memballoon>
Apr 12 12:40:29 user nova-compute[71321]:   </devices>
Apr 12 12:40:29 user nova-compute[71321]: </domain>
Apr 12 12:40:29 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:40:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:40:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1424711161',display_name='tempest-TestVolumeBootPattern-server-1424711161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1424711161',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsgnjp9DU7mhDKOnejfarx74lKPsdA7XFVVac0IXQsHunQgmiZdnkpBnb9o+2GfDpfLr3Vtu/GonERs5AS6wpKwmtd3eb4XJchkGev4GCvYiSWT7o/Zl3+nrrnYoAMm1w==',key_name='tempest-TestVolumeBootPattern-1044387718',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ada441da2124adda751365952320e81',ramdisk_id='',reservation_id='r-8oedf15o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-310589135',owner_user_name='tempest-TestVolumeBootPattern-310589135-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:40:23Z,user_data=None,user_id='076e65b43f664765ad1d48be6e814f40',uuid=2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c", "address": "fa:16:3e:ab:22:27", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d914f7-c4", "ovs_interfaceid": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:40:29 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converting VIF {"id": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c", "address": "fa:16:3e:ab:22:27", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d914f7-c4", "ovs_interfaceid": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:40:29 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:22:27,bridge_name='br-int',has_traffic_filtering=True,id=f6d914f7-c468-4bda-80d4-b6f37e3bea3c,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6d914f7-c4') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:40:29 user nova-compute[71321]: DEBUG os_vif [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:22:27,bridge_name='br-int',has_traffic_filtering=True,id=f6d914f7-c468-4bda-80d4-b6f37e3bea3c,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6d914f7-c4') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:40:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:40:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:40:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6d914f7-c4, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:40:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf6d914f7-c4, col_values=(('external_ids', {'iface-id': 'f6d914f7-c468-4bda-80d4-b6f37e3bea3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:22:27', 'vm-uuid': '2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:40:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:40:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:29 user nova-compute[71321]: INFO os_vif [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:22:27,bridge_name='br-int',has_traffic_filtering=True,id=f6d914f7-c468-4bda-80d4-b6f37e3bea3c,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6d914f7-c4')
Apr 12 12:40:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:40:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] No VIF found with MAC fa:16:3e:ab:22:27, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:40:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:30 user nova-compute[71321]: DEBUG nova.compute.manager [req-6fe407bb-c07e-4adc-81de-e14ef0cd6f14 req-e3e250c8-57f9-4eb6-8ccc-40e04df2677e service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Received event network-vif-plugged-f6d914f7-c468-4bda-80d4-b6f37e3bea3c {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:40:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-6fe407bb-c07e-4adc-81de-e14ef0cd6f14 req-e3e250c8-57f9-4eb6-8ccc-40e04df2677e service nova] Acquiring lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:40:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-6fe407bb-c07e-4adc-81de-e14ef0cd6f14 req-e3e250c8-57f9-4eb6-8ccc-40e04df2677e service nova] Lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:40:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-6fe407bb-c07e-4adc-81de-e14ef0cd6f14 req-e3e250c8-57f9-4eb6-8ccc-40e04df2677e service nova] Lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:40:30 user nova-compute[71321]: DEBUG nova.compute.manager [req-6fe407bb-c07e-4adc-81de-e14ef0cd6f14 req-e3e250c8-57f9-4eb6-8ccc-40e04df2677e service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] No waiting events found dispatching network-vif-plugged-f6d914f7-c468-4bda-80d4-b6f37e3bea3c {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:40:30 user nova-compute[71321]: WARNING nova.compute.manager [req-6fe407bb-c07e-4adc-81de-e14ef0cd6f14 req-e3e250c8-57f9-4eb6-8ccc-40e04df2677e service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Received unexpected event network-vif-plugged-f6d914f7-c468-4bda-80d4-b6f37e3bea3c for instance with vm_state building and task_state spawning.
Apr 12 12:40:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:32 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303232.513092, 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:40:32 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] VM Resumed (Lifecycle Event)
Apr 12 12:40:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:40:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:40:32 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Instance spawned successfully.
Apr 12 12:40:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:40:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:40:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:40:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:40:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:40:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:40:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:40:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:40:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:40:32 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:40:32 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303232.5182397, 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:40:32 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] VM Started (Lifecycle Event)
Apr 12 12:40:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:40:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:40:32 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:40:32 user nova-compute[71321]: INFO nova.compute.manager [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Took 4.99 seconds to spawn the instance on the hypervisor.
Apr 12 12:40:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:40:32 user nova-compute[71321]: DEBUG nova.compute.manager [req-c7f7bc1a-4bb5-463f-9a7c-59530b978da4 req-d5befbfe-1f57-4e61-b18a-17770bbfe0af service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Received event network-vif-plugged-f6d914f7-c468-4bda-80d4-b6f37e3bea3c {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:40:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c7f7bc1a-4bb5-463f-9a7c-59530b978da4 req-d5befbfe-1f57-4e61-b18a-17770bbfe0af service nova] Acquiring lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:40:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c7f7bc1a-4bb5-463f-9a7c-59530b978da4 req-d5befbfe-1f57-4e61-b18a-17770bbfe0af service nova] Lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:40:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c7f7bc1a-4bb5-463f-9a7c-59530b978da4 req-d5befbfe-1f57-4e61-b18a-17770bbfe0af service nova] Lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:40:32 user nova-compute[71321]: DEBUG nova.compute.manager [req-c7f7bc1a-4bb5-463f-9a7c-59530b978da4 req-d5befbfe-1f57-4e61-b18a-17770bbfe0af service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] No waiting events found dispatching network-vif-plugged-f6d914f7-c468-4bda-80d4-b6f37e3bea3c {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:40:32 user nova-compute[71321]: WARNING nova.compute.manager [req-c7f7bc1a-4bb5-463f-9a7c-59530b978da4 req-d5befbfe-1f57-4e61-b18a-17770bbfe0af service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Received unexpected event network-vif-plugged-f6d914f7-c468-4bda-80d4-b6f37e3bea3c for instance with vm_state building and task_state spawning.
Apr 12 12:40:32 user nova-compute[71321]: INFO nova.compute.manager [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Took 11.21 seconds to build instance.
Apr 12 12:40:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.348s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:40:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:35 user nova-compute[71321]: DEBUG nova.compute.manager [req-0557371b-aa6e-4daf-aa82-0c111df48a85 req-667581b3-adaf-4c0e-af28-1da37ccbeed7 service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Received event network-changed-8243f136-fe60-498f-80e1-27a598c434a3 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:40:35 user nova-compute[71321]: DEBUG nova.compute.manager [req-0557371b-aa6e-4daf-aa82-0c111df48a85 req-667581b3-adaf-4c0e-af28-1da37ccbeed7 service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Refreshing instance network info cache due to event network-changed-8243f136-fe60-498f-80e1-27a598c434a3. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:40:35 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0557371b-aa6e-4daf-aa82-0c111df48a85 req-667581b3-adaf-4c0e-af28-1da37ccbeed7 service nova] Acquiring lock "refresh_cache-fa011231-049f-40c3-89c0-53447a35752f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:40:35 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0557371b-aa6e-4daf-aa82-0c111df48a85 req-667581b3-adaf-4c0e-af28-1da37ccbeed7 service nova] Acquired lock "refresh_cache-fa011231-049f-40c3-89c0-53447a35752f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:40:35 user nova-compute[71321]: DEBUG nova.network.neutron [req-0557371b-aa6e-4daf-aa82-0c111df48a85 req-667581b3-adaf-4c0e-af28-1da37ccbeed7 service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Refreshing network info cache for port 8243f136-fe60-498f-80e1-27a598c434a3 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:40:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:35 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "fa011231-049f-40c3-89c0-53447a35752f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:40:35 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "fa011231-049f-40c3-89c0-53447a35752f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:40:35 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "fa011231-049f-40c3-89c0-53447a35752f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:40:35 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "fa011231-049f-40c3-89c0-53447a35752f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:40:35 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "fa011231-049f-40c3-89c0-53447a35752f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:40:35 user nova-compute[71321]: INFO nova.compute.manager [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Terminating instance
Apr 12 12:40:35 user nova-compute[71321]: DEBUG nova.compute.manager [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:40:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:35 user nova-compute[71321]: DEBUG nova.compute.manager [req-54d36200-7fc7-4941-8eab-51b66f93be10 req-b7ceae88-5f7b-4f99-8351-e0ffae228fad service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Received event network-vif-unplugged-8243f136-fe60-498f-80e1-27a598c434a3 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:40:35 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-54d36200-7fc7-4941-8eab-51b66f93be10 req-b7ceae88-5f7b-4f99-8351-e0ffae228fad service nova] Acquiring lock "fa011231-049f-40c3-89c0-53447a35752f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:40:35 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-54d36200-7fc7-4941-8eab-51b66f93be10 req-b7ceae88-5f7b-4f99-8351-e0ffae228fad service nova] Lock "fa011231-049f-40c3-89c0-53447a35752f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:40:35 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-54d36200-7fc7-4941-8eab-51b66f93be10 req-b7ceae88-5f7b-4f99-8351-e0ffae228fad service nova] Lock "fa011231-049f-40c3-89c0-53447a35752f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:40:35 user nova-compute[71321]: DEBUG nova.compute.manager [req-54d36200-7fc7-4941-8eab-51b66f93be10 req-b7ceae88-5f7b-4f99-8351-e0ffae228fad service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] No waiting events found dispatching network-vif-unplugged-8243f136-fe60-498f-80e1-27a598c434a3 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:40:35 user nova-compute[71321]: DEBUG nova.compute.manager [req-54d36200-7fc7-4941-8eab-51b66f93be10 req-b7ceae88-5f7b-4f99-8351-e0ffae228fad service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Received event network-vif-unplugged-8243f136-fe60-498f-80e1-27a598c434a3 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:40:35 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: fa011231-049f-40c3-89c0-53447a35752f] Instance destroyed successfully.
Apr 12 12:40:35 user nova-compute[71321]: DEBUG nova.objects.instance [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lazy-loading 'resources' on Instance uuid fa011231-049f-40c3-89c0-53447a35752f {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:40:35 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T12:34:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-224414802',display_name='tempest-TestShelveInstance-server-224414802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-224414802',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIXMDy37+J0z2zjXuZ61N5MrklsBTrLDHZ5WONUVRavY0GPTGKIiOPe6k/JrTv4Yj3TrMCnYedVgrFp1+M+iVBHHlbm5MUjkvlQ73cuxRdVBOG/e8rbEfvGvKpVaF3RRQ==',key_name='tempest-TestShelveInstance-568010420',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:38:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99a894beccbd45af9d4486772fccb949',ramdisk_id='',reservation_id='r-e0ge4cua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1585323339',owner_user_name='tempest-TestShelveInstance-1585323339-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:38:56Z,user_data=None,user_id='b4b62db7ef8e4ae4bc11ff520c6afcd8',uuid=fa011231-049f-40c3-89c0-53447a35752f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8243f136-fe60-498f-80e1-27a598c434a3", "address": "fa:16:3e:2f:02:41", "network": {"id": "34ecf1c9-50ff-4168-8650-a5277102ccaa", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730184159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a894beccbd45af9d4486772fccb949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8243f136-fe", "ovs_interfaceid": "8243f136-fe60-498f-80e1-27a598c434a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:40:35 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Converting VIF {"id": "8243f136-fe60-498f-80e1-27a598c434a3", "address": "fa:16:3e:2f:02:41", "network": {"id": "34ecf1c9-50ff-4168-8650-a5277102ccaa", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730184159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a894beccbd45af9d4486772fccb949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8243f136-fe", "ovs_interfaceid": "8243f136-fe60-498f-80e1-27a598c434a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:40:35 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:02:41,bridge_name='br-int',has_traffic_filtering=True,id=8243f136-fe60-498f-80e1-27a598c434a3,network=Network(34ecf1c9-50ff-4168-8650-a5277102ccaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8243f136-fe') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:40:35 user nova-compute[71321]: DEBUG os_vif [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:02:41,bridge_name='br-int',has_traffic_filtering=True,id=8243f136-fe60-498f-80e1-27a598c434a3,network=Network(34ecf1c9-50ff-4168-8650-a5277102ccaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8243f136-fe') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:40:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8243f136-fe, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:40:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:40:36 user nova-compute[71321]: INFO os_vif [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:02:41,bridge_name='br-int',has_traffic_filtering=True,id=8243f136-fe60-498f-80e1-27a598c434a3,network=Network(34ecf1c9-50ff-4168-8650-a5277102ccaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8243f136-fe')
Apr 12 12:40:36 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MJbBXUwj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:40:36 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:40:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG nova.network.neutron [req-0557371b-aa6e-4daf-aa82-0c111df48a85 req-667581b3-adaf-4c0e-af28-1da37ccbeed7 service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Updated VIF entry in instance network info cache for port 8243f136-fe60-498f-80e1-27a598c434a3. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG nova.network.neutron [req-0557371b-aa6e-4daf-aa82-0c111df48a85 req-667581b3-adaf-4c0e-af28-1da37ccbeed7 service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Updating instance_info_cache with network_info: [{"id": "8243f136-fe60-498f-80e1-27a598c434a3", "address": "fa:16:3e:2f:02:41", "network": {"id": "34ecf1c9-50ff-4168-8650-a5277102ccaa", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730184159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a894beccbd45af9d4486772fccb949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8243f136-fe", "ovs_interfaceid": "8243f136-fe60-498f-80e1-27a598c434a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee662f8b-6017-4d94-93f9-45617eb367ef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:40:36 user nova-compute[71321]: No targets found.
Apr 12 12:40:36 user nova-compute[71321]: iSNS:
Apr 12 12:40:36 user nova-compute[71321]: No targets found.
Apr 12 12:40:36 user nova-compute[71321]: STATIC:
Apr 12 12:40:36 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945
Apr 12 12:40:36 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:40:36 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:40:36 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f
Apr 12 12:40:36 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:40:36 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:40:36 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5
Apr 12 12:40:36 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:40:36 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:40:36 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b
Apr 12 12:40:36 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:40:36 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:40:36 user nova-compute[71321]: FIRMWARE:
Apr 12 12:40:36 user nova-compute[71321]: No targets found.
Apr 12 12:40:36 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:40:36 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:40:36 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0557371b-aa6e-4daf-aa82-0c111df48a85 req-667581b3-adaf-4c0e-af28-1da37ccbeed7 service nova] Releasing lock "refresh_cache-fa011231-049f-40c3-89c0-53447a35752f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bcb97b-d3b1-4fa1-b34d-62f7c80794a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ef6f9c-2cd8-4316-9d5c-f52586e660d9]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)
Apr 12 12:40:36 user nova-compute[71321]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:40:36 user nova-compute[71321]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)
Apr 12 12:40:36 user nova-compute[71321]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:40:36 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)
Apr 12 12:40:36 user nova-compute[71321]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 (non-flash)
Apr 12 12:40:36 user nova-compute[71321]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)
Apr 12 12:40:36 user nova-compute[71321]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:40:36 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef8a06d480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945'): ({'sde'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Removing single pathed devices sde {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[500f28ad-edee-430b-a944-76077e55adc6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21486ce-fa7c-4dc2-9458-b2f2e444c70d]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Flushing IO for device /dev/sde {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec6d8d6-4a27-46f4-ba0e-fc79a7b72b67]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.058s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[43be5341-74c4-4401-9f30-eaf8eee5ed78]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] SCSI volumes sde have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ee596e-8116-4f6c-a6c0-d21ff721720f]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[25452eec-5db9-45a0-a5e6-f887d942f3c4]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945, portal: 172.16.0.220,3260]
Apr 12 12:40:36 user nova-compute[71321]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945, portal: 172.16.0.220,3260] successful.
Apr 12 12:40:36 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b75333b-9743-463b-bd86-ed3f7a8bf1ec]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] <== disconnect_volume: return (366ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:40:36 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Deleting instance files /opt/stack/data/nova/instances/fa011231-049f-40c3-89c0-53447a35752f_del
Apr 12 12:40:36 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Deletion of /opt/stack/data/nova/instances/fa011231-049f-40c3-89c0-53447a35752f_del complete
Apr 12 12:40:36 user nova-compute[71321]: INFO nova.compute.manager [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Took 1.25 seconds to destroy the instance on the hypervisor.
Apr 12 12:40:36 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: fa011231-049f-40c3-89c0-53447a35752f] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: fa011231-049f-40c3-89c0-53447a35752f] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:40:36 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: fa011231-049f-40c3-89c0-53447a35752f] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:40:36 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: fa011231-049f-40c3-89c0-53447a35752f] Took 0.50 seconds to deallocate network for instance.
Apr 12 12:40:37 user nova-compute[71321]: INFO nova.compute.manager [None req-c919b799-7f4a-4fff-a25f-9d0e9a5d77d7 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Unrescuing
Apr 12 12:40:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c919b799-7f4a-4fff-a25f-9d0e9a5d77d7 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "refresh_cache-89cc5f86-c387-4966-8bbf-a64d42d30db7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:40:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c919b799-7f4a-4fff-a25f-9d0e9a5d77d7 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquired lock "refresh_cache-89cc5f86-c387-4966-8bbf-a64d42d30db7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:40:37 user nova-compute[71321]: DEBUG nova.network.neutron [None req-c919b799-7f4a-4fff-a25f-9d0e9a5d77d7 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:40:37 user nova-compute[71321]: DEBUG nova.compute.manager [req-bef24c3c-7188-4ac0-8dfd-13f3837ff413 req-ecc3e8fa-f098-44ea-befa-f78e008f49df service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Received event network-vif-plugged-8243f136-fe60-498f-80e1-27a598c434a3 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:40:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-bef24c3c-7188-4ac0-8dfd-13f3837ff413 req-ecc3e8fa-f098-44ea-befa-f78e008f49df service nova] Acquiring lock "fa011231-049f-40c3-89c0-53447a35752f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:40:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-bef24c3c-7188-4ac0-8dfd-13f3837ff413 req-ecc3e8fa-f098-44ea-befa-f78e008f49df service nova] Lock "fa011231-049f-40c3-89c0-53447a35752f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:40:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-bef24c3c-7188-4ac0-8dfd-13f3837ff413 req-ecc3e8fa-f098-44ea-befa-f78e008f49df service nova] Lock "fa011231-049f-40c3-89c0-53447a35752f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:40:37 user nova-compute[71321]: DEBUG nova.compute.manager [req-bef24c3c-7188-4ac0-8dfd-13f3837ff413 req-ecc3e8fa-f098-44ea-befa-f78e008f49df service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] No waiting events found dispatching network-vif-plugged-8243f136-fe60-498f-80e1-27a598c434a3 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:40:37 user nova-compute[71321]: WARNING nova.compute.manager [req-bef24c3c-7188-4ac0-8dfd-13f3837ff413 req-ecc3e8fa-f098-44ea-befa-f78e008f49df service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Received unexpected event network-vif-plugged-8243f136-fe60-498f-80e1-27a598c434a3 for instance with vm_state active and task_state deleting.
Apr 12 12:40:37 user nova-compute[71321]: DEBUG nova.compute.manager [req-bef24c3c-7188-4ac0-8dfd-13f3837ff413 req-ecc3e8fa-f098-44ea-befa-f78e008f49df service nova] [instance: fa011231-049f-40c3-89c0-53447a35752f] Received event network-vif-deleted-8243f136-fe60-498f-80e1-27a598c434a3 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:40:37 user nova-compute[71321]: INFO nova.compute.manager [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Took 0.81 seconds to detach 1 volumes for instance.
Apr 12 12:40:37 user nova-compute[71321]: DEBUG nova.compute.manager [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Deleting volume: 5edf56f8-c348-40e5-a9e0-d0b3a7fc7945 {{(pid=71321) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 12:40:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:40:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:40:37 user nova-compute[71321]: DEBUG nova.network.neutron [None req-c919b799-7f4a-4fff-a25f-9d0e9a5d77d7 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Updating instance_info_cache with network_info: [{"id": "c3155961-f301-4a26-a599-1d648d2500b0", "address": "fa:16:3e:75:3a:c1", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3155961-f3", "ovs_interfaceid": "c3155961-f301-4a26-a599-1d648d2500b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:40:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c919b799-7f4a-4fff-a25f-9d0e9a5d77d7 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Releasing lock "refresh_cache-89cc5f86-c387-4966-8bbf-a64d42d30db7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:40:38 user nova-compute[71321]: DEBUG nova.objects.instance [None req-c919b799-7f4a-4fff-a25f-9d0e9a5d77d7 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'flavor' on Instance uuid 89cc5f86-c387-4966-8bbf-a64d42d30db7 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:40:38 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:40:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:38 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:40:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:40:38 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Deleted allocations for instance fa011231-049f-40c3-89c0-53447a35752f
Apr 12 12:40:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "fa011231-049f-40c3-89c0-53447a35752f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.147s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:40:38 user nova-compute[71321]: DEBUG nova.compute.manager [req-58ec9b88-4740-4c00-ae66-67d382789dd3 req-20d41d58-77b0-424e-a9a3-1a0dbb56ba4c service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received event network-vif-unplugged-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:40:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-58ec9b88-4740-4c00-ae66-67d382789dd3 req-20d41d58-77b0-424e-a9a3-1a0dbb56ba4c service nova] Acquiring lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:40:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-58ec9b88-4740-4c00-ae66-67d382789dd3 req-20d41d58-77b0-424e-a9a3-1a0dbb56ba4c service nova] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:40:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-58ec9b88-4740-4c00-ae66-67d382789dd3 req-20d41d58-77b0-424e-a9a3-1a0dbb56ba4c service nova] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:40:38 user nova-compute[71321]: DEBUG nova.compute.manager [req-58ec9b88-4740-4c00-ae66-67d382789dd3 req-20d41d58-77b0-424e-a9a3-1a0dbb56ba4c service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] No waiting events found dispatching network-vif-unplugged-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:40:38 user nova-compute[71321]: WARNING nova.compute.manager [req-58ec9b88-4740-4c00-ae66-67d382789dd3 req-20d41d58-77b0-424e-a9a3-1a0dbb56ba4c service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received unexpected event network-vif-unplugged-c3155961-f301-4a26-a599-1d648d2500b0 for instance with vm_state rescued and task_state unrescuing.
Apr 12 12:40:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:38 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Instance destroyed successfully.
Apr 12 12:40:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:40 user nova-compute[71321]: DEBUG nova.compute.manager [req-eeb1ee39-8cf1-4ffe-a68f-4a19e53d65c2 req-b5c58735-4c65-4e66-8ae8-ed67ea07a3a2 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received event network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:40:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-eeb1ee39-8cf1-4ffe-a68f-4a19e53d65c2 req-b5c58735-4c65-4e66-8ae8-ed67ea07a3a2 service nova] Acquiring lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:40:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-eeb1ee39-8cf1-4ffe-a68f-4a19e53d65c2 req-b5c58735-4c65-4e66-8ae8-ed67ea07a3a2 service nova] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:40:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-eeb1ee39-8cf1-4ffe-a68f-4a19e53d65c2 req-b5c58735-4c65-4e66-8ae8-ed67ea07a3a2 service nova] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:40:40 user nova-compute[71321]: DEBUG nova.compute.manager [req-eeb1ee39-8cf1-4ffe-a68f-4a19e53d65c2 req-b5c58735-4c65-4e66-8ae8-ed67ea07a3a2 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] No waiting events found dispatching network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:40:40 user nova-compute[71321]: WARNING nova.compute.manager [req-eeb1ee39-8cf1-4ffe-a68f-4a19e53d65c2 req-b5c58735-4c65-4e66-8ae8-ed67ea07a3a2 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received unexpected event network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 for instance with vm_state rescued and task_state unrescuing.
Apr 12 12:40:40 user nova-compute[71321]: DEBUG nova.compute.manager [req-eeb1ee39-8cf1-4ffe-a68f-4a19e53d65c2 req-b5c58735-4c65-4e66-8ae8-ed67ea07a3a2 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received event network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:40:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-eeb1ee39-8cf1-4ffe-a68f-4a19e53d65c2 req-b5c58735-4c65-4e66-8ae8-ed67ea07a3a2 service nova] Acquiring lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:40:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-eeb1ee39-8cf1-4ffe-a68f-4a19e53d65c2 req-b5c58735-4c65-4e66-8ae8-ed67ea07a3a2 service nova] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:40:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-eeb1ee39-8cf1-4ffe-a68f-4a19e53d65c2 req-b5c58735-4c65-4e66-8ae8-ed67ea07a3a2 service nova] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:40:40 user nova-compute[71321]: DEBUG nova.compute.manager [req-eeb1ee39-8cf1-4ffe-a68f-4a19e53d65c2 req-b5c58735-4c65-4e66-8ae8-ed67ea07a3a2 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] No waiting events found dispatching network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:40:40 user nova-compute[71321]: WARNING nova.compute.manager [req-eeb1ee39-8cf1-4ffe-a68f-4a19e53d65c2 req-b5c58735-4c65-4e66-8ae8-ed67ea07a3a2 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received unexpected event network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 for instance with vm_state rescued and task_state unrescuing.
Apr 12 12:40:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Removed pending event for 89cc5f86-c387-4966-8bbf-a64d42d30db7 due to event {{(pid=71321) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 12:40:42 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303242.330474, 89cc5f86-c387-4966-8bbf-a64d42d30db7 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:40:42 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] VM Resumed (Lifecycle Event)
Apr 12 12:40:42 user nova-compute[71321]: DEBUG nova.compute.manager [None req-c919b799-7f4a-4fff-a25f-9d0e9a5d77d7 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:40:42 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:40:42 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:40:42 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 12:40:42 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303242.331771, 89cc5f86-c387-4966-8bbf-a64d42d30db7 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:40:42 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] VM Started (Lifecycle Event)
Apr 12 12:40:42 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:40:42 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:40:42 user nova-compute[71321]: DEBUG nova.compute.manager [req-564e2728-b4cc-4f1e-b571-d16ca320256c req-f306fb61-1017-4688-954f-848318565db6 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received event network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:40:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-564e2728-b4cc-4f1e-b571-d16ca320256c req-f306fb61-1017-4688-954f-848318565db6 service nova] Acquiring lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:40:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-564e2728-b4cc-4f1e-b571-d16ca320256c req-f306fb61-1017-4688-954f-848318565db6 service nova] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:40:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-564e2728-b4cc-4f1e-b571-d16ca320256c req-f306fb61-1017-4688-954f-848318565db6 service nova] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:40:42 user nova-compute[71321]: DEBUG nova.compute.manager [req-564e2728-b4cc-4f1e-b571-d16ca320256c req-f306fb61-1017-4688-954f-848318565db6 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] No waiting events found dispatching network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:40:42 user nova-compute[71321]: WARNING nova.compute.manager [req-564e2728-b4cc-4f1e-b571-d16ca320256c req-f306fb61-1017-4688-954f-848318565db6 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received unexpected event network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 for instance with vm_state active and task_state None.
Apr 12 12:40:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:50 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681303235.9508405, fa011231-049f-40c3-89c0-53447a35752f => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:40:50 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: fa011231-049f-40c3-89c0-53447a35752f] VM Stopped (Lifecycle Event)
Apr 12 12:40:50 user nova-compute[71321]: DEBUG nova.compute.manager [None req-85a6edf0-d5b0-4b8c-a0bd-d43ce3f5be93 None None] [instance: fa011231-049f-40c3-89c0-53447a35752f] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:40:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:40:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:20 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:41:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:21 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:41:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:41:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:41:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:41:21 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:41:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:41:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:41:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:41:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:41:21 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:41:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:41:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:41:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:41:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:41:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:41:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:41:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:41:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:41:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:41:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:41:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:41:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:41:22 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:41:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:41:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:41:22 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:41:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:41:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:41:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:41:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:41:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:41:23 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:41:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:41:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:41:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:41:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:41:24 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:41:24 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:41:24 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8081MB free_disk=26.432003021240234GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:41:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:41:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:41:24 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 10116da0-785c-41cf-96bb-95721af863db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:41:24 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance a4107f2d-88e4-4846-9ece-cb16ad7ecd02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:41:24 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 8403a098-a141-4feb-9eed-3731e2c7c152 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:41:24 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:41:24 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:41:24 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:41:24 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:41:24 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:41:24 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:41:24 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:41:24 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:41:24 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:41:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.381s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:41:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:26 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:41:26 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:41:26 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:41:26 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Rebuilding the list of instances to heal {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 12:41:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-10116da0-785c-41cf-96bb-95721af863db" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:41:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-10116da0-785c-41cf-96bb-95721af863db" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:41:27 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 12:41:27 user nova-compute[71321]: DEBUG nova.objects.instance [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lazy-loading 'info_cache' on Instance uuid 10116da0-785c-41cf-96bb-95721af863db {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:41:27 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] Updating instance_info_cache with network_info: [{"id": "cbb69638-6a5f-4d12-8737-45850145fa0e", "address": "fa:16:3e:57:7c:99", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb69638-6a", "ovs_interfaceid": "cbb69638-6a5f-4d12-8737-45850145fa0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:41:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-10116da0-785c-41cf-96bb-95721af863db" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:41:27 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 12:41:27 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:41:27 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:41:27 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:41:27 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:41:27 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:41:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:30 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:41:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:32 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:41 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7feadb14-3b5a-4043-82f1-2bd4e4cef653 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "8403a098-a141-4feb-9eed-3731e2c7c152" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:41:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7feadb14-3b5a-4043-82f1-2bd4e4cef653 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "8403a098-a141-4feb-9eed-3731e2c7c152" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:41:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7feadb14-3b5a-4043-82f1-2bd4e4cef653 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "8403a098-a141-4feb-9eed-3731e2c7c152-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:41:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7feadb14-3b5a-4043-82f1-2bd4e4cef653 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "8403a098-a141-4feb-9eed-3731e2c7c152-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:41:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7feadb14-3b5a-4043-82f1-2bd4e4cef653 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "8403a098-a141-4feb-9eed-3731e2c7c152-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:41:49 user nova-compute[71321]: INFO nova.compute.manager [None req-7feadb14-3b5a-4043-82f1-2bd4e4cef653 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Terminating instance
Apr 12 12:41:49 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7feadb14-3b5a-4043-82f1-2bd4e4cef653 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:41:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:49 user nova-compute[71321]: DEBUG nova.compute.manager [req-b84108ee-7c81-420b-8464-b0e0cd887f6a req-d717f021-9fb0-41ff-9b58-1da8b3b84b13 service nova] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Received event network-vif-unplugged-12dd9e3e-1713-4f14-8893-3084e8140f87 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:41:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b84108ee-7c81-420b-8464-b0e0cd887f6a req-d717f021-9fb0-41ff-9b58-1da8b3b84b13 service nova] Acquiring lock "8403a098-a141-4feb-9eed-3731e2c7c152-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:41:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b84108ee-7c81-420b-8464-b0e0cd887f6a req-d717f021-9fb0-41ff-9b58-1da8b3b84b13 service nova] Lock "8403a098-a141-4feb-9eed-3731e2c7c152-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:41:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b84108ee-7c81-420b-8464-b0e0cd887f6a req-d717f021-9fb0-41ff-9b58-1da8b3b84b13 service nova] Lock "8403a098-a141-4feb-9eed-3731e2c7c152-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:41:49 user nova-compute[71321]: DEBUG nova.compute.manager [req-b84108ee-7c81-420b-8464-b0e0cd887f6a req-d717f021-9fb0-41ff-9b58-1da8b3b84b13 service nova] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] No waiting events found dispatching network-vif-unplugged-12dd9e3e-1713-4f14-8893-3084e8140f87 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:41:49 user nova-compute[71321]: DEBUG nova.compute.manager [req-b84108ee-7c81-420b-8464-b0e0cd887f6a req-d717f021-9fb0-41ff-9b58-1da8b3b84b13 service nova] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Received event network-vif-unplugged-12dd9e3e-1713-4f14-8893-3084e8140f87 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:41:50 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Instance destroyed successfully.
Apr 12 12:41:50 user nova-compute[71321]: DEBUG nova.objects.instance [None req-7feadb14-3b5a-4043-82f1-2bd4e4cef653 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lazy-loading 'resources' on Instance uuid 8403a098-a141-4feb-9eed-3731e2c7c152 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:41:50 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-7feadb14-3b5a-4043-82f1-2bd4e4cef653 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:33:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-17230305',display_name='tempest-ServersNegativeTestJSON-server-17230305',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-17230305',id=18,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:33:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ab04e4f968f4c07af43f3fe6651713a',ramdisk_id='',reservation_id='r-pl1rg0gl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1331801987',owner_user_name='tempest-ServersNegativeTestJSON-1331801987-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:33:14Z,user_data=None,user_id='bc42504b7aab4fedb136acd998adeddb',uuid=8403a098-a141-4feb-9eed-3731e2c7c152,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12dd9e3e-1713-4f14-8893-3084e8140f87", "address": "fa:16:3e:4c:01:43", "network": {"id": "963759e8-808d-494c-9dea-0efa9f78804a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-684057570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ab04e4f968f4c07af43f3fe6651713a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12dd9e3e-17", "ovs_interfaceid": "12dd9e3e-1713-4f14-8893-3084e8140f87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:41:50 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-7feadb14-3b5a-4043-82f1-2bd4e4cef653 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Converting VIF {"id": "12dd9e3e-1713-4f14-8893-3084e8140f87", "address": "fa:16:3e:4c:01:43", "network": {"id": "963759e8-808d-494c-9dea-0efa9f78804a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-684057570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ab04e4f968f4c07af43f3fe6651713a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12dd9e3e-17", "ovs_interfaceid": "12dd9e3e-1713-4f14-8893-3084e8140f87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:41:50 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-7feadb14-3b5a-4043-82f1-2bd4e4cef653 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:01:43,bridge_name='br-int',has_traffic_filtering=True,id=12dd9e3e-1713-4f14-8893-3084e8140f87,network=Network(963759e8-808d-494c-9dea-0efa9f78804a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12dd9e3e-17') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:41:50 user nova-compute[71321]: DEBUG os_vif [None req-7feadb14-3b5a-4043-82f1-2bd4e4cef653 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:01:43,bridge_name='br-int',has_traffic_filtering=True,id=12dd9e3e-1713-4f14-8893-3084e8140f87,network=Network(963759e8-808d-494c-9dea-0efa9f78804a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12dd9e3e-17') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:41:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12dd9e3e-17, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:41:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:41:50 user nova-compute[71321]: INFO os_vif [None req-7feadb14-3b5a-4043-82f1-2bd4e4cef653 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:01:43,bridge_name='br-int',has_traffic_filtering=True,id=12dd9e3e-1713-4f14-8893-3084e8140f87,network=Network(963759e8-808d-494c-9dea-0efa9f78804a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12dd9e3e-17')
Apr 12 12:41:50 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-7feadb14-3b5a-4043-82f1-2bd4e4cef653 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Deleting instance files /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152_del
Apr 12 12:41:50 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-7feadb14-3b5a-4043-82f1-2bd4e4cef653 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Deletion of /opt/stack/data/nova/instances/8403a098-a141-4feb-9eed-3731e2c7c152_del complete
Apr 12 12:41:50 user nova-compute[71321]: INFO nova.compute.manager [None req-7feadb14-3b5a-4043-82f1-2bd4e4cef653 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 12 12:41:50 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-7feadb14-3b5a-4043-82f1-2bd4e4cef653 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:41:50 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:41:50 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:41:50 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:41:50 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Took 0.49 seconds to deallocate network for instance.
Apr 12 12:41:50 user nova-compute[71321]: DEBUG nova.compute.manager [req-d37361d7-4313-4857-a273-42c5a600a722 req-05f57ae2-fb73-4a06-acdb-545140196db2 service nova] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Received event network-vif-deleted-12dd9e3e-1713-4f14-8893-3084e8140f87 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:41:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7feadb14-3b5a-4043-82f1-2bd4e4cef653 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:41:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7feadb14-3b5a-4043-82f1-2bd4e4cef653 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:41:51 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-7feadb14-3b5a-4043-82f1-2bd4e4cef653 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:41:51 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-7feadb14-3b5a-4043-82f1-2bd4e4cef653 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:41:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7feadb14-3b5a-4043-82f1-2bd4e4cef653 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:41:51 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-7feadb14-3b5a-4043-82f1-2bd4e4cef653 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Deleted allocations for instance 8403a098-a141-4feb-9eed-3731e2c7c152
Apr 12 12:41:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7feadb14-3b5a-4043-82f1-2bd4e4cef653 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "8403a098-a141-4feb-9eed-3731e2c7c152" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.889s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:41:51 user nova-compute[71321]: DEBUG nova.compute.manager [req-fa5636ab-99e8-49b6-b5fe-f9bd4ed06db5 req-83674176-4a43-4fdd-8d0c-aa8af11ab525 service nova] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Received event network-vif-plugged-12dd9e3e-1713-4f14-8893-3084e8140f87 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:41:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-fa5636ab-99e8-49b6-b5fe-f9bd4ed06db5 req-83674176-4a43-4fdd-8d0c-aa8af11ab525 service nova] Acquiring lock "8403a098-a141-4feb-9eed-3731e2c7c152-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:41:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-fa5636ab-99e8-49b6-b5fe-f9bd4ed06db5 req-83674176-4a43-4fdd-8d0c-aa8af11ab525 service nova] Lock "8403a098-a141-4feb-9eed-3731e2c7c152-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:41:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-fa5636ab-99e8-49b6-b5fe-f9bd4ed06db5 req-83674176-4a43-4fdd-8d0c-aa8af11ab525 service nova] Lock "8403a098-a141-4feb-9eed-3731e2c7c152-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:41:51 user nova-compute[71321]: DEBUG nova.compute.manager [req-fa5636ab-99e8-49b6-b5fe-f9bd4ed06db5 req-83674176-4a43-4fdd-8d0c-aa8af11ab525 service nova] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] No waiting events found dispatching network-vif-plugged-12dd9e3e-1713-4f14-8893-3084e8140f87 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:41:51 user nova-compute[71321]: WARNING nova.compute.manager [req-fa5636ab-99e8-49b6-b5fe-f9bd4ed06db5 req-83674176-4a43-4fdd-8d0c-aa8af11ab525 service nova] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Received unexpected event network-vif-plugged-12dd9e3e-1713-4f14-8893-3084e8140f87 for instance with vm_state deleted and task_state None.
Apr 12 12:41:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:55 user nova-compute[71321]: DEBUG nova.compute.manager [req-9ddf0e59-901b-4f04-be0f-753dcc1ad63d req-67c645b2-907a-4c1c-9167-962570eff584 service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Received event network-changed-7e54d3ba-dd94-4d8c-adca-16b108135e54 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:41:55 user nova-compute[71321]: DEBUG nova.compute.manager [req-9ddf0e59-901b-4f04-be0f-753dcc1ad63d req-67c645b2-907a-4c1c-9167-962570eff584 service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Refreshing instance network info cache due to event network-changed-7e54d3ba-dd94-4d8c-adca-16b108135e54. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:41:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9ddf0e59-901b-4f04-be0f-753dcc1ad63d req-67c645b2-907a-4c1c-9167-962570eff584 service nova] Acquiring lock "refresh_cache-08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:41:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9ddf0e59-901b-4f04-be0f-753dcc1ad63d req-67c645b2-907a-4c1c-9167-962570eff584 service nova] Acquired lock "refresh_cache-08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:41:55 user nova-compute[71321]: DEBUG nova.network.neutron [req-9ddf0e59-901b-4f04-be0f-753dcc1ad63d req-67c645b2-907a-4c1c-9167-962570eff584 service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Refreshing network info cache for port 7e54d3ba-dd94-4d8c-adca-16b108135e54 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:41:55 user nova-compute[71321]: DEBUG nova.network.neutron [req-9ddf0e59-901b-4f04-be0f-753dcc1ad63d req-67c645b2-907a-4c1c-9167-962570eff584 service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Updated VIF entry in instance network info cache for port 7e54d3ba-dd94-4d8c-adca-16b108135e54. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:41:55 user nova-compute[71321]: DEBUG nova.network.neutron [req-9ddf0e59-901b-4f04-be0f-753dcc1ad63d req-67c645b2-907a-4c1c-9167-962570eff584 service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Updating instance_info_cache with network_info: [{"id": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "address": "fa:16:3e:bc:a8:83", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e54d3ba-dd", "ovs_interfaceid": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:41:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9ddf0e59-901b-4f04-be0f-753dcc1ad63d req-67c645b2-907a-4c1c-9167-962570eff584 service nova] Releasing lock "refresh_cache-08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:41:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:41:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:41:57 user nova-compute[71321]: INFO nova.compute.manager [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Shelving
Apr 12 12:41:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:58 user nova-compute[71321]: DEBUG nova.compute.manager [req-603f9abc-28f2-421b-867f-8c585ed5bb21 req-054949a2-d0a2-48a1-89eb-f31a5ffab92c service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Received event network-vif-unplugged-7e54d3ba-dd94-4d8c-adca-16b108135e54 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:41:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-603f9abc-28f2-421b-867f-8c585ed5bb21 req-054949a2-d0a2-48a1-89eb-f31a5ffab92c service nova] Acquiring lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:41:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-603f9abc-28f2-421b-867f-8c585ed5bb21 req-054949a2-d0a2-48a1-89eb-f31a5ffab92c service nova] Lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:41:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-603f9abc-28f2-421b-867f-8c585ed5bb21 req-054949a2-d0a2-48a1-89eb-f31a5ffab92c service nova] Lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:41:58 user nova-compute[71321]: DEBUG nova.compute.manager [req-603f9abc-28f2-421b-867f-8c585ed5bb21 req-054949a2-d0a2-48a1-89eb-f31a5ffab92c service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] No waiting events found dispatching network-vif-unplugged-7e54d3ba-dd94-4d8c-adca-16b108135e54 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:41:58 user nova-compute[71321]: WARNING nova.compute.manager [req-603f9abc-28f2-421b-867f-8c585ed5bb21 req-054949a2-d0a2-48a1-89eb-f31a5ffab92c service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Received unexpected event network-vif-unplugged-7e54d3ba-dd94-4d8c-adca-16b108135e54 for instance with vm_state active and task_state shelving.
Apr 12 12:41:58 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Instance destroyed successfully.
Apr 12 12:41:58 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Beginning cold snapshot process
Apr 12 12:41:58 user nova-compute[71321]: DEBUG nova.privsep.utils [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 12:41:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk /opt/stack/data/nova/instances/snapshots/tmptcsds4pn/41e4e3b3140142ffb0d2fb84fe3af7e2 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:41:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "546c0c08-35f1-4043-ac30-56d49bc86af1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:41:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:41:59 user nova-compute[71321]: INFO nova.compute.manager [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Terminating instance
Apr 12 12:41:59 user nova-compute[71321]: DEBUG nova.compute.manager [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk /opt/stack/data/nova/instances/snapshots/tmptcsds4pn/41e4e3b3140142ffb0d2fb84fe3af7e2" returned: 0 in 0.588s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:41:59 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Snapshot extracted, beginning image upload
Apr 12 12:41:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:59 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Instance destroyed successfully.
Apr 12 12:41:59 user nova-compute[71321]: DEBUG nova.objects.instance [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lazy-loading 'resources' on Instance uuid 546c0c08-35f1-4043-ac30-56d49bc86af1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T12:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1139912608',display_name='tempest-ServerActionsTestJSON-server-548854806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1139912608',id=4,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9e64miZ/iyVASS4OS8AZthMPT8KBHm0byN/8NFP7U1AgI9/hOw/R+BSPozX14usgKt+VEqTE1BPs7aRGcfyuCZ/K0LBkD7enTbPYgw3NHHlO3PWScCWY1ae7IFb2uJEw==',key_name='tempest-keypair-1245622558',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:39:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ba5375005114c8594e0ae86b2f19093',ramdisk_id='',reservation_id='r-kvv9k7th',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1233797030',owner_user_name='tempest-ServerActionsTestJSON-1233797030-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:39:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29f7f46d32f4465ba3e8b504c645c22f',uuid=546c0c08-35f1-4043-ac30-56d49bc86af1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converting VIF {"id": "6f21df63-1895-4500-b119-c4670a7f3569", "address": "fa:16:3e:14:16:c4", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f21df63-18", "ovs_interfaceid": "6f21df63-1895-4500-b119-c4670a7f3569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f21df63-1895-4500-b119-c4670a7f3569,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21df63-18') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG os_vif [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f21df63-1895-4500-b119-c4670a7f3569,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21df63-18') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f21df63-18, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:41:59 user nova-compute[71321]: INFO os_vif [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:16:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f21df63-1895-4500-b119-c4670a7f3569,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f21df63-18')
Apr 12 12:41:59 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TonhIRZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:41:59 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:41:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[492a5542-731d-41bf-a43b-beb133b29ee8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:41:59 user nova-compute[71321]: No targets found.
Apr 12 12:41:59 user nova-compute[71321]: iSNS:
Apr 12 12:41:59 user nova-compute[71321]: No targets found.
Apr 12 12:41:59 user nova-compute[71321]: STATIC:
Apr 12 12:41:59 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f
Apr 12 12:41:59 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:41:59 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:41:59 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5
Apr 12 12:41:59 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:41:59 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:41:59 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b
Apr 12 12:41:59 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:41:59 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:41:59 user nova-compute[71321]: FIRMWARE:
Apr 12 12:41:59 user nova-compute[71321]: No targets found.
Apr 12 12:41:59 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:41:59 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:41:59 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d542285e-52f8-4933-b53b-e8d539da3df3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[790a09df-ffe0-4db8-86be-9e9797ff9ecb]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)
Apr 12 12:41:59 user nova-compute[71321]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)
Apr 12 12:41:59 user nova-compute[71321]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:41:59 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)
Apr 12 12:41:59 user nova-compute[71321]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f (non-flash)
Apr 12 12:41:59 user nova-compute[71321]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:41:59 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef4436bac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f'): ({'sdc'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Removing single pathed devices sdc {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7df31a-1350-4134-abc7-0fe5cd93a37f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9924cd10-fa63-4281-8847-5cc0fc0a4bb1]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Flushing IO for device /dev/sdc {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[db97f37b-e338-437d-851d-10a0ce6ec1e4]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:41:59 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3308543-cb6d-456e-8fc2-4bf126485ad2]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] SCSI volumes sdc have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[234108bd-c296-4f73-883c-93074bbc94d9]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c621847-890e-43c7-a606-f8707d773fae]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f, portal: 172.16.0.220,3260]
Apr 12 12:42:00 user nova-compute[71321]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f, portal: 172.16.0.220,3260] successful.
Apr 12 12:42:00 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285a2e71-c724-427a-94a8-d0f646e9083f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2462d055-3781-42c9-a77a-2c952127202b]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] <== disconnect_volume: return (328ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:42:00 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Deleting instance files /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1_del
Apr 12 12:42:00 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Deletion of /opt/stack/data/nova/instances/546c0c08-35f1-4043-ac30-56d49bc86af1_del complete
Apr 12 12:42:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG nova.compute.manager [req-f5a84fad-ed25-4925-9e00-64e206bbee98 req-5ce08749-b0b8-45cd-875a-2b0c64a480e7 service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Received event network-vif-plugged-7e54d3ba-dd94-4d8c-adca-16b108135e54 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f5a84fad-ed25-4925-9e00-64e206bbee98 req-5ce08749-b0b8-45cd-875a-2b0c64a480e7 service nova] Acquiring lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f5a84fad-ed25-4925-9e00-64e206bbee98 req-5ce08749-b0b8-45cd-875a-2b0c64a480e7 service nova] Lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f5a84fad-ed25-4925-9e00-64e206bbee98 req-5ce08749-b0b8-45cd-875a-2b0c64a480e7 service nova] Lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG nova.compute.manager [req-f5a84fad-ed25-4925-9e00-64e206bbee98 req-5ce08749-b0b8-45cd-875a-2b0c64a480e7 service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] No waiting events found dispatching network-vif-plugged-7e54d3ba-dd94-4d8c-adca-16b108135e54 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:42:00 user nova-compute[71321]: WARNING nova.compute.manager [req-f5a84fad-ed25-4925-9e00-64e206bbee98 req-5ce08749-b0b8-45cd-875a-2b0c64a480e7 service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Received unexpected event network-vif-plugged-7e54d3ba-dd94-4d8c-adca-16b108135e54 for instance with vm_state active and task_state shelving_image_uploading.
Apr 12 12:42:00 user nova-compute[71321]: DEBUG nova.compute.manager [req-f5a84fad-ed25-4925-9e00-64e206bbee98 req-5ce08749-b0b8-45cd-875a-2b0c64a480e7 service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received event network-vif-unplugged-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f5a84fad-ed25-4925-9e00-64e206bbee98 req-5ce08749-b0b8-45cd-875a-2b0c64a480e7 service nova] Acquiring lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f5a84fad-ed25-4925-9e00-64e206bbee98 req-5ce08749-b0b8-45cd-875a-2b0c64a480e7 service nova] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f5a84fad-ed25-4925-9e00-64e206bbee98 req-5ce08749-b0b8-45cd-875a-2b0c64a480e7 service nova] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG nova.compute.manager [req-f5a84fad-ed25-4925-9e00-64e206bbee98 req-5ce08749-b0b8-45cd-875a-2b0c64a480e7 service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] No waiting events found dispatching network-vif-unplugged-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG nova.compute.manager [req-f5a84fad-ed25-4925-9e00-64e206bbee98 req-5ce08749-b0b8-45cd-875a-2b0c64a480e7 service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received event network-vif-unplugged-6f21df63-1895-4500-b119-c4670a7f3569 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG nova.compute.manager [req-f5a84fad-ed25-4925-9e00-64e206bbee98 req-5ce08749-b0b8-45cd-875a-2b0c64a480e7 service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received event network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f5a84fad-ed25-4925-9e00-64e206bbee98 req-5ce08749-b0b8-45cd-875a-2b0c64a480e7 service nova] Acquiring lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f5a84fad-ed25-4925-9e00-64e206bbee98 req-5ce08749-b0b8-45cd-875a-2b0c64a480e7 service nova] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f5a84fad-ed25-4925-9e00-64e206bbee98 req-5ce08749-b0b8-45cd-875a-2b0c64a480e7 service nova] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG nova.compute.manager [req-f5a84fad-ed25-4925-9e00-64e206bbee98 req-5ce08749-b0b8-45cd-875a-2b0c64a480e7 service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] No waiting events found dispatching network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:42:00 user nova-compute[71321]: WARNING nova.compute.manager [req-f5a84fad-ed25-4925-9e00-64e206bbee98 req-5ce08749-b0b8-45cd-875a-2b0c64a480e7 service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received unexpected event network-vif-plugged-6f21df63-1895-4500-b119-c4670a7f3569 for instance with vm_state active and task_state deleting.
Apr 12 12:42:00 user nova-compute[71321]: INFO nova.compute.manager [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Took 1.22 seconds to destroy the instance on the hypervisor.
Apr 12 12:42:00 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:42:00 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:42:00 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Took 0.69 seconds to deallocate network for instance.
Apr 12 12:42:01 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Snapshot image upload complete
Apr 12 12:42:01 user nova-compute[71321]: DEBUG nova.compute.manager [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:42:01 user nova-compute[71321]: INFO nova.compute.manager [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Shelve offloading
Apr 12 12:42:01 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Instance destroyed successfully.
Apr 12 12:42:01 user nova-compute[71321]: DEBUG nova.compute.manager [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:42:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "refresh_cache-08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:42:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquired lock "refresh_cache-08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:42:01 user nova-compute[71321]: DEBUG nova.network.neutron [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:42:01 user nova-compute[71321]: INFO nova.compute.manager [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Took 0.87 seconds to detach 1 volumes for instance.
Apr 12 12:42:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:42:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:42:02 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:42:02 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:42:02 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.215s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:42:02 user nova-compute[71321]: DEBUG nova.network.neutron [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Updating instance_info_cache with network_info: [{"id": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "address": "fa:16:3e:bc:a8:83", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e54d3ba-dd", "ovs_interfaceid": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:42:02 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Releasing lock "refresh_cache-08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:42:02 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Deleted allocations for instance 546c0c08-35f1-4043-ac30-56d49bc86af1
Apr 12 12:42:02 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "546c0c08-35f1-4043-ac30-56d49bc86af1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.206s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:42:02 user nova-compute[71321]: DEBUG nova.compute.manager [req-888a4625-4ce3-43e5-aa86-f6c72a919ad0 req-42b1d487-0088-467d-9350-0cf14606ba07 service nova] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Received event network-vif-deleted-6f21df63-1895-4500-b119-c4670a7f3569 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:42:03 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Instance destroyed successfully.
Apr 12 12:42:03 user nova-compute[71321]: DEBUG nova.objects.instance [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lazy-loading 'resources' on Instance uuid 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:42:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:40:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-615902404',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-615902404',id=26,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEkOEoNk45Nbu+gKXPJrgeuFyxP14yDmjujq5KBzAf1jdooM7if7PjnwRiQIghyJu3/D7EhyMQG3CM2jiTOS6YDsVIzsRhBe/9QtuVP0Mga6D+4x7iy56z4kNHaQEC8tg==',key_name='tempest-keypair-2116396079',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:40:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5fec0c6dc7ab46b0b6b0a580252f40e3',ramdisk_id='',reservation_id='r-hw62w5cz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2036744628',owner_user_name='tempest-AttachVolumeShelveTestJSON-2036744628-project-member',shelved_at='2023-04-12T12:42:01.476045',shelved_host='user',shelved_image_id='25818f81-d64c-4887-9b8b-a235c7f23e54'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:41:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e4935eed324b868477f8e88918364a',uuid=08f95333-8c01-4fb1-a2cb-4501e6b0d2a5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "address": "fa:16:3e:bc:a8:83", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e54d3ba-dd", "ovs_interfaceid": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:42:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Converting VIF {"id": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "address": "fa:16:3e:bc:a8:83", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e54d3ba-dd", "ovs_interfaceid": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:42:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:a8:83,bridge_name='br-int',has_traffic_filtering=True,id=7e54d3ba-dd94-4d8c-adca-16b108135e54,network=Network(4ba97279-e122-4c2b-b931-dde33e1d71df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e54d3ba-dd') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:42:03 user nova-compute[71321]: DEBUG os_vif [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:a8:83,bridge_name='br-int',has_traffic_filtering=True,id=7e54d3ba-dd94-4d8c-adca-16b108135e54,network=Network(4ba97279-e122-4c2b-b931-dde33e1d71df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e54d3ba-dd') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:42:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e54d3ba-dd, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:42:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:42:03 user nova-compute[71321]: INFO os_vif [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:a8:83,bridge_name='br-int',has_traffic_filtering=True,id=7e54d3ba-dd94-4d8c-adca-16b108135e54,network=Network(4ba97279-e122-4c2b-b931-dde33e1d71df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e54d3ba-dd')
Apr 12 12:42:03 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Deleting instance files /opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5_del
Apr 12 12:42:03 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Deletion of /opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5_del complete
Apr 12 12:42:03 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Deleted allocations for instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5
Apr 12 12:42:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:42:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:42:03 user nova-compute[71321]: DEBUG nova.objects.instance [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lazy-loading 'numa_topology' on Instance uuid 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:42:03 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:42:03 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:42:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:42:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.713s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:42:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:05 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681303310.1758313, 8403a098-a141-4feb-9eed-3731e2c7c152 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:42:05 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] VM Stopped (Lifecycle Event)
Apr 12 12:42:05 user nova-compute[71321]: DEBUG nova.compute.manager [None req-299ee452-adcd-4d11-a73d-68da5fedbc3b None None] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:42:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:12 user nova-compute[71321]: DEBUG nova.compute.manager [req-0d29ee6c-b47b-4e83-866d-0b9f6fafec8c req-b015f658-23a5-420a-a1e7-7a0f5aa473f8 service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Received event network-changed-f6d914f7-c468-4bda-80d4-b6f37e3bea3c {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:42:12 user nova-compute[71321]: DEBUG nova.compute.manager [req-0d29ee6c-b47b-4e83-866d-0b9f6fafec8c req-b015f658-23a5-420a-a1e7-7a0f5aa473f8 service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Refreshing instance network info cache due to event network-changed-f6d914f7-c468-4bda-80d4-b6f37e3bea3c. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:42:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0d29ee6c-b47b-4e83-866d-0b9f6fafec8c req-b015f658-23a5-420a-a1e7-7a0f5aa473f8 service nova] Acquiring lock "refresh_cache-2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:42:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0d29ee6c-b47b-4e83-866d-0b9f6fafec8c req-b015f658-23a5-420a-a1e7-7a0f5aa473f8 service nova] Acquired lock "refresh_cache-2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:42:12 user nova-compute[71321]: DEBUG nova.network.neutron [req-0d29ee6c-b47b-4e83-866d-0b9f6fafec8c req-b015f658-23a5-420a-a1e7-7a0f5aa473f8 service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Refreshing network info cache for port f6d914f7-c468-4bda-80d4-b6f37e3bea3c {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:42:13 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:13 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681303318.3242333, 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:42:13 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] VM Stopped (Lifecycle Event)
Apr 12 12:42:13 user nova-compute[71321]: DEBUG nova.compute.manager [None req-6681ef4b-4c81-4543-ac3e-aed30d710a17 None None] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:42:13 user nova-compute[71321]: DEBUG nova.network.neutron [req-0d29ee6c-b47b-4e83-866d-0b9f6fafec8c req-b015f658-23a5-420a-a1e7-7a0f5aa473f8 service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Updated VIF entry in instance network info cache for port f6d914f7-c468-4bda-80d4-b6f37e3bea3c. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:42:13 user nova-compute[71321]: DEBUG nova.network.neutron [req-0d29ee6c-b47b-4e83-866d-0b9f6fafec8c req-b015f658-23a5-420a-a1e7-7a0f5aa473f8 service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Updating instance_info_cache with network_info: [{"id": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c", "address": "fa:16:3e:ab:22:27", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d914f7-c4", "ovs_interfaceid": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:42:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0d29ee6c-b47b-4e83-866d-0b9f6fafec8c req-b015f658-23a5-420a-a1e7-7a0f5aa473f8 service nova] Releasing lock "refresh_cache-2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:42:14 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681303319.7736416, 546c0c08-35f1-4043-ac30-56d49bc86af1 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:42:14 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] VM Stopped (Lifecycle Event)
Apr 12 12:42:14 user nova-compute[71321]: DEBUG nova.compute.manager [None req-ef19eb71-d144-4303-a7c4-fe41592c8a5b None None] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:42:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "88e09fde-0a42-4066-b1f5-413903476735" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:42:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "88e09fde-0a42-4066-b1f5-413903476735" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:42:20 user nova-compute[71321]: DEBUG nova.compute.manager [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:42:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:42:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:42:20 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:42:20 user nova-compute[71321]: INFO nova.compute.claims [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Claim successful on node user
Apr 12 12:42:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:20 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:42:20 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:42:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.320s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:42:20 user nova-compute[71321]: DEBUG nova.compute.manager [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:42:20 user nova-compute[71321]: DEBUG nova.compute.manager [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:42:20 user nova-compute[71321]: DEBUG nova.network.neutron [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:42:20 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:42:20 user nova-compute[71321]: DEBUG nova.compute.manager [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:42:20 user nova-compute[71321]: DEBUG nova.policy [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '076e65b43f664765ad1d48be6e814f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ada441da2124adda751365952320e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:42:20 user nova-compute[71321]: INFO nova.virt.block_device [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Booting with volume 8d51c851-3ddf-4ff7-bdc0-982cf356bc0d at /dev/vda
Apr 12 12:42:20 user nova-compute[71321]: DEBUG os_brick.utils [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:42:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d336a4-c192-43e5-9c21-28eaaf274dbd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:42:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d060e358-b604-4975-802d-60d91d1bc117]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:42:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0715a3-68d8-4e1b-96b7-f1c137974b3c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:42:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1a451e-ef45-4255-98e4-573f1ad4b2e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:42:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:42:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:42:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:42:20 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:42:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[977a88db-d664-42a7-8a80-dea5e555411b]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:42:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:42:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:42:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:42:20 user nova-compute[71321]: DEBUG os_brick.utils [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:42:20 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Updating existing volume attachment record: bb08c292-e45d-4daf-acfb-09a5fdede88d {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:42:21 user nova-compute[71321]: DEBUG nova.network.neutron [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Successfully created port: bf3129f6-4466-41a8-a974-86182f2e209e {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:42:21 user nova-compute[71321]: DEBUG nova.network.neutron [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Successfully updated port: bf3129f6-4466-41a8-a974-86182f2e209e {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:42:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "refresh_cache-88e09fde-0a42-4066-b1f5-413903476735" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:42:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquired lock "refresh_cache-88e09fde-0a42-4066-b1f5-413903476735" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:42:21 user nova-compute[71321]: DEBUG nova.network.neutron [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:42:22 user nova-compute[71321]: DEBUG nova.compute.manager [req-ab2af09b-0a20-4a9a-acb8-29ed4954f7a2 req-11e5678d-3599-4e88-b402-4db0c8b17050 service nova] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Received event network-changed-bf3129f6-4466-41a8-a974-86182f2e209e {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:42:22 user nova-compute[71321]: DEBUG nova.compute.manager [req-ab2af09b-0a20-4a9a-acb8-29ed4954f7a2 req-11e5678d-3599-4e88-b402-4db0c8b17050 service nova] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Refreshing instance network info cache due to event network-changed-bf3129f6-4466-41a8-a974-86182f2e209e. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:42:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ab2af09b-0a20-4a9a-acb8-29ed4954f7a2 req-11e5678d-3599-4e88-b402-4db0c8b17050 service nova] Acquiring lock "refresh_cache-88e09fde-0a42-4066-b1f5-413903476735" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:42:22 user nova-compute[71321]: DEBUG nova.network.neutron [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:42:22 user nova-compute[71321]: DEBUG nova.network.neutron [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Updating instance_info_cache with network_info: [{"id": "bf3129f6-4466-41a8-a974-86182f2e209e", "address": "fa:16:3e:07:2e:ee", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf3129f6-44", "ovs_interfaceid": "bf3129f6-4466-41a8-a974-86182f2e209e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:42:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Releasing lock "refresh_cache-88e09fde-0a42-4066-b1f5-413903476735" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:42:22 user nova-compute[71321]: DEBUG nova.compute.manager [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Instance network_info: |[{"id": "bf3129f6-4466-41a8-a974-86182f2e209e", "address": "fa:16:3e:07:2e:ee", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf3129f6-44", "ovs_interfaceid": "bf3129f6-4466-41a8-a974-86182f2e209e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:42:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ab2af09b-0a20-4a9a-acb8-29ed4954f7a2 req-11e5678d-3599-4e88-b402-4db0c8b17050 service nova] Acquired lock "refresh_cache-88e09fde-0a42-4066-b1f5-413903476735" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:42:22 user nova-compute[71321]: DEBUG nova.network.neutron [req-ab2af09b-0a20-4a9a-acb8-29ed4954f7a2 req-11e5678d-3599-4e88-b402-4db0c8b17050 service nova] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Refreshing network info cache for port bf3129f6-4466-41a8-a974-86182f2e209e {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:42:22 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:42:22 user nova-compute[71321]: DEBUG nova.network.neutron [req-ab2af09b-0a20-4a9a-acb8-29ed4954f7a2 req-11e5678d-3599-4e88-b402-4db0c8b17050 service nova] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Updated VIF entry in instance network info cache for port bf3129f6-4466-41a8-a974-86182f2e209e. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:42:22 user nova-compute[71321]: DEBUG nova.network.neutron [req-ab2af09b-0a20-4a9a-acb8-29ed4954f7a2 req-11e5678d-3599-4e88-b402-4db0c8b17050 service nova] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Updating instance_info_cache with network_info: [{"id": "bf3129f6-4466-41a8-a974-86182f2e209e", "address": "fa:16:3e:07:2e:ee", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf3129f6-44", "ovs_interfaceid": "bf3129f6-4466-41a8-a974-86182f2e209e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:42:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ab2af09b-0a20-4a9a-acb8-29ed4954f7a2 req-11e5678d-3599-4e88-b402-4db0c8b17050 service nova] Releasing lock "refresh_cache-88e09fde-0a42-4066-b1f5-413903476735" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:42:23 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:23 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:42:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:42:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:42:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:42:23 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:42:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:23 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:42:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:24 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:42:25 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:42:25 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:42:25 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8355MB free_disk=26.445079803466797GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 10116da0-785c-41cf-96bb-95721af863db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance a4107f2d-88e4-4846-9ece-cb16ad7ecd02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 88e09fde-0a42-4066-b1f5-413903476735 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG nova.compute.manager [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:42:25 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Creating image(s)
Apr 12 12:42:25 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Did not create local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Ensure instance console log exists: /opt/stack/data/nova/instances/88e09fde-0a42-4066-b1f5-413903476735/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Start _get_guest_xml network_info=[{"id": "bf3129f6-4466-41a8-a974-86182f2e209e", "address": "fa:16:3e:07:2e:ee", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf3129f6-44", "ovs_interfaceid": "bf3129f6-4466-41a8-a974-86182f2e209e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'bb08c292-e45d-4daf-acfb-09a5fdede88d', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bVSoJMNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '88e09fde-0a42-4066-b1f5-413903476735', 'attached_at': '', 'detached_at': '', 'volume_id': '8d51c851-3ddf-4ff7-bdc0-982cf356bc0d', 'serial': '8d51c851-3ddf-4ff7-bdc0-982cf356bc0d'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:42:25 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:42:25 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:42:25 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bVSoJMNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:42:25 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:42:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:42:25 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:42:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:42:25 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd0b4b6-fd00-430b-a5d0-870df794c9a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:42:25 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[343a19bc-362a-478b-b840-254e24c78e7e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d] added
Apr 12 12:42:25 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abf7f03-3a5d-4ed2-81c7-6eed84493ca3]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d6045f-a752-41d8-824c-23d3ea6383da]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bVSoJMNE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bVSoJMNE" returned: 0 in 0.038s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb0ea55-8821-45ce-b395-c1c744c50ebd]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bVSoJMNE'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.120s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0027fa-9554-4b22-adca-11579654e1fc]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.624s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c1497c-9796-46e9-80a0-2623e66ed914]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)
Apr 12 12:42:25 user nova-compute[71321]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:42:25 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)
Apr 12 12:42:25 user nova-compute[71321]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:42:25 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee744ffc-7969-49b9-abb8-fa5eeebc8340]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d, portal: 172.16.0.220,3260]
Apr 12 12:42:25 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d, portal: 172.16.0.220,3260] successful.
Apr 12 12:42:25 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c76249-9c90-4cff-9e24-c13f13b58022]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e60d7c1-c8bb-4265-939e-bec00a1f21cb]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)
Apr 12 12:42:25 user nova-compute[71321]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:42:25 user nova-compute[71321]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d (non-flash)
Apr 12 12:42:25 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)
Apr 12 12:42:25 user nova-compute[71321]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:42:25 user nova-compute[71321]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d (non-flash)
Apr 12 12:42:25 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.486s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:42:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:26 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a861ab2d-3f1b-4923-abe3-d5ad212b7734]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:42:26 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:42:26 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bVSoJMNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:42:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.529s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:42:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] <== connect_volume: return (1531ms) {'type': 'block', 'scsi_wwn': '26561353736643161', 'path': '/dev/sdc'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:42:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561353736643161', 'path': '/dev/sdc'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:42:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:42:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-55213853',display_name='tempest-TestVolumeBootPattern-server-55213853',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-55213853',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsgnjp9DU7mhDKOnejfarx74lKPsdA7XFVVac0IXQsHunQgmiZdnkpBnb9o+2GfDpfLr3Vtu/GonERs5AS6wpKwmtd3eb4XJchkGev4GCvYiSWT7o/Zl3+nrrnYoAMm1w==',key_name='tempest-TestVolumeBootPattern-1044387718',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ada441da2124adda751365952320e81',ramdisk_id='',reservation_id='r-0orssmtm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-310589135',owner_user_name='tempest-TestVolumeBootPattern-310589135-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:42:21Z,user_data=None,user_id='076e65b43f664765ad1d48be6e814f40',uuid=88e09fde-0a42-4066-b1f5-413903476735,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf3129f6-4466-41a8-a974-86182f2e209e", "address": "fa:16:3e:07:2e:ee", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf3129f6-44", "ovs_interfaceid": "bf3129f6-4466-41a8-a974-86182f2e209e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:42:27 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converting VIF {"id": "bf3129f6-4466-41a8-a974-86182f2e209e", "address": "fa:16:3e:07:2e:ee", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf3129f6-44", "ovs_interfaceid": "bf3129f6-4466-41a8-a974-86182f2e209e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:42:27 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:2e:ee,bridge_name='br-int',has_traffic_filtering=True,id=bf3129f6-4466-41a8-a974-86182f2e209e,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf3129f6-44') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:42:27 user nova-compute[71321]: DEBUG nova.objects.instance [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lazy-loading 'pci_devices' on Instance uuid 88e09fde-0a42-4066-b1f5-413903476735 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:42:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:42:27 user nova-compute[71321]:   <uuid>88e09fde-0a42-4066-b1f5-413903476735</uuid>
Apr 12 12:42:27 user nova-compute[71321]:   <name>instance-0000001c</name>
Apr 12 12:42:27 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:42:27 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:42:27 user nova-compute[71321]:   <metadata>
Apr 12 12:42:27 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:42:27 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:42:27 user nova-compute[71321]:       <nova:name>tempest-TestVolumeBootPattern-server-55213853</nova:name>
Apr 12 12:42:27 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:42:25</nova:creationTime>
Apr 12 12:42:27 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:42:27 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:42:27 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:42:27 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:42:27 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:42:27 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:42:27 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:42:27 user nova-compute[71321]:       <nova:owner>
Apr 12 12:42:27 user nova-compute[71321]:         <nova:user uuid="076e65b43f664765ad1d48be6e814f40">tempest-TestVolumeBootPattern-310589135-project-member</nova:user>
Apr 12 12:42:27 user nova-compute[71321]:         <nova:project uuid="5ada441da2124adda751365952320e81">tempest-TestVolumeBootPattern-310589135</nova:project>
Apr 12 12:42:27 user nova-compute[71321]:       </nova:owner>
Apr 12 12:42:27 user nova-compute[71321]:       <nova:ports>
Apr 12 12:42:27 user nova-compute[71321]:         <nova:port uuid="bf3129f6-4466-41a8-a974-86182f2e209e">
Apr 12 12:42:27 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 12:42:27 user nova-compute[71321]:         </nova:port>
Apr 12 12:42:27 user nova-compute[71321]:       </nova:ports>
Apr 12 12:42:27 user nova-compute[71321]:     </nova:instance>
Apr 12 12:42:27 user nova-compute[71321]:   </metadata>
Apr 12 12:42:27 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:42:27 user nova-compute[71321]:     <system>
Apr 12 12:42:27 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:42:27 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:42:27 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:42:27 user nova-compute[71321]:       <entry name="serial">88e09fde-0a42-4066-b1f5-413903476735</entry>
Apr 12 12:42:27 user nova-compute[71321]:       <entry name="uuid">88e09fde-0a42-4066-b1f5-413903476735</entry>
Apr 12 12:42:27 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:42:27 user nova-compute[71321]:     </system>
Apr 12 12:42:27 user nova-compute[71321]:   </sysinfo>
Apr 12 12:42:27 user nova-compute[71321]:   <os>
Apr 12 12:42:27 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:42:27 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:42:27 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:42:27 user nova-compute[71321]:   </os>
Apr 12 12:42:27 user nova-compute[71321]:   <features>
Apr 12 12:42:27 user nova-compute[71321]:     <acpi/>
Apr 12 12:42:27 user nova-compute[71321]:     <apic/>
Apr 12 12:42:27 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:42:27 user nova-compute[71321]:   </features>
Apr 12 12:42:27 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:42:27 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:42:27 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:42:27 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:42:27 user nova-compute[71321]:   </clock>
Apr 12 12:42:27 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:42:27 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:42:27 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:42:27 user nova-compute[71321]:   </cpu>
Apr 12 12:42:27 user nova-compute[71321]:   <devices>
Apr 12 12:42:27 user nova-compute[71321]:     <disk type="block" device="disk">
Apr 12 12:42:27 user nova-compute[71321]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:42:27 user nova-compute[71321]:       <source dev="/dev/sdc"/>
Apr 12 12:42:27 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:42:27 user nova-compute[71321]:       <serial>8d51c851-3ddf-4ff7-bdc0-982cf356bc0d</serial>
Apr 12 12:42:27 user nova-compute[71321]:     </disk>
Apr 12 12:42:27 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:42:27 user nova-compute[71321]:       <mac address="fa:16:3e:07:2e:ee"/>
Apr 12 12:42:27 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:42:27 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:42:27 user nova-compute[71321]:       <target dev="tapbf3129f6-44"/>
Apr 12 12:42:27 user nova-compute[71321]:     </interface>
Apr 12 12:42:27 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:42:27 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/88e09fde-0a42-4066-b1f5-413903476735/console.log" append="off"/>
Apr 12 12:42:27 user nova-compute[71321]:     </serial>
Apr 12 12:42:27 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:42:27 user nova-compute[71321]:     <video>
Apr 12 12:42:27 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:42:27 user nova-compute[71321]:     </video>
Apr 12 12:42:27 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:42:27 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:42:27 user nova-compute[71321]:     </rng>
Apr 12 12:42:27 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:42:27 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:42:27 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:42:27 user nova-compute[71321]:     </memballoon>
Apr 12 12:42:27 user nova-compute[71321]:   </devices>
Apr 12 12:42:27 user nova-compute[71321]: </domain>
Apr 12 12:42:27 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:42:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:42:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-55213853',display_name='tempest-TestVolumeBootPattern-server-55213853',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-55213853',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsgnjp9DU7mhDKOnejfarx74lKPsdA7XFVVac0IXQsHunQgmiZdnkpBnb9o+2GfDpfLr3Vtu/GonERs5AS6wpKwmtd3eb4XJchkGev4GCvYiSWT7o/Zl3+nrrnYoAMm1w==',key_name='tempest-TestVolumeBootPattern-1044387718',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ada441da2124adda751365952320e81',ramdisk_id='',reservation_id='r-0orssmtm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-310589135',owner_user_name='tempest-TestVolumeBootPattern-310589135-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:42:21Z,user_data=None,user_id='076e65b43f664765ad1d48be6e814f40',uuid=88e09fde-0a42-4066-b1f5-413903476735,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf3129f6-4466-41a8-a974-86182f2e209e", "address": "fa:16:3e:07:2e:ee", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf3129f6-44", "ovs_interfaceid": "bf3129f6-4466-41a8-a974-86182f2e209e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:42:27 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converting VIF {"id": "bf3129f6-4466-41a8-a974-86182f2e209e", "address": "fa:16:3e:07:2e:ee", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf3129f6-44", "ovs_interfaceid": "bf3129f6-4466-41a8-a974-86182f2e209e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:42:27 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:2e:ee,bridge_name='br-int',has_traffic_filtering=True,id=bf3129f6-4466-41a8-a974-86182f2e209e,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf3129f6-44') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:42:27 user nova-compute[71321]: DEBUG os_vif [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:2e:ee,bridge_name='br-int',has_traffic_filtering=True,id=bf3129f6-4466-41a8-a974-86182f2e209e,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf3129f6-44') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:42:27 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:27 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:42:27 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:42:27 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:27 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf3129f6-44, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:42:27 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbf3129f6-44, col_values=(('external_ids', {'iface-id': 'bf3129f6-4466-41a8-a974-86182f2e209e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:2e:ee', 'vm-uuid': '88e09fde-0a42-4066-b1f5-413903476735'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:42:27 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:27 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:42:27 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:27 user nova-compute[71321]: INFO os_vif [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:2e:ee,bridge_name='br-int',has_traffic_filtering=True,id=bf3129f6-4466-41a8-a974-86182f2e209e,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf3129f6-44')
Apr 12 12:42:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:42:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] No VIF found with MAC fa:16:3e:07:2e:ee, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:42:27 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:42:27 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:42:27 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:42:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-a4107f2d-88e4-4846-9ece-cb16ad7ecd02" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:42:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-a4107f2d-88e4-4846-9ece-cb16ad7ecd02" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:42:27 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 12:42:28 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Updating instance_info_cache with network_info: [{"id": "5680054b-9363-4825-ade2-add800d7142b", "address": "fa:16:3e:08:27:b7", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5680054b-93", "ovs_interfaceid": "5680054b-9363-4825-ade2-add800d7142b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:42:28 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-a4107f2d-88e4-4846-9ece-cb16ad7ecd02" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:42:28 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 12:42:28 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:42:28 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:42:28 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:42:28 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:42:28 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:42:28 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:28 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:28 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:28 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:28 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:28 user nova-compute[71321]: DEBUG nova.compute.manager [req-68069ae5-3e9c-47bb-b365-5663ccaf4e26 req-741d1ee9-1fd3-4fb1-883c-a0a9989c37c7 service nova] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Received event network-vif-plugged-bf3129f6-4466-41a8-a974-86182f2e209e {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:42:28 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-68069ae5-3e9c-47bb-b365-5663ccaf4e26 req-741d1ee9-1fd3-4fb1-883c-a0a9989c37c7 service nova] Acquiring lock "88e09fde-0a42-4066-b1f5-413903476735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:42:28 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-68069ae5-3e9c-47bb-b365-5663ccaf4e26 req-741d1ee9-1fd3-4fb1-883c-a0a9989c37c7 service nova] Lock "88e09fde-0a42-4066-b1f5-413903476735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:42:28 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-68069ae5-3e9c-47bb-b365-5663ccaf4e26 req-741d1ee9-1fd3-4fb1-883c-a0a9989c37c7 service nova] Lock "88e09fde-0a42-4066-b1f5-413903476735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:42:28 user nova-compute[71321]: DEBUG nova.compute.manager [req-68069ae5-3e9c-47bb-b365-5663ccaf4e26 req-741d1ee9-1fd3-4fb1-883c-a0a9989c37c7 service nova] [instance: 88e09fde-0a42-4066-b1f5-413903476735] No waiting events found dispatching network-vif-plugged-bf3129f6-4466-41a8-a974-86182f2e209e {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:42:28 user nova-compute[71321]: WARNING nova.compute.manager [req-68069ae5-3e9c-47bb-b365-5663ccaf4e26 req-741d1ee9-1fd3-4fb1-883c-a0a9989c37c7 service nova] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Received unexpected event network-vif-plugged-bf3129f6-4466-41a8-a974-86182f2e209e for instance with vm_state building and task_state spawning.
Apr 12 12:42:28 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "89cc5f86-c387-4966-8bbf-a64d42d30db7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:42:30 user nova-compute[71321]: INFO nova.compute.manager [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Detaching volume 2695aae0-2bb7-41a8-9f06-dd2df4aba06b
Apr 12 12:42:30 user nova-compute[71321]: INFO nova.virt.block_device [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Attempting to driver detach volume 2695aae0-2bb7-41a8-9f06-dd2df4aba06b from mountpoint /dev/vdb
Apr 12 12:42:30 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Attempting to detach device vdb from instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 from the persistent domain config. {{(pid=71321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:42:30 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:42:30 user nova-compute[71321]:   <source dev="/dev/sdb"/>
Apr 12 12:42:30 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:42:30 user nova-compute[71321]:   <serial>2695aae0-2bb7-41a8-9f06-dd2df4aba06b</serial>
Apr 12 12:42:30 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 12:42:30 user nova-compute[71321]: </disk>
Apr 12 12:42:30 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:42:30 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Successfully detached device vdb from instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 from the persistent domain config.
Apr 12 12:42:30 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 from the live domain config. {{(pid=71321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:42:30 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:42:30 user nova-compute[71321]:   <source dev="/dev/sdb"/>
Apr 12 12:42:30 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:42:30 user nova-compute[71321]:   <serial>2695aae0-2bb7-41a8-9f06-dd2df4aba06b</serial>
Apr 12 12:42:30 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 12:42:30 user nova-compute[71321]: </disk>
Apr 12 12:42:30 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Received event <DeviceRemovedEvent: 1681303350.5649502, 89cc5f86-c387-4966-8bbf-a64d42d30db7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 {{(pid=71321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 12:42:30 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Successfully detached device vdb from instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 from the live domain config.
Apr 12 12:42:30 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZGHsSNtk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:42:30 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:42:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f6808e-cd5c-4da3-98b4-0cdc80a63cf4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:42:30 user nova-compute[71321]: No targets found.
Apr 12 12:42:30 user nova-compute[71321]: iSNS:
Apr 12 12:42:30 user nova-compute[71321]: No targets found.
Apr 12 12:42:30 user nova-compute[71321]: STATIC:
Apr 12 12:42:30 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5
Apr 12 12:42:30 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:42:30 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:42:30 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b
Apr 12 12:42:30 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:42:30 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:42:30 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d
Apr 12 12:42:30 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:42:30 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:42:30 user nova-compute[71321]: FIRMWARE:
Apr 12 12:42:30 user nova-compute[71321]: No targets found.
Apr 12 12:42:30 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:42:30 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:42:30 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b933592-db8c-4337-bd04-9a8a11378fe6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303350.6268573, 88e09fde-0a42-4066-b1f5-413903476735 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:42:30 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 88e09fde-0a42-4066-b1f5-413903476735] VM Resumed (Lifecycle Event)
Apr 12 12:42:30 user nova-compute[71321]: DEBUG nova.compute.manager [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:42:30 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Instance spawned successfully.
Apr 12 12:42:30 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[43003c02-54ce-461b-8253-626f53facf6b]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)
Apr 12 12:42:30 user nova-compute[71321]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:42:30 user nova-compute[71321]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d (non-flash)
Apr 12 12:42:30 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b (non-flash)
Apr 12 12:42:30 user nova-compute[71321]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:42:30 user nova-compute[71321]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d (non-flash)
Apr 12 12:42:30 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef64184430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b'): ({'sdb'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Removing single pathed devices sdb {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:42:30 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 88e09fde-0a42-4066-b1f5-413903476735] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:42:30 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303350.6278858, 88e09fde-0a42-4066-b1f5-413903476735 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:42:30 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 88e09fde-0a42-4066-b1f5-413903476735] VM Started (Lifecycle Event)
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f86dc0b-6933-4136-81de-c7f96670a288]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79809ec-1802-4b1b-888d-0fdb15a130f2]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Flushing IO for device /dev/sdb {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[509e604b-9496-4be2-8dcd-22b29561e15e]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:30 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 88e09fde-0a42-4066-b1f5-413903476735] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:42:30 user nova-compute[71321]: INFO nova.compute.manager [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Took 5.35 seconds to spawn the instance on the hypervisor.
Apr 12 12:42:30 user nova-compute[71321]: DEBUG nova.compute.manager [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b352ab-c07d-4fb2-a1d7-74c8877d19b5]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] SCSI volumes sdb have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e50b0dd-f124-4d0b-bd49-37354d75331a]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:30 user nova-compute[71321]: INFO nova.compute.manager [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Took 10.76 seconds to build instance.
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed55cb1-2cfb-44a0-97c9-0162c4a5028f]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b, portal: 172.16.0.220,3260]
Apr 12 12:42:30 user nova-compute[71321]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b, portal: 172.16.0.220,3260] successful.
Apr 12 12:42:30 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "88e09fde-0a42-4066-b1f5-413903476735" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.862s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2695aae0-2bb7-41a8-9f06-dd2df4aba06b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9649b8c8-c9e9-45ad-9e5e-3e398429df73]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] <== disconnect_volume: return (314ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG nova.compute.manager [req-7e7c90c0-0214-4706-b844-d7ec59e6d6a4 req-6c03b276-998b-49c3-a176-e4b9414e1ced service nova] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Received event network-vif-plugged-bf3129f6-4466-41a8-a974-86182f2e209e {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7e7c90c0-0214-4706-b844-d7ec59e6d6a4 req-6c03b276-998b-49c3-a176-e4b9414e1ced service nova] Acquiring lock "88e09fde-0a42-4066-b1f5-413903476735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7e7c90c0-0214-4706-b844-d7ec59e6d6a4 req-6c03b276-998b-49c3-a176-e4b9414e1ced service nova] Lock "88e09fde-0a42-4066-b1f5-413903476735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7e7c90c0-0214-4706-b844-d7ec59e6d6a4 req-6c03b276-998b-49c3-a176-e4b9414e1ced service nova] Lock "88e09fde-0a42-4066-b1f5-413903476735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG nova.compute.manager [req-7e7c90c0-0214-4706-b844-d7ec59e6d6a4 req-6c03b276-998b-49c3-a176-e4b9414e1ced service nova] [instance: 88e09fde-0a42-4066-b1f5-413903476735] No waiting events found dispatching network-vif-plugged-bf3129f6-4466-41a8-a974-86182f2e209e {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:42:30 user nova-compute[71321]: WARNING nova.compute.manager [req-7e7c90c0-0214-4706-b844-d7ec59e6d6a4 req-6c03b276-998b-49c3-a176-e4b9414e1ced service nova] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Received unexpected event network-vif-plugged-bf3129f6-4466-41a8-a974-86182f2e209e for instance with vm_state active and task_state None.
Apr 12 12:42:30 user nova-compute[71321]: DEBUG nova.compute.manager [req-7e7c90c0-0214-4706-b844-d7ec59e6d6a4 req-6c03b276-998b-49c3-a176-e4b9414e1ced service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received event network-changed-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG nova.compute.manager [req-7e7c90c0-0214-4706-b844-d7ec59e6d6a4 req-6c03b276-998b-49c3-a176-e4b9414e1ced service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Refreshing instance network info cache due to event network-changed-c3155961-f301-4a26-a599-1d648d2500b0. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7e7c90c0-0214-4706-b844-d7ec59e6d6a4 req-6c03b276-998b-49c3-a176-e4b9414e1ced service nova] Acquiring lock "refresh_cache-89cc5f86-c387-4966-8bbf-a64d42d30db7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7e7c90c0-0214-4706-b844-d7ec59e6d6a4 req-6c03b276-998b-49c3-a176-e4b9414e1ced service nova] Acquired lock "refresh_cache-89cc5f86-c387-4966-8bbf-a64d42d30db7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:42:30 user nova-compute[71321]: DEBUG nova.network.neutron [req-7e7c90c0-0214-4706-b844-d7ec59e6d6a4 req-6c03b276-998b-49c3-a176-e4b9414e1ced service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Refreshing network info cache for port c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:42:31 user nova-compute[71321]: DEBUG nova.network.neutron [req-7e7c90c0-0214-4706-b844-d7ec59e6d6a4 req-6c03b276-998b-49c3-a176-e4b9414e1ced service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Updated VIF entry in instance network info cache for port c3155961-f301-4a26-a599-1d648d2500b0. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:42:31 user nova-compute[71321]: DEBUG nova.network.neutron [req-7e7c90c0-0214-4706-b844-d7ec59e6d6a4 req-6c03b276-998b-49c3-a176-e4b9414e1ced service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Updating instance_info_cache with network_info: [{"id": "c3155961-f301-4a26-a599-1d648d2500b0", "address": "fa:16:3e:75:3a:c1", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3155961-f3", "ovs_interfaceid": "c3155961-f301-4a26-a599-1d648d2500b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:42:31 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:42:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7e7c90c0-0214-4706-b844-d7ec59e6d6a4 req-6c03b276-998b-49c3-a176-e4b9414e1ced service nova] Releasing lock "refresh_cache-89cc5f86-c387-4966-8bbf-a64d42d30db7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:42:31 user nova-compute[71321]: DEBUG nova.compute.manager [req-7e7c90c0-0214-4706-b844-d7ec59e6d6a4 req-6c03b276-998b-49c3-a176-e4b9414e1ced service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received event network-changed-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:42:31 user nova-compute[71321]: DEBUG nova.compute.manager [req-7e7c90c0-0214-4706-b844-d7ec59e6d6a4 req-6c03b276-998b-49c3-a176-e4b9414e1ced service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Refreshing instance network info cache due to event network-changed-c3155961-f301-4a26-a599-1d648d2500b0. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:42:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7e7c90c0-0214-4706-b844-d7ec59e6d6a4 req-6c03b276-998b-49c3-a176-e4b9414e1ced service nova] Acquiring lock "refresh_cache-89cc5f86-c387-4966-8bbf-a64d42d30db7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:42:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7e7c90c0-0214-4706-b844-d7ec59e6d6a4 req-6c03b276-998b-49c3-a176-e4b9414e1ced service nova] Acquired lock "refresh_cache-89cc5f86-c387-4966-8bbf-a64d42d30db7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:42:31 user nova-compute[71321]: DEBUG nova.network.neutron [req-7e7c90c0-0214-4706-b844-d7ec59e6d6a4 req-6c03b276-998b-49c3-a176-e4b9414e1ced service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Refreshing network info cache for port c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:42:31 user nova-compute[71321]: DEBUG nova.objects.instance [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'flavor' on Instance uuid 89cc5f86-c387-4966-8bbf-a64d42d30db7 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:42:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.896s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:42:32 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:32 user nova-compute[71321]: DEBUG nova.network.neutron [req-7e7c90c0-0214-4706-b844-d7ec59e6d6a4 req-6c03b276-998b-49c3-a176-e4b9414e1ced service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Updated VIF entry in instance network info cache for port c3155961-f301-4a26-a599-1d648d2500b0. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:42:32 user nova-compute[71321]: DEBUG nova.network.neutron [req-7e7c90c0-0214-4706-b844-d7ec59e6d6a4 req-6c03b276-998b-49c3-a176-e4b9414e1ced service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Updating instance_info_cache with network_info: [{"id": "c3155961-f301-4a26-a599-1d648d2500b0", "address": "fa:16:3e:75:3a:c1", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3155961-f3", "ovs_interfaceid": "c3155961-f301-4a26-a599-1d648d2500b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:42:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7e7c90c0-0214-4706-b844-d7ec59e6d6a4 req-6c03b276-998b-49c3-a176-e4b9414e1ced service nova] Releasing lock "refresh_cache-89cc5f86-c387-4966-8bbf-a64d42d30db7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:42:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:42:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:42 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:42 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:42:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:42:50 user nova-compute[71321]: DEBUG nova.compute.manager [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:42:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:42:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:42:51 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:42:51 user nova-compute[71321]: INFO nova.compute.claims [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Claim successful on node user
Apr 12 12:42:51 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:42:51 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:42:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.301s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:42:51 user nova-compute[71321]: DEBUG nova.compute.manager [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:42:51 user nova-compute[71321]: DEBUG nova.compute.manager [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:42:51 user nova-compute[71321]: DEBUG nova.network.neutron [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:42:51 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:42:51 user nova-compute[71321]: DEBUG nova.compute.manager [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:42:51 user nova-compute[71321]: DEBUG nova.policy [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:42:51 user nova-compute[71321]: DEBUG nova.compute.manager [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:42:51 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:42:51 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Creating image(s)
Apr 12 12:42:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:42:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "/opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:42:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "/opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:42:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.135s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:42:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:42:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.146s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk 1073741824" returned: 0 in 0.045s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:42:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:52 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.128s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:52 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:42:52 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:42:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:52 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:42:52 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Cannot resize image /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:42:52 user nova-compute[71321]: DEBUG nova.objects.instance [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lazy-loading 'migration_context' on Instance uuid a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:42:52 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:42:52 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Ensure instance console log exists: /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:42:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:42:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:42:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:42:52 user nova-compute[71321]: DEBUG nova.network.neutron [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Successfully created port: 01ee163a-4590-4b09-bcb5-a53d238252d8 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG nova.network.neutron [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Successfully updated port: 01ee163a-4590-4b09-bcb5-a53d238252d8 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "refresh_cache-a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquired lock "refresh_cache-a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG nova.network.neutron [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG nova.compute.manager [req-06ac94c5-66a5-409b-90b0-35ba8fe433ff req-33222deb-81a9-410f-b91a-6701fa2fbeb9 service nova] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Received event network-changed-01ee163a-4590-4b09-bcb5-a53d238252d8 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG nova.compute.manager [req-06ac94c5-66a5-409b-90b0-35ba8fe433ff req-33222deb-81a9-410f-b91a-6701fa2fbeb9 service nova] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Refreshing instance network info cache due to event network-changed-01ee163a-4590-4b09-bcb5-a53d238252d8. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-06ac94c5-66a5-409b-90b0-35ba8fe433ff req-33222deb-81a9-410f-b91a-6701fa2fbeb9 service nova] Acquiring lock "refresh_cache-a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG nova.network.neutron [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG nova.network.neutron [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Updating instance_info_cache with network_info: [{"id": "01ee163a-4590-4b09-bcb5-a53d238252d8", "address": "fa:16:3e:36:a3:07", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01ee163a-45", "ovs_interfaceid": "01ee163a-4590-4b09-bcb5-a53d238252d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Releasing lock "refresh_cache-a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG nova.compute.manager [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Instance network_info: |[{"id": "01ee163a-4590-4b09-bcb5-a53d238252d8", "address": "fa:16:3e:36:a3:07", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01ee163a-45", "ovs_interfaceid": "01ee163a-4590-4b09-bcb5-a53d238252d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-06ac94c5-66a5-409b-90b0-35ba8fe433ff req-33222deb-81a9-410f-b91a-6701fa2fbeb9 service nova] Acquired lock "refresh_cache-a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG nova.network.neutron [req-06ac94c5-66a5-409b-90b0-35ba8fe433ff req-33222deb-81a9-410f-b91a-6701fa2fbeb9 service nova] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Refreshing network info cache for port 01ee163a-4590-4b09-bcb5-a53d238252d8 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Start _get_guest_xml network_info=[{"id": "01ee163a-4590-4b09-bcb5-a53d238252d8", "address": "fa:16:3e:36:a3:07", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01ee163a-45", "ovs_interfaceid": "01ee163a-4590-4b09-bcb5-a53d238252d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:42:53 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:42:53 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:42:53 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:42:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1256098765',display_name='tempest-ServerActionsTestJSON-server-1256098765',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1256098765',id=29,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9e64miZ/iyVASS4OS8AZthMPT8KBHm0byN/8NFP7U1AgI9/hOw/R+BSPozX14usgKt+VEqTE1BPs7aRGcfyuCZ/K0LBkD7enTbPYgw3NHHlO3PWScCWY1ae7IFb2uJEw==',key_name='tempest-keypair-1245622558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ba5375005114c8594e0ae86b2f19093',ramdisk_id='',reservation_id='r-8j5c45m9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1233797030',owner_user_name='tempest-ServerActionsTestJSON-1233797030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:42:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29f7f46d32f4465ba3e8b504c645c22f',uuid=a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01ee163a-4590-4b09-bcb5-a53d238252d8", "address": "fa:16:3e:36:a3:07", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01ee163a-45", "ovs_interfaceid": "01ee163a-4590-4b09-bcb5-a53d238252d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converting VIF {"id": "01ee163a-4590-4b09-bcb5-a53d238252d8", "address": "fa:16:3e:36:a3:07", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01ee163a-45", "ovs_interfaceid": "01ee163a-4590-4b09-bcb5-a53d238252d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:a3:07,bridge_name='br-int',has_traffic_filtering=True,id=01ee163a-4590-4b09-bcb5-a53d238252d8,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01ee163a-45') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG nova.objects.instance [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lazy-loading 'pci_devices' on Instance uuid a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:42:53 user nova-compute[71321]:   <uuid>a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7</uuid>
Apr 12 12:42:53 user nova-compute[71321]:   <name>instance-0000001d</name>
Apr 12 12:42:53 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:42:53 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:42:53 user nova-compute[71321]:   <metadata>
Apr 12 12:42:53 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:42:53 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:42:53 user nova-compute[71321]:       <nova:name>tempest-ServerActionsTestJSON-server-1256098765</nova:name>
Apr 12 12:42:53 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:42:53</nova:creationTime>
Apr 12 12:42:53 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:42:53 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:42:53 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:42:53 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:42:53 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:42:53 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:42:53 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:42:53 user nova-compute[71321]:       <nova:owner>
Apr 12 12:42:53 user nova-compute[71321]:         <nova:user uuid="29f7f46d32f4465ba3e8b504c645c22f">tempest-ServerActionsTestJSON-1233797030-project-member</nova:user>
Apr 12 12:42:53 user nova-compute[71321]:         <nova:project uuid="7ba5375005114c8594e0ae86b2f19093">tempest-ServerActionsTestJSON-1233797030</nova:project>
Apr 12 12:42:53 user nova-compute[71321]:       </nova:owner>
Apr 12 12:42:53 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:42:53 user nova-compute[71321]:       <nova:ports>
Apr 12 12:42:53 user nova-compute[71321]:         <nova:port uuid="01ee163a-4590-4b09-bcb5-a53d238252d8">
Apr 12 12:42:53 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 12:42:53 user nova-compute[71321]:         </nova:port>
Apr 12 12:42:53 user nova-compute[71321]:       </nova:ports>
Apr 12 12:42:53 user nova-compute[71321]:     </nova:instance>
Apr 12 12:42:53 user nova-compute[71321]:   </metadata>
Apr 12 12:42:53 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:42:53 user nova-compute[71321]:     <system>
Apr 12 12:42:53 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:42:53 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:42:53 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:42:53 user nova-compute[71321]:       <entry name="serial">a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7</entry>
Apr 12 12:42:53 user nova-compute[71321]:       <entry name="uuid">a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7</entry>
Apr 12 12:42:53 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:42:53 user nova-compute[71321]:     </system>
Apr 12 12:42:53 user nova-compute[71321]:   </sysinfo>
Apr 12 12:42:53 user nova-compute[71321]:   <os>
Apr 12 12:42:53 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:42:53 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:42:53 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:42:53 user nova-compute[71321]:   </os>
Apr 12 12:42:53 user nova-compute[71321]:   <features>
Apr 12 12:42:53 user nova-compute[71321]:     <acpi/>
Apr 12 12:42:53 user nova-compute[71321]:     <apic/>
Apr 12 12:42:53 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:42:53 user nova-compute[71321]:   </features>
Apr 12 12:42:53 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:42:53 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:42:53 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:42:53 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:42:53 user nova-compute[71321]:   </clock>
Apr 12 12:42:53 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:42:53 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:42:53 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:42:53 user nova-compute[71321]:   </cpu>
Apr 12 12:42:53 user nova-compute[71321]:   <devices>
Apr 12 12:42:53 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:42:53 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:42:53 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk"/>
Apr 12 12:42:53 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:42:53 user nova-compute[71321]:     </disk>
Apr 12 12:42:53 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:42:53 user nova-compute[71321]:       <mac address="fa:16:3e:36:a3:07"/>
Apr 12 12:42:53 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:42:53 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:42:53 user nova-compute[71321]:       <target dev="tap01ee163a-45"/>
Apr 12 12:42:53 user nova-compute[71321]:     </interface>
Apr 12 12:42:53 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:42:53 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/console.log" append="off"/>
Apr 12 12:42:53 user nova-compute[71321]:     </serial>
Apr 12 12:42:53 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:42:53 user nova-compute[71321]:     <video>
Apr 12 12:42:53 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:42:53 user nova-compute[71321]:     </video>
Apr 12 12:42:53 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:42:53 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:42:53 user nova-compute[71321]:     </rng>
Apr 12 12:42:53 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:42:53 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:42:53 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:42:53 user nova-compute[71321]:     </memballoon>
Apr 12 12:42:53 user nova-compute[71321]:   </devices>
Apr 12 12:42:53 user nova-compute[71321]: </domain>
Apr 12 12:42:53 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:42:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1256098765',display_name='tempest-ServerActionsTestJSON-server-1256098765',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1256098765',id=29,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9e64miZ/iyVASS4OS8AZthMPT8KBHm0byN/8NFP7U1AgI9/hOw/R+BSPozX14usgKt+VEqTE1BPs7aRGcfyuCZ/K0LBkD7enTbPYgw3NHHlO3PWScCWY1ae7IFb2uJEw==',key_name='tempest-keypair-1245622558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ba5375005114c8594e0ae86b2f19093',ramdisk_id='',reservation_id='r-8j5c45m9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1233797030',owner_user_name='tempest-ServerActionsTestJSON-1233797030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:42:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29f7f46d32f4465ba3e8b504c645c22f',uuid=a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01ee163a-4590-4b09-bcb5-a53d238252d8", "address": "fa:16:3e:36:a3:07", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01ee163a-45", "ovs_interfaceid": "01ee163a-4590-4b09-bcb5-a53d238252d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converting VIF {"id": "01ee163a-4590-4b09-bcb5-a53d238252d8", "address": "fa:16:3e:36:a3:07", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01ee163a-45", "ovs_interfaceid": "01ee163a-4590-4b09-bcb5-a53d238252d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:a3:07,bridge_name='br-int',has_traffic_filtering=True,id=01ee163a-4590-4b09-bcb5-a53d238252d8,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01ee163a-45') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG os_vif [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:a3:07,bridge_name='br-int',has_traffic_filtering=True,id=01ee163a-4590-4b09-bcb5-a53d238252d8,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01ee163a-45') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01ee163a-45, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap01ee163a-45, col_values=(('external_ids', {'iface-id': '01ee163a-4590-4b09-bcb5-a53d238252d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:a3:07', 'vm-uuid': 'a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:53 user nova-compute[71321]: INFO os_vif [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:a3:07,bridge_name='br-int',has_traffic_filtering=True,id=01ee163a-4590-4b09-bcb5-a53d238252d8,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01ee163a-45')
Apr 12 12:42:53 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] No VIF found with MAC fa:16:3e:36:a3:07, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG nova.network.neutron [req-06ac94c5-66a5-409b-90b0-35ba8fe433ff req-33222deb-81a9-410f-b91a-6701fa2fbeb9 service nova] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Updated VIF entry in instance network info cache for port 01ee163a-4590-4b09-bcb5-a53d238252d8. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG nova.network.neutron [req-06ac94c5-66a5-409b-90b0-35ba8fe433ff req-33222deb-81a9-410f-b91a-6701fa2fbeb9 service nova] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Updating instance_info_cache with network_info: [{"id": "01ee163a-4590-4b09-bcb5-a53d238252d8", "address": "fa:16:3e:36:a3:07", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01ee163a-45", "ovs_interfaceid": "01ee163a-4590-4b09-bcb5-a53d238252d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:42:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-06ac94c5-66a5-409b-90b0-35ba8fe433ff req-33222deb-81a9-410f-b91a-6701fa2fbeb9 service nova] Releasing lock "refresh_cache-a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:42:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:55 user nova-compute[71321]: DEBUG nova.compute.manager [req-f29ccda8-9568-4cc7-98f4-d476ce79d87c req-e9d8f139-3f50-422e-8818-4f14a08b0dab service nova] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Received event network-vif-plugged-01ee163a-4590-4b09-bcb5-a53d238252d8 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:42:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f29ccda8-9568-4cc7-98f4-d476ce79d87c req-e9d8f139-3f50-422e-8818-4f14a08b0dab service nova] Acquiring lock "a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:42:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f29ccda8-9568-4cc7-98f4-d476ce79d87c req-e9d8f139-3f50-422e-8818-4f14a08b0dab service nova] Lock "a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:42:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f29ccda8-9568-4cc7-98f4-d476ce79d87c req-e9d8f139-3f50-422e-8818-4f14a08b0dab service nova] Lock "a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:42:55 user nova-compute[71321]: DEBUG nova.compute.manager [req-f29ccda8-9568-4cc7-98f4-d476ce79d87c req-e9d8f139-3f50-422e-8818-4f14a08b0dab service nova] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] No waiting events found dispatching network-vif-plugged-01ee163a-4590-4b09-bcb5-a53d238252d8 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:42:55 user nova-compute[71321]: WARNING nova.compute.manager [req-f29ccda8-9568-4cc7-98f4-d476ce79d87c req-e9d8f139-3f50-422e-8818-4f14a08b0dab service nova] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Received unexpected event network-vif-plugged-01ee163a-4590-4b09-bcb5-a53d238252d8 for instance with vm_state building and task_state spawning.
Apr 12 12:42:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:42:57 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303377.0969265, a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:42:57 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] VM Resumed (Lifecycle Event)
Apr 12 12:42:57 user nova-compute[71321]: DEBUG nova.compute.manager [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:42:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:42:57 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Instance spawned successfully.
Apr 12 12:42:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:42:57 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:42:57 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:42:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:42:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:42:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:42:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:42:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:42:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:42:57 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:42:57 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303377.0985107, a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:42:57 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] VM Started (Lifecycle Event)
Apr 12 12:42:57 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:42:57 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:42:57 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:42:57 user nova-compute[71321]: INFO nova.compute.manager [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Took 5.68 seconds to spawn the instance on the hypervisor.
Apr 12 12:42:57 user nova-compute[71321]: DEBUG nova.compute.manager [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:42:57 user nova-compute[71321]: INFO nova.compute.manager [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Took 6.31 seconds to build instance.
Apr 12 12:42:57 user nova-compute[71321]: DEBUG nova.compute.manager [req-b831db8f-a2f7-4f68-bc00-4298a3889359 req-fa4156b9-6f54-4bd4-952f-fe4422061a15 service nova] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Received event network-vif-plugged-01ee163a-4590-4b09-bcb5-a53d238252d8 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:42:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b831db8f-a2f7-4f68-bc00-4298a3889359 req-fa4156b9-6f54-4bd4-952f-fe4422061a15 service nova] Acquiring lock "a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:42:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b831db8f-a2f7-4f68-bc00-4298a3889359 req-fa4156b9-6f54-4bd4-952f-fe4422061a15 service nova] Lock "a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:42:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b831db8f-a2f7-4f68-bc00-4298a3889359 req-fa4156b9-6f54-4bd4-952f-fe4422061a15 service nova] Lock "a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:42:57 user nova-compute[71321]: DEBUG nova.compute.manager [req-b831db8f-a2f7-4f68-bc00-4298a3889359 req-fa4156b9-6f54-4bd4-952f-fe4422061a15 service nova] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] No waiting events found dispatching network-vif-plugged-01ee163a-4590-4b09-bcb5-a53d238252d8 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:42:57 user nova-compute[71321]: WARNING nova.compute.manager [req-b831db8f-a2f7-4f68-bc00-4298a3889359 req-fa4156b9-6f54-4bd4-952f-fe4422061a15 service nova] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Received unexpected event network-vif-plugged-01ee163a-4590-4b09-bcb5-a53d238252d8 for instance with vm_state active and task_state None.
Apr 12 12:42:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.407s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:42:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:13 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5f660bd9-dc4e-472f-bff7-61b5506c2a78 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "89cc5f86-c387-4966-8bbf-a64d42d30db7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:43:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5f660bd9-dc4e-472f-bff7-61b5506c2a78 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:43:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5f660bd9-dc4e-472f-bff7-61b5506c2a78 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:43:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5f660bd9-dc4e-472f-bff7-61b5506c2a78 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:43:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5f660bd9-dc4e-472f-bff7-61b5506c2a78 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:43:20 user nova-compute[71321]: INFO nova.compute.manager [None req-5f660bd9-dc4e-472f-bff7-61b5506c2a78 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Terminating instance
Apr 12 12:43:20 user nova-compute[71321]: DEBUG nova.compute.manager [None req-5f660bd9-dc4e-472f-bff7-61b5506c2a78 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:43:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:20 user nova-compute[71321]: DEBUG nova.compute.manager [req-726eaa54-346e-4322-9b30-d95c0aaf056e req-10db4816-c106-462d-9cce-b8c6d798f71f service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received event network-vif-unplugged-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:43:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-726eaa54-346e-4322-9b30-d95c0aaf056e req-10db4816-c106-462d-9cce-b8c6d798f71f service nova] Acquiring lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:43:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-726eaa54-346e-4322-9b30-d95c0aaf056e req-10db4816-c106-462d-9cce-b8c6d798f71f service nova] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:43:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-726eaa54-346e-4322-9b30-d95c0aaf056e req-10db4816-c106-462d-9cce-b8c6d798f71f service nova] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:43:20 user nova-compute[71321]: DEBUG nova.compute.manager [req-726eaa54-346e-4322-9b30-d95c0aaf056e req-10db4816-c106-462d-9cce-b8c6d798f71f service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] No waiting events found dispatching network-vif-unplugged-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:43:20 user nova-compute[71321]: DEBUG nova.compute.manager [req-726eaa54-346e-4322-9b30-d95c0aaf056e req-10db4816-c106-462d-9cce-b8c6d798f71f service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received event network-vif-unplugged-c3155961-f301-4a26-a599-1d648d2500b0 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:43:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:21 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Instance destroyed successfully.
Apr 12 12:43:21 user nova-compute[71321]: DEBUG nova.objects.instance [None req-5f660bd9-dc4e-472f-bff7-61b5506c2a78 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'resources' on Instance uuid 89cc5f86-c387-4966-8bbf-a64d42d30db7 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:43:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:21 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-5f660bd9-dc4e-472f-bff7-61b5506c2a78 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:36:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1426605846',display_name='tempest-ServerRescueNegativeTestJSON-server-1426605846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1426605846',id=24,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoCyqzs+8zrj4h6uGdmSsuDYdl4XZy4hARXsIlRPh7dRZ2tEg+K3UMhHPOf8n5+xfHG0dd1ftUcbN4N2gdcb3nvuvPgtvGBh8vkaOa3CldqRPPAwwxfvBWjOglZdUPChQ==',key_name='tempest-keypair-856573039',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:38:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9ec9671123c4a00a2880de4b4df8d3e',ramdisk_id='',reservation_id='r-mdc0x69g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1979263125',owner_user_name='tempest-ServerRescueNegativeTestJSON-1979263125-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:40:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1db0203a6e6f4cc3bccbf19577a0c82f',uuid=89cc5f86-c387-4966-8bbf-a64d42d30db7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3155961-f301-4a26-a599-1d648d2500b0", "address": "fa:16:3e:75:3a:c1", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3155961-f3", "ovs_interfaceid": "c3155961-f301-4a26-a599-1d648d2500b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:43:21 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-5f660bd9-dc4e-472f-bff7-61b5506c2a78 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Converting VIF {"id": "c3155961-f301-4a26-a599-1d648d2500b0", "address": "fa:16:3e:75:3a:c1", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3155961-f3", "ovs_interfaceid": "c3155961-f301-4a26-a599-1d648d2500b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:43:21 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-5f660bd9-dc4e-472f-bff7-61b5506c2a78 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:3a:c1,bridge_name='br-int',has_traffic_filtering=True,id=c3155961-f301-4a26-a599-1d648d2500b0,network=Network(0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3155961-f3') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:43:21 user nova-compute[71321]: DEBUG os_vif [None req-5f660bd9-dc4e-472f-bff7-61b5506c2a78 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:3a:c1,bridge_name='br-int',has_traffic_filtering=True,id=c3155961-f301-4a26-a599-1d648d2500b0,network=Network(0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3155961-f3') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:43:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3155961-f3, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:43:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:43:21 user nova-compute[71321]: INFO os_vif [None req-5f660bd9-dc4e-472f-bff7-61b5506c2a78 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:3a:c1,bridge_name='br-int',has_traffic_filtering=True,id=c3155961-f301-4a26-a599-1d648d2500b0,network=Network(0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3155961-f3')
Apr 12 12:43:21 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-5f660bd9-dc4e-472f-bff7-61b5506c2a78 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Deleting instance files /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7_del
Apr 12 12:43:21 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-5f660bd9-dc4e-472f-bff7-61b5506c2a78 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Deletion of /opt/stack/data/nova/instances/89cc5f86-c387-4966-8bbf-a64d42d30db7_del complete
Apr 12 12:43:21 user nova-compute[71321]: INFO nova.compute.manager [None req-5f660bd9-dc4e-472f-bff7-61b5506c2a78 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 12 12:43:21 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-5f660bd9-dc4e-472f-bff7-61b5506c2a78 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:43:21 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:43:21 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:43:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:22 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:43:22 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:43:22 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Took 1.35 seconds to deallocate network for instance.
Apr 12 12:43:22 user nova-compute[71321]: DEBUG nova.compute.manager [req-c0e429e9-7e27-4be0-ae40-1f5f0453d947 req-181e403c-d4d3-4f53-8b32-2882a0e5c43a service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received event network-vif-deleted-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:43:22 user nova-compute[71321]: INFO nova.compute.manager [req-c0e429e9-7e27-4be0-ae40-1f5f0453d947 req-181e403c-d4d3-4f53-8b32-2882a0e5c43a service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Neutron deleted interface c3155961-f301-4a26-a599-1d648d2500b0; detaching it from the instance and deleting it from the info cache
Apr 12 12:43:22 user nova-compute[71321]: DEBUG nova.network.neutron [req-c0e429e9-7e27-4be0-ae40-1f5f0453d947 req-181e403c-d4d3-4f53-8b32-2882a0e5c43a service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:43:22 user nova-compute[71321]: DEBUG nova.compute.manager [req-c0e429e9-7e27-4be0-ae40-1f5f0453d947 req-181e403c-d4d3-4f53-8b32-2882a0e5c43a service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Detach interface failed, port_id=c3155961-f301-4a26-a599-1d648d2500b0, reason: Instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 could not be found. {{(pid=71321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 12:43:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5f660bd9-dc4e-472f-bff7-61b5506c2a78 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:43:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5f660bd9-dc4e-472f-bff7-61b5506c2a78 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:43:22 user nova-compute[71321]: DEBUG nova.compute.manager [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received event network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:43:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] Acquiring lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:43:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:43:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:43:22 user nova-compute[71321]: DEBUG nova.compute.manager [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] No waiting events found dispatching network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:43:22 user nova-compute[71321]: WARNING nova.compute.manager [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received unexpected event network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 for instance with vm_state deleted and task_state None.
Apr 12 12:43:22 user nova-compute[71321]: DEBUG nova.compute.manager [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received event network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:43:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] Acquiring lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:43:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:43:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:43:22 user nova-compute[71321]: DEBUG nova.compute.manager [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] No waiting events found dispatching network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:43:22 user nova-compute[71321]: WARNING nova.compute.manager [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received unexpected event network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 for instance with vm_state deleted and task_state None.
Apr 12 12:43:22 user nova-compute[71321]: DEBUG nova.compute.manager [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received event network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:43:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] Acquiring lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:43:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:43:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:43:22 user nova-compute[71321]: DEBUG nova.compute.manager [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] No waiting events found dispatching network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:43:22 user nova-compute[71321]: WARNING nova.compute.manager [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received unexpected event network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 for instance with vm_state deleted and task_state None.
Apr 12 12:43:22 user nova-compute[71321]: DEBUG nova.compute.manager [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received event network-vif-unplugged-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:43:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] Acquiring lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:43:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:43:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:43:22 user nova-compute[71321]: DEBUG nova.compute.manager [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] No waiting events found dispatching network-vif-unplugged-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:43:22 user nova-compute[71321]: WARNING nova.compute.manager [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received unexpected event network-vif-unplugged-c3155961-f301-4a26-a599-1d648d2500b0 for instance with vm_state deleted and task_state None.
Apr 12 12:43:22 user nova-compute[71321]: DEBUG nova.compute.manager [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received event network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:43:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] Acquiring lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:43:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:43:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:43:22 user nova-compute[71321]: DEBUG nova.compute.manager [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] No waiting events found dispatching network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:43:22 user nova-compute[71321]: WARNING nova.compute.manager [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Received unexpected event network-vif-plugged-c3155961-f301-4a26-a599-1d648d2500b0 for instance with vm_state deleted and task_state None.
Apr 12 12:43:22 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-5f660bd9-dc4e-472f-bff7-61b5506c2a78 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:43:22 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-5f660bd9-dc4e-472f-bff7-61b5506c2a78 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:43:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5f660bd9-dc4e-472f-bff7-61b5506c2a78 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.231s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:43:23 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-5f660bd9-dc4e-472f-bff7-61b5506c2a78 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Deleted allocations for instance 89cc5f86-c387-4966-8bbf-a64d42d30db7
Apr 12 12:43:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5f660bd9-dc4e-472f-bff7-61b5506c2a78 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "89cc5f86-c387-4966-8bbf-a64d42d30db7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.674s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:43:24 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:43:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:43:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:43:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:43:24 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:43:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:43:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:43:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:43:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:43:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:43:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:43:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:43:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:43:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:43:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:43:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:43:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:43:25 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:43:25 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:43:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:43:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:43:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:43:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:43:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:26 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:43:26 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:43:26 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8230MB free_disk=26.439964294433594GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:43:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:43:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:43:26 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 10116da0-785c-41cf-96bb-95721af863db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:43:26 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance a4107f2d-88e4-4846-9ece-cb16ad7ecd02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:43:26 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:43:26 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 88e09fde-0a42-4066-b1f5-413903476735 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:43:26 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:43:26 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:43:26 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:43:26 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:43:26 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:43:26 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:43:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.333s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:43:27 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:43:27 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:43:27 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:43:27 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:43:27 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:43:28 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:43:28 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:43:28 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Skipping network cache update for instance because it has been migrated to another host. {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9836}}
Apr 12 12:43:28 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:43:28 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:43:28 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 12:43:29 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Updating instance_info_cache with network_info: [{"id": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c", "address": "fa:16:3e:ab:22:27", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d914f7-c4", "ovs_interfaceid": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:43:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:43:29 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 12:43:29 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:43:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:43:33 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:43:36 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681303401.209799, 89cc5f86-c387-4966-8bbf-a64d42d30db7 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:43:36 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] VM Stopped (Lifecycle Event)
Apr 12 12:43:36 user nova-compute[71321]: DEBUG nova.compute.manager [None req-22affc3b-fcf9-4329-af4e-35d88647a603 None None] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:43:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:43:41 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:43:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "d0592fff-d30d-40dc-95d3-263aab10a70e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:43:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "d0592fff-d30d-40dc-95d3-263aab10a70e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:43:43 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:43:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:43:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:43:43 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:43:43 user nova-compute[71321]: INFO nova.compute.claims [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Claim successful on node user
Apr 12 12:43:43 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:43:43 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:43:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.290s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:43:43 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:43:43 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:43:43 user nova-compute[71321]: DEBUG nova.network.neutron [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:43:43 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:43:43 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:43:43 user nova-compute[71321]: DEBUG nova.policy [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b3792e5a3b24583bbf50fb2b275b6d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd0006105e24edb9516d52c5af63054', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:43:43 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:43:43 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:43:43 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Creating image(s)
Apr 12 12:43:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "/opt/stack/data/nova/instances/d0592fff-d30d-40dc-95d3-263aab10a70e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:43:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "/opt/stack/data/nova/instances/d0592fff-d30d-40dc-95d3-263aab10a70e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:43:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "/opt/stack/data/nova/instances/d0592fff-d30d-40dc-95d3-263aab10a70e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:43:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:43:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.136s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:43:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:43:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:43:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:43:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.132s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:43:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/d0592fff-d30d-40dc-95d3-263aab10a70e/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:43:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/d0592fff-d30d-40dc-95d3-263aab10a70e/disk 1073741824" returned: 0 in 0.059s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:43:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:43:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:43:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.182s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:43:44 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d0592fff-d30d-40dc-95d3-263aab10a70e/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:43:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0592fff-d30d-40dc-95d3-263aab10a70e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:43:44 user nova-compute[71321]: DEBUG nova.network.neutron [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Successfully created port: 92c07803-de20-43a3-98cc-f663ecf1c733 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:43:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0592fff-d30d-40dc-95d3-263aab10a70e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:43:44 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Cannot resize image /opt/stack/data/nova/instances/d0592fff-d30d-40dc-95d3-263aab10a70e/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:43:44 user nova-compute[71321]: DEBUG nova.objects.instance [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lazy-loading 'migration_context' on Instance uuid d0592fff-d30d-40dc-95d3-263aab10a70e {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:43:44 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:43:44 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Ensure instance console log exists: /opt/stack/data/nova/instances/d0592fff-d30d-40dc-95d3-263aab10a70e/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:43:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:43:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:43:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG nova.network.neutron [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Successfully updated port: 92c07803-de20-43a3-98cc-f663ecf1c733 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "refresh_cache-d0592fff-d30d-40dc-95d3-263aab10a70e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquired lock "refresh_cache-d0592fff-d30d-40dc-95d3-263aab10a70e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG nova.network.neutron [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG nova.compute.manager [req-a8c59d0e-38af-452f-8a07-f1004cd58474 req-573a2fd0-9e3e-42a8-8d46-a4b04c85e333 service nova] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Received event network-changed-92c07803-de20-43a3-98cc-f663ecf1c733 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG nova.compute.manager [req-a8c59d0e-38af-452f-8a07-f1004cd58474 req-573a2fd0-9e3e-42a8-8d46-a4b04c85e333 service nova] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Refreshing instance network info cache due to event network-changed-92c07803-de20-43a3-98cc-f663ecf1c733. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a8c59d0e-38af-452f-8a07-f1004cd58474 req-573a2fd0-9e3e-42a8-8d46-a4b04c85e333 service nova] Acquiring lock "refresh_cache-d0592fff-d30d-40dc-95d3-263aab10a70e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG nova.network.neutron [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG nova.network.neutron [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Updating instance_info_cache with network_info: [{"id": "92c07803-de20-43a3-98cc-f663ecf1c733", "address": "fa:16:3e:c0:90:8b", "network": {"id": "eaded3a8-c825-4731-95bc-3f39f32603da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1058349103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bfd0006105e24edb9516d52c5af63054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92c07803-de", "ovs_interfaceid": "92c07803-de20-43a3-98cc-f663ecf1c733", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Releasing lock "refresh_cache-d0592fff-d30d-40dc-95d3-263aab10a70e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Instance network_info: |[{"id": "92c07803-de20-43a3-98cc-f663ecf1c733", "address": "fa:16:3e:c0:90:8b", "network": {"id": "eaded3a8-c825-4731-95bc-3f39f32603da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1058349103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bfd0006105e24edb9516d52c5af63054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92c07803-de", "ovs_interfaceid": "92c07803-de20-43a3-98cc-f663ecf1c733", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a8c59d0e-38af-452f-8a07-f1004cd58474 req-573a2fd0-9e3e-42a8-8d46-a4b04c85e333 service nova] Acquired lock "refresh_cache-d0592fff-d30d-40dc-95d3-263aab10a70e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG nova.network.neutron [req-a8c59d0e-38af-452f-8a07-f1004cd58474 req-573a2fd0-9e3e-42a8-8d46-a4b04c85e333 service nova] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Refreshing network info cache for port 92c07803-de20-43a3-98cc-f663ecf1c733 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Start _get_guest_xml network_info=[{"id": "92c07803-de20-43a3-98cc-f663ecf1c733", "address": "fa:16:3e:c0:90:8b", "network": {"id": "eaded3a8-c825-4731-95bc-3f39f32603da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1058349103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bfd0006105e24edb9516d52c5af63054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92c07803-de", "ovs_interfaceid": "92c07803-de20-43a3-98cc-f663ecf1c733", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:43:45 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:43:45 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:43:45 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:43:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1074373312',display_name='tempest-VolumesActionsTest-instance-1074373312',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1074373312',id=30,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfd0006105e24edb9516d52c5af63054',ramdisk_id='',reservation_id='r-45kh0v0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1646592366',owner_user_name='tempest-VolumesActionsTest-1646592366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:43:44Z,user_data=None,user_id='2b3792e5a3b24583bbf50fb2b275b6d0',uuid=d0592fff-d30d-40dc-95d3-263aab10a70e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92c07803-de20-43a3-98cc-f663ecf1c733", "address": "fa:16:3e:c0:90:8b", "network": {"id": "eaded3a8-c825-4731-95bc-3f39f32603da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1058349103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bfd0006105e24edb9516d52c5af63054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92c07803-de", "ovs_interfaceid": "92c07803-de20-43a3-98cc-f663ecf1c733", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Converting VIF {"id": "92c07803-de20-43a3-98cc-f663ecf1c733", "address": "fa:16:3e:c0:90:8b", "network": {"id": "eaded3a8-c825-4731-95bc-3f39f32603da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1058349103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bfd0006105e24edb9516d52c5af63054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92c07803-de", "ovs_interfaceid": "92c07803-de20-43a3-98cc-f663ecf1c733", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:90:8b,bridge_name='br-int',has_traffic_filtering=True,id=92c07803-de20-43a3-98cc-f663ecf1c733,network=Network(eaded3a8-c825-4731-95bc-3f39f32603da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92c07803-de') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG nova.objects.instance [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lazy-loading 'pci_devices' on Instance uuid d0592fff-d30d-40dc-95d3-263aab10a70e {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:43:45 user nova-compute[71321]:   <uuid>d0592fff-d30d-40dc-95d3-263aab10a70e</uuid>
Apr 12 12:43:45 user nova-compute[71321]:   <name>instance-0000001e</name>
Apr 12 12:43:45 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:43:45 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:43:45 user nova-compute[71321]:   <metadata>
Apr 12 12:43:45 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:43:45 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:43:45 user nova-compute[71321]:       <nova:name>tempest-VolumesActionsTest-instance-1074373312</nova:name>
Apr 12 12:43:45 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:43:45</nova:creationTime>
Apr 12 12:43:45 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:43:45 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:43:45 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:43:45 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:43:45 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:43:45 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:43:45 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:43:45 user nova-compute[71321]:       <nova:owner>
Apr 12 12:43:45 user nova-compute[71321]:         <nova:user uuid="2b3792e5a3b24583bbf50fb2b275b6d0">tempest-VolumesActionsTest-1646592366-project-member</nova:user>
Apr 12 12:43:45 user nova-compute[71321]:         <nova:project uuid="bfd0006105e24edb9516d52c5af63054">tempest-VolumesActionsTest-1646592366</nova:project>
Apr 12 12:43:45 user nova-compute[71321]:       </nova:owner>
Apr 12 12:43:45 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:43:45 user nova-compute[71321]:       <nova:ports>
Apr 12 12:43:45 user nova-compute[71321]:         <nova:port uuid="92c07803-de20-43a3-98cc-f663ecf1c733">
Apr 12 12:43:45 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 12:43:45 user nova-compute[71321]:         </nova:port>
Apr 12 12:43:45 user nova-compute[71321]:       </nova:ports>
Apr 12 12:43:45 user nova-compute[71321]:     </nova:instance>
Apr 12 12:43:45 user nova-compute[71321]:   </metadata>
Apr 12 12:43:45 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:43:45 user nova-compute[71321]:     <system>
Apr 12 12:43:45 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:43:45 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:43:45 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:43:45 user nova-compute[71321]:       <entry name="serial">d0592fff-d30d-40dc-95d3-263aab10a70e</entry>
Apr 12 12:43:45 user nova-compute[71321]:       <entry name="uuid">d0592fff-d30d-40dc-95d3-263aab10a70e</entry>
Apr 12 12:43:45 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:43:45 user nova-compute[71321]:     </system>
Apr 12 12:43:45 user nova-compute[71321]:   </sysinfo>
Apr 12 12:43:45 user nova-compute[71321]:   <os>
Apr 12 12:43:45 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:43:45 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:43:45 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:43:45 user nova-compute[71321]:   </os>
Apr 12 12:43:45 user nova-compute[71321]:   <features>
Apr 12 12:43:45 user nova-compute[71321]:     <acpi/>
Apr 12 12:43:45 user nova-compute[71321]:     <apic/>
Apr 12 12:43:45 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:43:45 user nova-compute[71321]:   </features>
Apr 12 12:43:45 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:43:45 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:43:45 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:43:45 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:43:45 user nova-compute[71321]:   </clock>
Apr 12 12:43:45 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:43:45 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:43:45 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:43:45 user nova-compute[71321]:   </cpu>
Apr 12 12:43:45 user nova-compute[71321]:   <devices>
Apr 12 12:43:45 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:43:45 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:43:45 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/d0592fff-d30d-40dc-95d3-263aab10a70e/disk"/>
Apr 12 12:43:45 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:43:45 user nova-compute[71321]:     </disk>
Apr 12 12:43:45 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:43:45 user nova-compute[71321]:       <mac address="fa:16:3e:c0:90:8b"/>
Apr 12 12:43:45 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:43:45 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:43:45 user nova-compute[71321]:       <target dev="tap92c07803-de"/>
Apr 12 12:43:45 user nova-compute[71321]:     </interface>
Apr 12 12:43:45 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:43:45 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/d0592fff-d30d-40dc-95d3-263aab10a70e/console.log" append="off"/>
Apr 12 12:43:45 user nova-compute[71321]:     </serial>
Apr 12 12:43:45 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:43:45 user nova-compute[71321]:     <video>
Apr 12 12:43:45 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:43:45 user nova-compute[71321]:     </video>
Apr 12 12:43:45 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:43:45 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:43:45 user nova-compute[71321]:     </rng>
Apr 12 12:43:45 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:43:45 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:43:45 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:43:45 user nova-compute[71321]:     </memballoon>
Apr 12 12:43:45 user nova-compute[71321]:   </devices>
Apr 12 12:43:45 user nova-compute[71321]: </domain>
Apr 12 12:43:45 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:43:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1074373312',display_name='tempest-VolumesActionsTest-instance-1074373312',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1074373312',id=30,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfd0006105e24edb9516d52c5af63054',ramdisk_id='',reservation_id='r-45kh0v0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1646592366',owner_user_name='tempest-VolumesActionsTest-1646592366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:43:44Z,user_data=None,user_id='2b3792e5a3b24583bbf50fb2b275b6d0',uuid=d0592fff-d30d-40dc-95d3-263aab10a70e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92c07803-de20-43a3-98cc-f663ecf1c733", "address": "fa:16:3e:c0:90:8b", "network": {"id": "eaded3a8-c825-4731-95bc-3f39f32603da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1058349103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bfd0006105e24edb9516d52c5af63054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92c07803-de", "ovs_interfaceid": "92c07803-de20-43a3-98cc-f663ecf1c733", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Converting VIF {"id": "92c07803-de20-43a3-98cc-f663ecf1c733", "address": "fa:16:3e:c0:90:8b", "network": {"id": "eaded3a8-c825-4731-95bc-3f39f32603da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1058349103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bfd0006105e24edb9516d52c5af63054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92c07803-de", "ovs_interfaceid": "92c07803-de20-43a3-98cc-f663ecf1c733", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:90:8b,bridge_name='br-int',has_traffic_filtering=True,id=92c07803-de20-43a3-98cc-f663ecf1c733,network=Network(eaded3a8-c825-4731-95bc-3f39f32603da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92c07803-de') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG os_vif [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:90:8b,bridge_name='br-int',has_traffic_filtering=True,id=92c07803-de20-43a3-98cc-f663ecf1c733,network=Network(eaded3a8-c825-4731-95bc-3f39f32603da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92c07803-de') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92c07803-de, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap92c07803-de, col_values=(('external_ids', {'iface-id': '92c07803-de20-43a3-98cc-f663ecf1c733', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:90:8b', 'vm-uuid': 'd0592fff-d30d-40dc-95d3-263aab10a70e'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:45 user nova-compute[71321]: INFO os_vif [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:90:8b,bridge_name='br-int',has_traffic_filtering=True,id=92c07803-de20-43a3-98cc-f663ecf1c733,network=Network(eaded3a8-c825-4731-95bc-3f39f32603da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92c07803-de')
Apr 12 12:43:45 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:43:45 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] No VIF found with MAC fa:16:3e:c0:90:8b, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:43:46 user nova-compute[71321]: DEBUG nova.network.neutron [req-a8c59d0e-38af-452f-8a07-f1004cd58474 req-573a2fd0-9e3e-42a8-8d46-a4b04c85e333 service nova] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Updated VIF entry in instance network info cache for port 92c07803-de20-43a3-98cc-f663ecf1c733. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:43:46 user nova-compute[71321]: DEBUG nova.network.neutron [req-a8c59d0e-38af-452f-8a07-f1004cd58474 req-573a2fd0-9e3e-42a8-8d46-a4b04c85e333 service nova] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Updating instance_info_cache with network_info: [{"id": "92c07803-de20-43a3-98cc-f663ecf1c733", "address": "fa:16:3e:c0:90:8b", "network": {"id": "eaded3a8-c825-4731-95bc-3f39f32603da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1058349103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bfd0006105e24edb9516d52c5af63054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92c07803-de", "ovs_interfaceid": "92c07803-de20-43a3-98cc-f663ecf1c733", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:43:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a8c59d0e-38af-452f-8a07-f1004cd58474 req-573a2fd0-9e3e-42a8-8d46-a4b04c85e333 service nova] Releasing lock "refresh_cache-d0592fff-d30d-40dc-95d3-263aab10a70e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:43:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:47 user nova-compute[71321]: DEBUG nova.compute.manager [req-f8013bb6-07bc-4dfd-8c02-13299dc74eac req-d28b3107-59ee-4d04-a17c-667da8e396ac service nova] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Received event network-vif-plugged-92c07803-de20-43a3-98cc-f663ecf1c733 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:43:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f8013bb6-07bc-4dfd-8c02-13299dc74eac req-d28b3107-59ee-4d04-a17c-667da8e396ac service nova] Acquiring lock "d0592fff-d30d-40dc-95d3-263aab10a70e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:43:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f8013bb6-07bc-4dfd-8c02-13299dc74eac req-d28b3107-59ee-4d04-a17c-667da8e396ac service nova] Lock "d0592fff-d30d-40dc-95d3-263aab10a70e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:43:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f8013bb6-07bc-4dfd-8c02-13299dc74eac req-d28b3107-59ee-4d04-a17c-667da8e396ac service nova] Lock "d0592fff-d30d-40dc-95d3-263aab10a70e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:43:47 user nova-compute[71321]: DEBUG nova.compute.manager [req-f8013bb6-07bc-4dfd-8c02-13299dc74eac req-d28b3107-59ee-4d04-a17c-667da8e396ac service nova] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] No waiting events found dispatching network-vif-plugged-92c07803-de20-43a3-98cc-f663ecf1c733 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:43:47 user nova-compute[71321]: WARNING nova.compute.manager [req-f8013bb6-07bc-4dfd-8c02-13299dc74eac req-d28b3107-59ee-4d04-a17c-667da8e396ac service nova] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Received unexpected event network-vif-plugged-92c07803-de20-43a3-98cc-f663ecf1c733 for instance with vm_state building and task_state spawning.
Apr 12 12:43:49 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303429.1202383, d0592fff-d30d-40dc-95d3-263aab10a70e => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:43:49 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] VM Resumed (Lifecycle Event)
Apr 12 12:43:49 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:43:49 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:43:49 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Instance spawned successfully.
Apr 12 12:43:49 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:43:49 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:43:49 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:43:49 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:43:49 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:43:49 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:43:49 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:43:49 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:43:49 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:43:49 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:43:49 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303429.1213396, d0592fff-d30d-40dc-95d3-263aab10a70e => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:43:49 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] VM Started (Lifecycle Event)
Apr 12 12:43:49 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:43:49 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:43:49 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:43:49 user nova-compute[71321]: INFO nova.compute.manager [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Took 5.59 seconds to spawn the instance on the hypervisor.
Apr 12 12:43:49 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:43:49 user nova-compute[71321]: INFO nova.compute.manager [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Took 6.21 seconds to build instance.
Apr 12 12:43:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "d0592fff-d30d-40dc-95d3-263aab10a70e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.329s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:43:49 user nova-compute[71321]: DEBUG nova.compute.manager [req-9ee1df2c-d0b7-4970-98d2-155539ee63d8 req-4f52ee2f-9af6-43e5-bae2-45dcbb7f0134 service nova] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Received event network-vif-plugged-92c07803-de20-43a3-98cc-f663ecf1c733 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:43:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9ee1df2c-d0b7-4970-98d2-155539ee63d8 req-4f52ee2f-9af6-43e5-bae2-45dcbb7f0134 service nova] Acquiring lock "d0592fff-d30d-40dc-95d3-263aab10a70e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:43:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9ee1df2c-d0b7-4970-98d2-155539ee63d8 req-4f52ee2f-9af6-43e5-bae2-45dcbb7f0134 service nova] Lock "d0592fff-d30d-40dc-95d3-263aab10a70e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:43:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9ee1df2c-d0b7-4970-98d2-155539ee63d8 req-4f52ee2f-9af6-43e5-bae2-45dcbb7f0134 service nova] Lock "d0592fff-d30d-40dc-95d3-263aab10a70e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:43:49 user nova-compute[71321]: DEBUG nova.compute.manager [req-9ee1df2c-d0b7-4970-98d2-155539ee63d8 req-4f52ee2f-9af6-43e5-bae2-45dcbb7f0134 service nova] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] No waiting events found dispatching network-vif-plugged-92c07803-de20-43a3-98cc-f663ecf1c733 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:43:49 user nova-compute[71321]: WARNING nova.compute.manager [req-9ee1df2c-d0b7-4970-98d2-155539ee63d8 req-4f52ee2f-9af6-43e5-bae2-45dcbb7f0134 service nova] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Received unexpected event network-vif-plugged-92c07803-de20-43a3-98cc-f663ecf1c733 for instance with vm_state active and task_state None.
Apr 12 12:43:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:43:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:43:50 user nova-compute[71321]: INFO nova.compute.manager [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Unshelving
Apr 12 12:43:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:43:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:43:50 user nova-compute[71321]: DEBUG nova.objects.instance [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lazy-loading 'pci_requests' on Instance uuid 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:43:50 user nova-compute[71321]: DEBUG nova.objects.instance [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lazy-loading 'numa_topology' on Instance uuid 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:43:50 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:43:50 user nova-compute[71321]: INFO nova.compute.claims [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Claim successful on node user
Apr 12 12:43:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:50 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:43:50 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:43:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.327s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:43:50 user nova-compute[71321]: INFO nova.network.neutron [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Updating port 7e54d3ba-dd94-4d8c-adca-16b108135e54 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 12 12:43:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "refresh_cache-08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:43:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquired lock "refresh_cache-08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:43:51 user nova-compute[71321]: DEBUG nova.network.neutron [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:43:51 user nova-compute[71321]: DEBUG nova.compute.manager [req-a852fb97-8528-4568-a9b4-26694f1bf401 req-c4341513-9d07-4b7b-90c4-dde9787364d0 service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Received event network-changed-7e54d3ba-dd94-4d8c-adca-16b108135e54 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:43:51 user nova-compute[71321]: DEBUG nova.compute.manager [req-a852fb97-8528-4568-a9b4-26694f1bf401 req-c4341513-9d07-4b7b-90c4-dde9787364d0 service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Refreshing instance network info cache due to event network-changed-7e54d3ba-dd94-4d8c-adca-16b108135e54. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:43:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a852fb97-8528-4568-a9b4-26694f1bf401 req-c4341513-9d07-4b7b-90c4-dde9787364d0 service nova] Acquiring lock "refresh_cache-08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:43:51 user nova-compute[71321]: DEBUG nova.network.neutron [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Updating instance_info_cache with network_info: [{"id": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "address": "fa:16:3e:bc:a8:83", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e54d3ba-dd", "ovs_interfaceid": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:43:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Releasing lock "refresh_cache-08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:43:51 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:43:51 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Creating image(s)
Apr 12 12:43:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "/opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:43:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "/opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:43:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "/opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:43:51 user nova-compute[71321]: DEBUG nova.objects.instance [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lazy-loading 'trusted_certs' on Instance uuid 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:43:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a852fb97-8528-4568-a9b4-26694f1bf401 req-c4341513-9d07-4b7b-90c4-dde9787364d0 service nova] Acquired lock "refresh_cache-08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:43:51 user nova-compute[71321]: DEBUG nova.network.neutron [req-a852fb97-8528-4568-a9b4-26694f1bf401 req-c4341513-9d07-4b7b-90c4-dde9787364d0 service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Refreshing network info cache for port 7e54d3ba-dd94-4d8c-adca-16b108135e54 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:43:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "ee6e4d62d017fb9117a2598777b359d378f7780b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:43:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "ee6e4d62d017fb9117a2598777b359d378f7780b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:43:52 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee6e4d62d017fb9117a2598777b359d378f7780b.part --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:43:52 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee6e4d62d017fb9117a2598777b359d378f7780b.part --force-share --output=json" returned: 0 in 0.155s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:43:52 user nova-compute[71321]: DEBUG nova.virt.images [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 25818f81-d64c-4887-9b8b-a235c7f23e54 was qcow2, converting to raw {{(pid=71321) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 12:43:52 user nova-compute[71321]: DEBUG nova.privsep.utils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 12:43:52 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ee6e4d62d017fb9117a2598777b359d378f7780b.part /opt/stack/data/nova/instances/_base/ee6e4d62d017fb9117a2598777b359d378f7780b.converted {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:43:53 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ee6e4d62d017fb9117a2598777b359d378f7780b.part /opt/stack/data/nova/instances/_base/ee6e4d62d017fb9117a2598777b359d378f7780b.converted" returned: 0 in 0.459s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:43:53 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee6e4d62d017fb9117a2598777b359d378f7780b.converted --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:43:53 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee6e4d62d017fb9117a2598777b359d378f7780b.converted --force-share --output=json" returned: 0 in 0.145s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:43:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "ee6e4d62d017fb9117a2598777b359d378f7780b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.652s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:43:53 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee6e4d62d017fb9117a2598777b359d378f7780b --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:43:53 user nova-compute[71321]: DEBUG nova.network.neutron [req-a852fb97-8528-4568-a9b4-26694f1bf401 req-c4341513-9d07-4b7b-90c4-dde9787364d0 service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Updated VIF entry in instance network info cache for port 7e54d3ba-dd94-4d8c-adca-16b108135e54. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:43:53 user nova-compute[71321]: DEBUG nova.network.neutron [req-a852fb97-8528-4568-a9b4-26694f1bf401 req-c4341513-9d07-4b7b-90c4-dde9787364d0 service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Updating instance_info_cache with network_info: [{"id": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "address": "fa:16:3e:bc:a8:83", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e54d3ba-dd", "ovs_interfaceid": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:43:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a852fb97-8528-4568-a9b4-26694f1bf401 req-c4341513-9d07-4b7b-90c4-dde9787364d0 service nova] Releasing lock "refresh_cache-08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:43:53 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee6e4d62d017fb9117a2598777b359d378f7780b --force-share --output=json" returned: 0 in 0.141s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:43:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "ee6e4d62d017fb9117a2598777b359d378f7780b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:43:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "ee6e4d62d017fb9117a2598777b359d378f7780b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:43:53 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee6e4d62d017fb9117a2598777b359d378f7780b --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:43:53 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee6e4d62d017fb9117a2598777b359d378f7780b --force-share --output=json" returned: 0 in 0.162s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:43:53 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ee6e4d62d017fb9117a2598777b359d378f7780b,backing_fmt=raw /opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:43:53 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ee6e4d62d017fb9117a2598777b359d378f7780b,backing_fmt=raw /opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk 1073741824" returned: 0 in 0.054s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:43:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "ee6e4d62d017fb9117a2598777b359d378f7780b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:43:53 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee6e4d62d017fb9117a2598777b359d378f7780b --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:43:53 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee6e4d62d017fb9117a2598777b359d378f7780b --force-share --output=json" returned: 0 in 0.137s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:43:53 user nova-compute[71321]: DEBUG nova.objects.instance [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lazy-loading 'migration_context' on Instance uuid 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:43:54 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Rebasing disk image.
Apr 12 12:43:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:43:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.139s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:43:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 -F raw /opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:43:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 -F raw /opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk" returned: 0 in 2.274s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Ensure instance console log exists: /opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Start _get_guest_xml network_info=[{"id": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "address": "fa:16:3e:bc:a8:83", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e54d3ba-dd", "ovs_interfaceid": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='fe4f5ca678991ffde1a81f78a03d3228',container_format='bare',created_at=2023-04-12T12:41:58Z,direct_url=<?>,disk_format='qcow2',id=25818f81-d64c-4887-9b8b-a235c7f23e54,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-615902404-shelved',owner='5fec0c6dc7ab46b0b6b0a580252f40e3',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-12T12:42:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:43:56 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:43:56 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:43:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='fe4f5ca678991ffde1a81f78a03d3228',container_format='bare',created_at=2023-04-12T12:41:58Z,direct_url=<?>,disk_format='qcow2',id=25818f81-d64c-4887-9b8b-a235c7f23e54,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-615902404-shelved',owner='5fec0c6dc7ab46b0b6b0a580252f40e3',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-12T12:42:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG nova.objects.instance [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lazy-loading 'vcpu_model' on Instance uuid 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T12:40:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-615902404',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-615902404',id=26,image_ref='25818f81-d64c-4887-9b8b-a235c7f23e54',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-2116396079',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:40:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5fec0c6dc7ab46b0b6b0a580252f40e3',ramdisk_id='',reservation_id='r-hw62w5cz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2036744628',owner_user_name='tempest-AttachVolumeShelveTestJSON-2036744628-project-member',shelved_at='2023-04-12T12:42:01.476045',shelved_host='user',shelved_image_id='25818f81-d64c-4887-9b8b-a235c7f23e54'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:43:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e4935eed324b868477f8e88918364a',uuid=08f95333-8c01-4fb1-a2cb-4501e6b0d2a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "address": "fa:16:3e:bc:a8:83", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e54d3ba-dd", "ovs_interfaceid": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Converting VIF {"id": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "address": "fa:16:3e:bc:a8:83", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e54d3ba-dd", "ovs_interfaceid": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:a8:83,bridge_name='br-int',has_traffic_filtering=True,id=7e54d3ba-dd94-4d8c-adca-16b108135e54,network=Network(4ba97279-e122-4c2b-b931-dde33e1d71df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e54d3ba-dd') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG nova.objects.instance [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lazy-loading 'pci_devices' on Instance uuid 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:43:56 user nova-compute[71321]:   <uuid>08f95333-8c01-4fb1-a2cb-4501e6b0d2a5</uuid>
Apr 12 12:43:56 user nova-compute[71321]:   <name>instance-0000001a</name>
Apr 12 12:43:56 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:43:56 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:43:56 user nova-compute[71321]:   <metadata>
Apr 12 12:43:56 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:43:56 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:43:56 user nova-compute[71321]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-615902404</nova:name>
Apr 12 12:43:56 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:43:56</nova:creationTime>
Apr 12 12:43:56 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:43:56 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:43:56 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:43:56 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:43:56 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:43:56 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:43:56 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:43:56 user nova-compute[71321]:       <nova:owner>
Apr 12 12:43:56 user nova-compute[71321]:         <nova:user uuid="46e4935eed324b868477f8e88918364a">tempest-AttachVolumeShelveTestJSON-2036744628-project-member</nova:user>
Apr 12 12:43:56 user nova-compute[71321]:         <nova:project uuid="5fec0c6dc7ab46b0b6b0a580252f40e3">tempest-AttachVolumeShelveTestJSON-2036744628</nova:project>
Apr 12 12:43:56 user nova-compute[71321]:       </nova:owner>
Apr 12 12:43:56 user nova-compute[71321]:       <nova:root type="image" uuid="25818f81-d64c-4887-9b8b-a235c7f23e54"/>
Apr 12 12:43:56 user nova-compute[71321]:       <nova:ports>
Apr 12 12:43:56 user nova-compute[71321]:         <nova:port uuid="7e54d3ba-dd94-4d8c-adca-16b108135e54">
Apr 12 12:43:56 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 12:43:56 user nova-compute[71321]:         </nova:port>
Apr 12 12:43:56 user nova-compute[71321]:       </nova:ports>
Apr 12 12:43:56 user nova-compute[71321]:     </nova:instance>
Apr 12 12:43:56 user nova-compute[71321]:   </metadata>
Apr 12 12:43:56 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:43:56 user nova-compute[71321]:     <system>
Apr 12 12:43:56 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:43:56 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:43:56 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:43:56 user nova-compute[71321]:       <entry name="serial">08f95333-8c01-4fb1-a2cb-4501e6b0d2a5</entry>
Apr 12 12:43:56 user nova-compute[71321]:       <entry name="uuid">08f95333-8c01-4fb1-a2cb-4501e6b0d2a5</entry>
Apr 12 12:43:56 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:43:56 user nova-compute[71321]:     </system>
Apr 12 12:43:56 user nova-compute[71321]:   </sysinfo>
Apr 12 12:43:56 user nova-compute[71321]:   <os>
Apr 12 12:43:56 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:43:56 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:43:56 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:43:56 user nova-compute[71321]:   </os>
Apr 12 12:43:56 user nova-compute[71321]:   <features>
Apr 12 12:43:56 user nova-compute[71321]:     <acpi/>
Apr 12 12:43:56 user nova-compute[71321]:     <apic/>
Apr 12 12:43:56 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:43:56 user nova-compute[71321]:   </features>
Apr 12 12:43:56 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:43:56 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:43:56 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:43:56 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:43:56 user nova-compute[71321]:   </clock>
Apr 12 12:43:56 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:43:56 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:43:56 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:43:56 user nova-compute[71321]:   </cpu>
Apr 12 12:43:56 user nova-compute[71321]:   <devices>
Apr 12 12:43:56 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:43:56 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:43:56 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk"/>
Apr 12 12:43:56 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:43:56 user nova-compute[71321]:     </disk>
Apr 12 12:43:56 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:43:56 user nova-compute[71321]:       <mac address="fa:16:3e:bc:a8:83"/>
Apr 12 12:43:56 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:43:56 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:43:56 user nova-compute[71321]:       <target dev="tap7e54d3ba-dd"/>
Apr 12 12:43:56 user nova-compute[71321]:     </interface>
Apr 12 12:43:56 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:43:56 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/console.log" append="off"/>
Apr 12 12:43:56 user nova-compute[71321]:     </serial>
Apr 12 12:43:56 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:43:56 user nova-compute[71321]:     <video>
Apr 12 12:43:56 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:43:56 user nova-compute[71321]:     </video>
Apr 12 12:43:56 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:43:56 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:43:56 user nova-compute[71321]:     </rng>
Apr 12 12:43:56 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:43:56 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:43:56 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:43:56 user nova-compute[71321]:     </memballoon>
Apr 12 12:43:56 user nova-compute[71321]:   </devices>
Apr 12 12:43:56 user nova-compute[71321]: </domain>
Apr 12 12:43:56 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T12:40:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-615902404',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-615902404',id=26,image_ref='25818f81-d64c-4887-9b8b-a235c7f23e54',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-2116396079',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:40:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5fec0c6dc7ab46b0b6b0a580252f40e3',ramdisk_id='',reservation_id='r-hw62w5cz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2036744628',owner_user_name='tempest-AttachVolumeShelveTestJSON-2036744628-project-member',shelved_at='2023-04-12T12:42:01.476045',shelved_host='user',shelved_image_id='25818f81-d64c-4887-9b8b-a235c7f23e54'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:43:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e4935eed324b868477f8e88918364a',uuid=08f95333-8c01-4fb1-a2cb-4501e6b0d2a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "address": "fa:16:3e:bc:a8:83", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e54d3ba-dd", "ovs_interfaceid": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Converting VIF {"id": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "address": "fa:16:3e:bc:a8:83", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e54d3ba-dd", "ovs_interfaceid": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:a8:83,bridge_name='br-int',has_traffic_filtering=True,id=7e54d3ba-dd94-4d8c-adca-16b108135e54,network=Network(4ba97279-e122-4c2b-b931-dde33e1d71df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e54d3ba-dd') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG os_vif [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:a8:83,bridge_name='br-int',has_traffic_filtering=True,id=7e54d3ba-dd94-4d8c-adca-16b108135e54,network=Network(4ba97279-e122-4c2b-b931-dde33e1d71df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e54d3ba-dd') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e54d3ba-dd, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e54d3ba-dd, col_values=(('external_ids', {'iface-id': '7e54d3ba-dd94-4d8c-adca-16b108135e54', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:a8:83', 'vm-uuid': '08f95333-8c01-4fb1-a2cb-4501e6b0d2a5'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:56 user nova-compute[71321]: INFO os_vif [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:a8:83,bridge_name='br-int',has_traffic_filtering=True,id=7e54d3ba-dd94-4d8c-adca-16b108135e54,network=Network(4ba97279-e122-4c2b-b931-dde33e1d71df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e54d3ba-dd')
Apr 12 12:43:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:43:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] No VIF found with MAC fa:16:3e:bc:a8:83, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:43:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:58 user nova-compute[71321]: DEBUG nova.compute.manager [req-3eecfd30-4989-475d-9567-dac39e8493db req-8fdc595e-1fff-4ecf-b4ca-f0c8fae98536 service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Received event network-vif-plugged-7e54d3ba-dd94-4d8c-adca-16b108135e54 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:43:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3eecfd30-4989-475d-9567-dac39e8493db req-8fdc595e-1fff-4ecf-b4ca-f0c8fae98536 service nova] Acquiring lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:43:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3eecfd30-4989-475d-9567-dac39e8493db req-8fdc595e-1fff-4ecf-b4ca-f0c8fae98536 service nova] Lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:43:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3eecfd30-4989-475d-9567-dac39e8493db req-8fdc595e-1fff-4ecf-b4ca-f0c8fae98536 service nova] Lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:43:58 user nova-compute[71321]: DEBUG nova.compute.manager [req-3eecfd30-4989-475d-9567-dac39e8493db req-8fdc595e-1fff-4ecf-b4ca-f0c8fae98536 service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] No waiting events found dispatching network-vif-plugged-7e54d3ba-dd94-4d8c-adca-16b108135e54 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:43:58 user nova-compute[71321]: WARNING nova.compute.manager [req-3eecfd30-4989-475d-9567-dac39e8493db req-8fdc595e-1fff-4ecf-b4ca-f0c8fae98536 service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Received unexpected event network-vif-plugged-7e54d3ba-dd94-4d8c-adca-16b108135e54 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 12:43:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:43:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:00 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303440.2318292, 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:44:00 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] VM Resumed (Lifecycle Event)
Apr 12 12:44:00 user nova-compute[71321]: DEBUG nova.compute.manager [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:44:00 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:44:00 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Instance spawned successfully.
Apr 12 12:44:00 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:44:00 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:44:00 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:44:00 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303440.2390053, 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:44:00 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] VM Started (Lifecycle Event)
Apr 12 12:44:00 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:44:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:00 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:44:00 user nova-compute[71321]: DEBUG nova.compute.manager [req-0fa20d79-bf9f-4a5f-a9c6-26189b917a43 req-a55800f0-04e2-4abf-9d84-cbe9839b37e8 service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Received event network-vif-plugged-7e54d3ba-dd94-4d8c-adca-16b108135e54 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:44:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0fa20d79-bf9f-4a5f-a9c6-26189b917a43 req-a55800f0-04e2-4abf-9d84-cbe9839b37e8 service nova] Acquiring lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:44:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0fa20d79-bf9f-4a5f-a9c6-26189b917a43 req-a55800f0-04e2-4abf-9d84-cbe9839b37e8 service nova] Lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:44:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0fa20d79-bf9f-4a5f-a9c6-26189b917a43 req-a55800f0-04e2-4abf-9d84-cbe9839b37e8 service nova] Lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:44:00 user nova-compute[71321]: DEBUG nova.compute.manager [req-0fa20d79-bf9f-4a5f-a9c6-26189b917a43 req-a55800f0-04e2-4abf-9d84-cbe9839b37e8 service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] No waiting events found dispatching network-vif-plugged-7e54d3ba-dd94-4d8c-adca-16b108135e54 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:44:00 user nova-compute[71321]: WARNING nova.compute.manager [req-0fa20d79-bf9f-4a5f-a9c6-26189b917a43 req-a55800f0-04e2-4abf-9d84-cbe9839b37e8 service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Received unexpected event network-vif-plugged-7e54d3ba-dd94-4d8c-adca-16b108135e54 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 12:44:00 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:44:00 user nova-compute[71321]: DEBUG nova.compute.manager [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:44:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.376s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:44:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:12 user nova-compute[71321]: DEBUG nova.compute.manager [req-808fe832-be88-4318-8a10-33190fca936c req-5cedd400-985a-4613-aac2-fb96b25b909c service nova] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Received event network-changed-bf3129f6-4466-41a8-a974-86182f2e209e {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:44:12 user nova-compute[71321]: DEBUG nova.compute.manager [req-808fe832-be88-4318-8a10-33190fca936c req-5cedd400-985a-4613-aac2-fb96b25b909c service nova] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Refreshing instance network info cache due to event network-changed-bf3129f6-4466-41a8-a974-86182f2e209e. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:44:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-808fe832-be88-4318-8a10-33190fca936c req-5cedd400-985a-4613-aac2-fb96b25b909c service nova] Acquiring lock "refresh_cache-88e09fde-0a42-4066-b1f5-413903476735" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:44:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-808fe832-be88-4318-8a10-33190fca936c req-5cedd400-985a-4613-aac2-fb96b25b909c service nova] Acquired lock "refresh_cache-88e09fde-0a42-4066-b1f5-413903476735" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:44:12 user nova-compute[71321]: DEBUG nova.network.neutron [req-808fe832-be88-4318-8a10-33190fca936c req-5cedd400-985a-4613-aac2-fb96b25b909c service nova] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Refreshing network info cache for port bf3129f6-4466-41a8-a974-86182f2e209e {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:44:12 user nova-compute[71321]: DEBUG nova.network.neutron [req-808fe832-be88-4318-8a10-33190fca936c req-5cedd400-985a-4613-aac2-fb96b25b909c service nova] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Updated VIF entry in instance network info cache for port bf3129f6-4466-41a8-a974-86182f2e209e. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:44:12 user nova-compute[71321]: DEBUG nova.network.neutron [req-808fe832-be88-4318-8a10-33190fca936c req-5cedd400-985a-4613-aac2-fb96b25b909c service nova] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Updating instance_info_cache with network_info: [{"id": "bf3129f6-4466-41a8-a974-86182f2e209e", "address": "fa:16:3e:07:2e:ee", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf3129f6-44", "ovs_interfaceid": "bf3129f6-4466-41a8-a974-86182f2e209e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:44:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-808fe832-be88-4318-8a10-33190fca936c req-5cedd400-985a-4613-aac2-fb96b25b909c service nova] Releasing lock "refresh_cache-88e09fde-0a42-4066-b1f5-413903476735" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:44:13 user nova-compute[71321]: DEBUG nova.compute.manager [req-1696cecd-f422-4336-a371-d3cb0b40cda9 req-c05a1642-85d5-481f-a797-ca19051d1667 service nova] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Received event network-changed-bf3129f6-4466-41a8-a974-86182f2e209e {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:44:13 user nova-compute[71321]: DEBUG nova.compute.manager [req-1696cecd-f422-4336-a371-d3cb0b40cda9 req-c05a1642-85d5-481f-a797-ca19051d1667 service nova] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Refreshing instance network info cache due to event network-changed-bf3129f6-4466-41a8-a974-86182f2e209e. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:44:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-1696cecd-f422-4336-a371-d3cb0b40cda9 req-c05a1642-85d5-481f-a797-ca19051d1667 service nova] Acquiring lock "refresh_cache-88e09fde-0a42-4066-b1f5-413903476735" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:44:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-1696cecd-f422-4336-a371-d3cb0b40cda9 req-c05a1642-85d5-481f-a797-ca19051d1667 service nova] Acquired lock "refresh_cache-88e09fde-0a42-4066-b1f5-413903476735" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:44:13 user nova-compute[71321]: DEBUG nova.network.neutron [req-1696cecd-f422-4336-a371-d3cb0b40cda9 req-c05a1642-85d5-481f-a797-ca19051d1667 service nova] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Refreshing network info cache for port bf3129f6-4466-41a8-a974-86182f2e209e {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:44:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "88e09fde-0a42-4066-b1f5-413903476735" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:44:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "88e09fde-0a42-4066-b1f5-413903476735" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:44:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "88e09fde-0a42-4066-b1f5-413903476735-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:44:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "88e09fde-0a42-4066-b1f5-413903476735-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:44:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "88e09fde-0a42-4066-b1f5-413903476735-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:44:13 user nova-compute[71321]: INFO nova.compute.manager [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Terminating instance
Apr 12 12:44:13 user nova-compute[71321]: DEBUG nova.compute.manager [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:44:13 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:13 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:13 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:13 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:13 user nova-compute[71321]: DEBUG nova.network.neutron [req-1696cecd-f422-4336-a371-d3cb0b40cda9 req-c05a1642-85d5-481f-a797-ca19051d1667 service nova] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Updated VIF entry in instance network info cache for port bf3129f6-4466-41a8-a974-86182f2e209e. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:44:13 user nova-compute[71321]: DEBUG nova.network.neutron [req-1696cecd-f422-4336-a371-d3cb0b40cda9 req-c05a1642-85d5-481f-a797-ca19051d1667 service nova] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Updating instance_info_cache with network_info: [{"id": "bf3129f6-4466-41a8-a974-86182f2e209e", "address": "fa:16:3e:07:2e:ee", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf3129f6-44", "ovs_interfaceid": "bf3129f6-4466-41a8-a974-86182f2e209e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:44:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-1696cecd-f422-4336-a371-d3cb0b40cda9 req-c05a1642-85d5-481f-a797-ca19051d1667 service nova] Releasing lock "refresh_cache-88e09fde-0a42-4066-b1f5-413903476735" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:14 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Instance destroyed successfully.
Apr 12 12:44:14 user nova-compute[71321]: DEBUG nova.objects.instance [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lazy-loading 'resources' on Instance uuid 88e09fde-0a42-4066-b1f5-413903476735 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:42:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-55213853',display_name='tempest-TestVolumeBootPattern-server-55213853',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-55213853',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsgnjp9DU7mhDKOnejfarx74lKPsdA7XFVVac0IXQsHunQgmiZdnkpBnb9o+2GfDpfLr3Vtu/GonERs5AS6wpKwmtd3eb4XJchkGev4GCvYiSWT7o/Zl3+nrrnYoAMm1w==',key_name='tempest-TestVolumeBootPattern-1044387718',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:42:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ada441da2124adda751365952320e81',ramdisk_id='',reservation_id='r-0orssmtm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-310589135',owner_user_name='tempest-TestVolumeBootPattern-310589135-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:42:31Z,user_data=None,user_id='076e65b43f664765ad1d48be6e814f40',uuid=88e09fde-0a42-4066-b1f5-413903476735,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf3129f6-4466-41a8-a974-86182f2e209e", "address": "fa:16:3e:07:2e:ee", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf3129f6-44", "ovs_interfaceid": "bf3129f6-4466-41a8-a974-86182f2e209e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converting VIF {"id": "bf3129f6-4466-41a8-a974-86182f2e209e", "address": "fa:16:3e:07:2e:ee", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf3129f6-44", "ovs_interfaceid": "bf3129f6-4466-41a8-a974-86182f2e209e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:2e:ee,bridge_name='br-int',has_traffic_filtering=True,id=bf3129f6-4466-41a8-a974-86182f2e209e,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf3129f6-44') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG os_vif [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:2e:ee,bridge_name='br-int',has_traffic_filtering=True,id=bf3129f6-4466-41a8-a974-86182f2e209e,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf3129f6-44') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf3129f6-44, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:14 user nova-compute[71321]: INFO os_vif [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:2e:ee,bridge_name='br-int',has_traffic_filtering=True,id=bf3129f6-4466-41a8-a974-86182f2e209e,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf3129f6-44')
Apr 12 12:44:14 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bVSoJMNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:44:14 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:44:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c42bd8-f2b3-4ab5-bf85-523ae4baeea4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:44:14 user nova-compute[71321]: No targets found.
Apr 12 12:44:14 user nova-compute[71321]: iSNS:
Apr 12 12:44:14 user nova-compute[71321]: No targets found.
Apr 12 12:44:14 user nova-compute[71321]: STATIC:
Apr 12 12:44:14 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5
Apr 12 12:44:14 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:44:14 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:44:14 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d
Apr 12 12:44:14 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:44:14 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:44:14 user nova-compute[71321]: FIRMWARE:
Apr 12 12:44:14 user nova-compute[71321]: No targets found.
Apr 12 12:44:14 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:44:14 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:44:14 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6143437-afa1-44f7-98e1-296150c6161b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a80afa9-9180-4a98-a422-823ba41d89d8]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:44:14 user nova-compute[71321]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d (non-flash)
Apr 12 12:44:14 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:44:14 user nova-compute[71321]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d (non-flash)
Apr 12 12:44:14 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef642c5f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d'): ({'sdc'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Removing single pathed devices sdc {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09a16ca-786f-4ade-a4e1-15d46b7295d3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd97dd0-0c56-4c57-80f5-b60b62792549]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Flushing IO for device /dev/sdc {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8165601a-a70c-4d79-859d-9782f1d51a2f]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a2dfac-f47f-4de9-86e8-b706c75ba119]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] SCSI volumes sdc have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO5fefaf21-ea576d1a1bc39366', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5fefaf21', '/dev/disk/by-id/scsi-26561353736643161') {{(pid=81736) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73f344b-1878-4336-ab92-36e79b9744fd]: (4, None) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbe37d7-251d-4985-ac31-dc506d8edbcc]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9b75e0-94a8-4f7e-a4e6-fe8429ddfdf5]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d, portal: 172.16.0.220,3260]
Apr 12 12:44:14 user nova-compute[71321]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d, portal: 172.16.0.220,3260] successful.
Apr 12 12:44:14 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d51c851-3ddf-4ff7-bdc0-982cf356bc0d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85a8d46-52f4-40d7-a162-43219cfdb46f]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] <== disconnect_volume: return (339ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:44:14 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Deleting instance files /opt/stack/data/nova/instances/88e09fde-0a42-4066-b1f5-413903476735_del
Apr 12 12:44:14 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Deletion of /opt/stack/data/nova/instances/88e09fde-0a42-4066-b1f5-413903476735_del complete
Apr 12 12:44:14 user nova-compute[71321]: INFO nova.compute.manager [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Took 1.28 seconds to destroy the instance on the hypervisor.
Apr 12 12:44:14 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:44:14 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 88e09fde-0a42-4066-b1f5-413903476735] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:44:15 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:44:15 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Took 0.45 seconds to deallocate network for instance.
Apr 12 12:44:15 user nova-compute[71321]: DEBUG nova.compute.manager [req-3bf40370-5ee6-4339-ace7-3f112425cf85 req-2f624627-ca74-4e26-99d6-af92beae81c4 service nova] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Received event network-vif-deleted-bf3129f6-4466-41a8-a974-86182f2e209e {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:44:15 user nova-compute[71321]: INFO nova.compute.manager [req-3bf40370-5ee6-4339-ace7-3f112425cf85 req-2f624627-ca74-4e26-99d6-af92beae81c4 service nova] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Neutron deleted interface bf3129f6-4466-41a8-a974-86182f2e209e; detaching it from the instance and deleting it from the info cache
Apr 12 12:44:15 user nova-compute[71321]: DEBUG nova.network.neutron [req-3bf40370-5ee6-4339-ace7-3f112425cf85 req-2f624627-ca74-4e26-99d6-af92beae81c4 service nova] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:44:15 user nova-compute[71321]: DEBUG nova.compute.manager [req-3bf40370-5ee6-4339-ace7-3f112425cf85 req-2f624627-ca74-4e26-99d6-af92beae81c4 service nova] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Detach interface failed, port_id=bf3129f6-4466-41a8-a974-86182f2e209e, reason: Instance 88e09fde-0a42-4066-b1f5-413903476735 could not be found. {{(pid=71321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 12:44:15 user nova-compute[71321]: DEBUG nova.compute.manager [req-f82e90da-fac5-4a3c-8ea2-3d50b4582ae6 req-d9d446d9-e476-4291-b809-df1f56ebe8b7 service nova] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Received event network-vif-unplugged-bf3129f6-4466-41a8-a974-86182f2e209e {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:44:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f82e90da-fac5-4a3c-8ea2-3d50b4582ae6 req-d9d446d9-e476-4291-b809-df1f56ebe8b7 service nova] Acquiring lock "88e09fde-0a42-4066-b1f5-413903476735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:44:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f82e90da-fac5-4a3c-8ea2-3d50b4582ae6 req-d9d446d9-e476-4291-b809-df1f56ebe8b7 service nova] Lock "88e09fde-0a42-4066-b1f5-413903476735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:44:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f82e90da-fac5-4a3c-8ea2-3d50b4582ae6 req-d9d446d9-e476-4291-b809-df1f56ebe8b7 service nova] Lock "88e09fde-0a42-4066-b1f5-413903476735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:44:15 user nova-compute[71321]: DEBUG nova.compute.manager [req-f82e90da-fac5-4a3c-8ea2-3d50b4582ae6 req-d9d446d9-e476-4291-b809-df1f56ebe8b7 service nova] [instance: 88e09fde-0a42-4066-b1f5-413903476735] No waiting events found dispatching network-vif-unplugged-bf3129f6-4466-41a8-a974-86182f2e209e {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:44:15 user nova-compute[71321]: DEBUG nova.compute.manager [req-f82e90da-fac5-4a3c-8ea2-3d50b4582ae6 req-d9d446d9-e476-4291-b809-df1f56ebe8b7 service nova] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Received event network-vif-unplugged-bf3129f6-4466-41a8-a974-86182f2e209e for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:44:15 user nova-compute[71321]: DEBUG nova.compute.manager [req-f82e90da-fac5-4a3c-8ea2-3d50b4582ae6 req-d9d446d9-e476-4291-b809-df1f56ebe8b7 service nova] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Received event network-vif-plugged-bf3129f6-4466-41a8-a974-86182f2e209e {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:44:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f82e90da-fac5-4a3c-8ea2-3d50b4582ae6 req-d9d446d9-e476-4291-b809-df1f56ebe8b7 service nova] Acquiring lock "88e09fde-0a42-4066-b1f5-413903476735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:44:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f82e90da-fac5-4a3c-8ea2-3d50b4582ae6 req-d9d446d9-e476-4291-b809-df1f56ebe8b7 service nova] Lock "88e09fde-0a42-4066-b1f5-413903476735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:44:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f82e90da-fac5-4a3c-8ea2-3d50b4582ae6 req-d9d446d9-e476-4291-b809-df1f56ebe8b7 service nova] Lock "88e09fde-0a42-4066-b1f5-413903476735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:44:15 user nova-compute[71321]: DEBUG nova.compute.manager [req-f82e90da-fac5-4a3c-8ea2-3d50b4582ae6 req-d9d446d9-e476-4291-b809-df1f56ebe8b7 service nova] [instance: 88e09fde-0a42-4066-b1f5-413903476735] No waiting events found dispatching network-vif-plugged-bf3129f6-4466-41a8-a974-86182f2e209e {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:44:15 user nova-compute[71321]: WARNING nova.compute.manager [req-f82e90da-fac5-4a3c-8ea2-3d50b4582ae6 req-d9d446d9-e476-4291-b809-df1f56ebe8b7 service nova] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Received unexpected event network-vif-plugged-bf3129f6-4466-41a8-a974-86182f2e209e for instance with vm_state active and task_state deleting.
Apr 12 12:44:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:15 user nova-compute[71321]: INFO nova.compute.manager [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Took 0.83 seconds to detach 1 volumes for instance.
Apr 12 12:44:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:44:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:44:16 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:44:16 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:44:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:44:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-21d41bb5-61f6-4b6b-88ab-e208d8301dd5 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:44:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-21d41bb5-61f6-4b6b-88ab-e208d8301dd5 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:44:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-21d41bb5-61f6-4b6b-88ab-e208d8301dd5 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:44:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-21d41bb5-61f6-4b6b-88ab-e208d8301dd5 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:44:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-21d41bb5-61f6-4b6b-88ab-e208d8301dd5 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:44:16 user nova-compute[71321]: INFO nova.compute.manager [None req-21d41bb5-61f6-4b6b-88ab-e208d8301dd5 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Terminating instance
Apr 12 12:44:16 user nova-compute[71321]: DEBUG nova.compute.manager [None req-21d41bb5-61f6-4b6b-88ab-e208d8301dd5 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:44:16 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Deleted allocations for instance 88e09fde-0a42-4066-b1f5-413903476735
Apr 12 12:44:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "88e09fde-0a42-4066-b1f5-413903476735" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.066s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:44:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:17 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Instance destroyed successfully.
Apr 12 12:44:17 user nova-compute[71321]: DEBUG nova.objects.instance [None req-21d41bb5-61f6-4b6b-88ab-e208d8301dd5 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'resources' on Instance uuid a4107f2d-88e4-4846-9ece-cb16ad7ecd02 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:44:17 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-21d41bb5-61f6-4b6b-88ab-e208d8301dd5 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:28:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-633086399',display_name='tempest-ServerRescueNegativeTestJSON-server-633086399',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-633086399',id=2,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:30:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9ec9671123c4a00a2880de4b4df8d3e',ramdisk_id='',reservation_id='r-s30bwkvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1979263125',owner_user_name='tempest-ServerRescueNegativeTestJSON-1979263125-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:30:13Z,user_data=None,user_id='1db0203a6e6f4cc3bccbf19577a0c82f',uuid=a4107f2d-88e4-4846-9ece-cb16ad7ecd02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "5680054b-9363-4825-ade2-add800d7142b", "address": "fa:16:3e:08:27:b7", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5680054b-93", "ovs_interfaceid": "5680054b-9363-4825-ade2-add800d7142b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:44:17 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-21d41bb5-61f6-4b6b-88ab-e208d8301dd5 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Converting VIF {"id": "5680054b-9363-4825-ade2-add800d7142b", "address": "fa:16:3e:08:27:b7", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5680054b-93", "ovs_interfaceid": "5680054b-9363-4825-ade2-add800d7142b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:44:17 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-21d41bb5-61f6-4b6b-88ab-e208d8301dd5 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:27:b7,bridge_name='br-int',has_traffic_filtering=True,id=5680054b-9363-4825-ade2-add800d7142b,network=Network(0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5680054b-93') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:44:17 user nova-compute[71321]: DEBUG os_vif [None req-21d41bb5-61f6-4b6b-88ab-e208d8301dd5 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:27:b7,bridge_name='br-int',has_traffic_filtering=True,id=5680054b-9363-4825-ade2-add800d7142b,network=Network(0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5680054b-93') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:44:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5680054b-93, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:44:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:44:17 user nova-compute[71321]: INFO os_vif [None req-21d41bb5-61f6-4b6b-88ab-e208d8301dd5 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:27:b7,bridge_name='br-int',has_traffic_filtering=True,id=5680054b-9363-4825-ade2-add800d7142b,network=Network(0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5680054b-93')
Apr 12 12:44:17 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-21d41bb5-61f6-4b6b-88ab-e208d8301dd5 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Deleting instance files /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02_del
Apr 12 12:44:17 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-21d41bb5-61f6-4b6b-88ab-e208d8301dd5 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Deletion of /opt/stack/data/nova/instances/a4107f2d-88e4-4846-9ece-cb16ad7ecd02_del complete
Apr 12 12:44:17 user nova-compute[71321]: DEBUG nova.compute.manager [req-b549fdfb-dac4-4ec1-9052-71a849417f43 req-3465afde-ed69-41ac-b7b9-f681a2bdd36b service nova] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Received event network-vif-unplugged-5680054b-9363-4825-ade2-add800d7142b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:44:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b549fdfb-dac4-4ec1-9052-71a849417f43 req-3465afde-ed69-41ac-b7b9-f681a2bdd36b service nova] Acquiring lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:44:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b549fdfb-dac4-4ec1-9052-71a849417f43 req-3465afde-ed69-41ac-b7b9-f681a2bdd36b service nova] Lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:44:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b549fdfb-dac4-4ec1-9052-71a849417f43 req-3465afde-ed69-41ac-b7b9-f681a2bdd36b service nova] Lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:44:17 user nova-compute[71321]: DEBUG nova.compute.manager [req-b549fdfb-dac4-4ec1-9052-71a849417f43 req-3465afde-ed69-41ac-b7b9-f681a2bdd36b service nova] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] No waiting events found dispatching network-vif-unplugged-5680054b-9363-4825-ade2-add800d7142b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:44:17 user nova-compute[71321]: DEBUG nova.compute.manager [req-b549fdfb-dac4-4ec1-9052-71a849417f43 req-3465afde-ed69-41ac-b7b9-f681a2bdd36b service nova] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Received event network-vif-unplugged-5680054b-9363-4825-ade2-add800d7142b for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:44:17 user nova-compute[71321]: DEBUG nova.compute.manager [req-b549fdfb-dac4-4ec1-9052-71a849417f43 req-3465afde-ed69-41ac-b7b9-f681a2bdd36b service nova] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Received event network-vif-plugged-5680054b-9363-4825-ade2-add800d7142b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:44:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b549fdfb-dac4-4ec1-9052-71a849417f43 req-3465afde-ed69-41ac-b7b9-f681a2bdd36b service nova] Acquiring lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:44:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b549fdfb-dac4-4ec1-9052-71a849417f43 req-3465afde-ed69-41ac-b7b9-f681a2bdd36b service nova] Lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:44:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b549fdfb-dac4-4ec1-9052-71a849417f43 req-3465afde-ed69-41ac-b7b9-f681a2bdd36b service nova] Lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:44:17 user nova-compute[71321]: DEBUG nova.compute.manager [req-b549fdfb-dac4-4ec1-9052-71a849417f43 req-3465afde-ed69-41ac-b7b9-f681a2bdd36b service nova] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] No waiting events found dispatching network-vif-plugged-5680054b-9363-4825-ade2-add800d7142b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:44:17 user nova-compute[71321]: WARNING nova.compute.manager [req-b549fdfb-dac4-4ec1-9052-71a849417f43 req-3465afde-ed69-41ac-b7b9-f681a2bdd36b service nova] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Received unexpected event network-vif-plugged-5680054b-9363-4825-ade2-add800d7142b for instance with vm_state rescued and task_state deleting.
Apr 12 12:44:17 user nova-compute[71321]: INFO nova.compute.manager [None req-21d41bb5-61f6-4b6b-88ab-e208d8301dd5 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 12 12:44:17 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-21d41bb5-61f6-4b6b-88ab-e208d8301dd5 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:44:17 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:44:17 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:44:17 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:44:17 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Took 0.48 seconds to deallocate network for instance.
Apr 12 12:44:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-21d41bb5-61f6-4b6b-88ab-e208d8301dd5 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:44:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-21d41bb5-61f6-4b6b-88ab-e208d8301dd5 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:44:17 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-21d41bb5-61f6-4b6b-88ab-e208d8301dd5 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:44:17 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-21d41bb5-61f6-4b6b-88ab-e208d8301dd5 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:44:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-21d41bb5-61f6-4b6b-88ab-e208d8301dd5 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.244s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:44:18 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-21d41bb5-61f6-4b6b-88ab-e208d8301dd5 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Deleted allocations for instance a4107f2d-88e4-4846-9ece-cb16ad7ecd02
Apr 12 12:44:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-21d41bb5-61f6-4b6b-88ab-e208d8301dd5 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "a4107f2d-88e4-4846-9ece-cb16ad7ecd02" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.810s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:44:18 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:44:18 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71321) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 12:44:19 user nova-compute[71321]: DEBUG nova.compute.manager [req-46f4c420-3550-48fd-b59c-4bcf62767aa1 req-95593cae-e297-4e40-a35e-911d5d091205 service nova] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Received event network-vif-deleted-5680054b-9363-4825-ade2-add800d7142b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:44:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:20 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:44:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:24 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:44:24 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:44:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:44:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:44:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:44:24 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:44:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:44:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:44:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:44:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:44:24 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:44:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:44:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:44:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:44:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:44:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:44:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:44:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:44:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:44:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0592fff-d30d-40dc-95d3-263aab10a70e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:44:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0592fff-d30d-40dc-95d3-263aab10a70e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:44:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0592fff-d30d-40dc-95d3-263aab10a70e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:44:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0592fff-d30d-40dc-95d3-263aab10a70e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:44:26 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:44:26 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:44:26 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8249MB free_disk=26.431285858154297GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:44:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:44:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:44:26 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 10116da0-785c-41cf-96bb-95721af863db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:44:26 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:44:26 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:44:26 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance d0592fff-d30d-40dc-95d3-263aab10a70e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:44:26 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:44:26 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:44:26 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:44:26 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:44:26 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:44:26 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:44:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.348s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:44:27 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:44:28 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:44:28 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:44:28 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:44:28 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:44:28 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:44:29 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681303454.2134428, 88e09fde-0a42-4066-b1f5-413903476735 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:44:29 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 88e09fde-0a42-4066-b1f5-413903476735] VM Stopped (Lifecycle Event)
Apr 12 12:44:29 user nova-compute[71321]: DEBUG nova.compute.manager [None req-763ca561-0c9a-4722-abce-a1a7101ba597 None None] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:44:29 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:44:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:30 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:44:30 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:44:30 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:44:30 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Rebuilding the list of instances to heal {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 12:44:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-10116da0-785c-41cf-96bb-95721af863db" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:44:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-10116da0-785c-41cf-96bb-95721af863db" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:44:30 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 12:44:30 user nova-compute[71321]: DEBUG nova.objects.instance [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lazy-loading 'info_cache' on Instance uuid 10116da0-785c-41cf-96bb-95721af863db {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:44:30 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] Updating instance_info_cache with network_info: [{"id": "cbb69638-6a5f-4d12-8737-45850145fa0e", "address": "fa:16:3e:57:7c:99", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb69638-6a", "ovs_interfaceid": "cbb69638-6a5f-4d12-8737-45850145fa0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:44:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-10116da0-785c-41cf-96bb-95721af863db" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:44:30 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 12:44:30 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:44:30 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Cleaning up deleted instances {{(pid=71321) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 12:44:31 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] There are 0 instances to clean {{(pid=71321) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 12:44:32 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681303457.0995703, a4107f2d-88e4-4846-9ece-cb16ad7ecd02 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:44:32 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] VM Stopped (Lifecycle Event)
Apr 12 12:44:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9aab0b4-1feb-4126-b1fe-337434b3ff7a None None] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:44:32 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:32 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:44:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Triggering sync for uuid 10116da0-785c-41cf-96bb-95721af863db {{(pid=71321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 12:44:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Triggering sync for uuid 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 {{(pid=71321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 12:44:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Triggering sync for uuid 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 {{(pid=71321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 12:44:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Triggering sync for uuid a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 {{(pid=71321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 12:44:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Triggering sync for uuid d0592fff-d30d-40dc-95d3-263aab10a70e {{(pid=71321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 12:44:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "10116da0-785c-41cf-96bb-95721af863db" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:44:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "10116da0-785c-41cf-96bb-95721af863db" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:44:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:44:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:44:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:44:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:44:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:44:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:44:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "d0592fff-d30d-40dc-95d3-263aab10a70e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:44:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "d0592fff-d30d-40dc-95d3-263aab10a70e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.003s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:44:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "10116da0-785c-41cf-96bb-95721af863db" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:44:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:44:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:44:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:44:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "d0592fff-d30d-40dc-95d3-263aab10a70e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:44:35 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:44:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:44:42 user nova-compute[71321]: DEBUG nova.compute.manager [req-0931750a-36c2-4f84-a467-364231cb8c2e req-930a449b-ea1e-4692-a152-77a8f4ee93f9 service nova] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Received event network-changed-01ee163a-4590-4b09-bcb5-a53d238252d8 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:44:42 user nova-compute[71321]: DEBUG nova.compute.manager [req-0931750a-36c2-4f84-a467-364231cb8c2e req-930a449b-ea1e-4692-a152-77a8f4ee93f9 service nova] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Refreshing instance network info cache due to event network-changed-01ee163a-4590-4b09-bcb5-a53d238252d8. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:44:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0931750a-36c2-4f84-a467-364231cb8c2e req-930a449b-ea1e-4692-a152-77a8f4ee93f9 service nova] Acquiring lock "refresh_cache-a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:44:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0931750a-36c2-4f84-a467-364231cb8c2e req-930a449b-ea1e-4692-a152-77a8f4ee93f9 service nova] Acquired lock "refresh_cache-a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:44:42 user nova-compute[71321]: DEBUG nova.network.neutron [req-0931750a-36c2-4f84-a467-364231cb8c2e req-930a449b-ea1e-4692-a152-77a8f4ee93f9 service nova] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Refreshing network info cache for port 01ee163a-4590-4b09-bcb5-a53d238252d8 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:44:42 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:44:42 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:44:42 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 12:44:42 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 12:44:42 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 12:44:42 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:42 user nova-compute[71321]: DEBUG nova.network.neutron [req-0931750a-36c2-4f84-a467-364231cb8c2e req-930a449b-ea1e-4692-a152-77a8f4ee93f9 service nova] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Updated VIF entry in instance network info cache for port 01ee163a-4590-4b09-bcb5-a53d238252d8. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:44:42 user nova-compute[71321]: DEBUG nova.network.neutron [req-0931750a-36c2-4f84-a467-364231cb8c2e req-930a449b-ea1e-4692-a152-77a8f4ee93f9 service nova] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Updating instance_info_cache with network_info: [{"id": "01ee163a-4590-4b09-bcb5-a53d238252d8", "address": "fa:16:3e:36:a3:07", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01ee163a-45", "ovs_interfaceid": "01ee163a-4590-4b09-bcb5-a53d238252d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:44:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0931750a-36c2-4f84-a467-364231cb8c2e req-930a449b-ea1e-4692-a152-77a8f4ee93f9 service nova] Releasing lock "refresh_cache-a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:44:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "62452efb-3a12-4aff-9359-217d17fc052a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:44:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "62452efb-3a12-4aff-9359-217d17fc052a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:44:46 user nova-compute[71321]: DEBUG nova.compute.manager [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:44:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:44:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:44:46 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:44:46 user nova-compute[71321]: INFO nova.compute.claims [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Claim successful on node user
Apr 12 12:44:46 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:44:46 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:44:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.301s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:44:46 user nova-compute[71321]: DEBUG nova.compute.manager [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:44:46 user nova-compute[71321]: DEBUG nova.compute.manager [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:44:46 user nova-compute[71321]: DEBUG nova.network.neutron [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:44:46 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:44:46 user nova-compute[71321]: DEBUG nova.compute.manager [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:44:46 user nova-compute[71321]: INFO nova.virt.block_device [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Booting with volume 3f8c0fb4-a50b-4195-ba6a-8e98f3360491 at /dev/vda
Apr 12 12:44:46 user nova-compute[71321]: DEBUG nova.policy [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:44:46 user nova-compute[71321]: DEBUG os_brick.utils [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:44:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:44:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:44:46 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[62364502-8934-4d57-bd99-e332be5db133]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:44:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:44:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:44:46 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d03716-6114-4307-9a57-44d05dc41014]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:44:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:44:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:44:46 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfd5c7f-0473-4c9b-a438-d65f912aa1f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:44:46 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[48625d94-81e4-42c9-98a9-06462c6948de]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:44:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:44:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:44:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:44:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:44:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:44:47 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:44:47 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83919b2-9e5a-4fc8-8074-7a7f4ef5bd3c]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:44:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:44:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:44:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:44:47 user nova-compute[71321]: DEBUG os_brick.utils [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:44:47 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Updating existing volume attachment record: 2ed74214-1546-4d82-9301-1d30acb59f75 {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:44:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:47 user nova-compute[71321]: DEBUG nova.network.neutron [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Successfully created port: 6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:44:48 user nova-compute[71321]: DEBUG nova.network.neutron [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Successfully updated port: 6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:44:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "refresh_cache-62452efb-3a12-4aff-9359-217d17fc052a" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:44:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquired lock "refresh_cache-62452efb-3a12-4aff-9359-217d17fc052a" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:44:48 user nova-compute[71321]: DEBUG nova.network.neutron [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:44:48 user nova-compute[71321]: DEBUG nova.compute.manager [req-cfce8ea6-83f5-4535-9846-0e8b380dcf26 req-c363acde-f078-400a-a7db-800424d61063 service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Received event network-changed-6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:44:48 user nova-compute[71321]: DEBUG nova.compute.manager [req-cfce8ea6-83f5-4535-9846-0e8b380dcf26 req-c363acde-f078-400a-a7db-800424d61063 service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Refreshing instance network info cache due to event network-changed-6ea59aa7-b979-4fa0-b26b-cf96ad5addb2. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:44:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-cfce8ea6-83f5-4535-9846-0e8b380dcf26 req-c363acde-f078-400a-a7db-800424d61063 service nova] Acquiring lock "refresh_cache-62452efb-3a12-4aff-9359-217d17fc052a" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:44:48 user nova-compute[71321]: DEBUG nova.network.neutron [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:44:48 user nova-compute[71321]: DEBUG nova.network.neutron [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Updating instance_info_cache with network_info: [{"id": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "address": "fa:16:3e:c6:61:66", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea59aa7-b9", "ovs_interfaceid": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:44:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Releasing lock "refresh_cache-62452efb-3a12-4aff-9359-217d17fc052a" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:44:48 user nova-compute[71321]: DEBUG nova.compute.manager [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Instance network_info: |[{"id": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "address": "fa:16:3e:c6:61:66", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea59aa7-b9", "ovs_interfaceid": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:44:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-cfce8ea6-83f5-4535-9846-0e8b380dcf26 req-c363acde-f078-400a-a7db-800424d61063 service nova] Acquired lock "refresh_cache-62452efb-3a12-4aff-9359-217d17fc052a" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:44:48 user nova-compute[71321]: DEBUG nova.network.neutron [req-cfce8ea6-83f5-4535-9846-0e8b380dcf26 req-c363acde-f078-400a-a7db-800424d61063 service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Refreshing network info cache for port 6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:44:49 user nova-compute[71321]: DEBUG nova.network.neutron [req-cfce8ea6-83f5-4535-9846-0e8b380dcf26 req-c363acde-f078-400a-a7db-800424d61063 service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Updated VIF entry in instance network info cache for port 6ea59aa7-b979-4fa0-b26b-cf96ad5addb2. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:44:49 user nova-compute[71321]: DEBUG nova.network.neutron [req-cfce8ea6-83f5-4535-9846-0e8b380dcf26 req-c363acde-f078-400a-a7db-800424d61063 service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Updating instance_info_cache with network_info: [{"id": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "address": "fa:16:3e:c6:61:66", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea59aa7-b9", "ovs_interfaceid": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:44:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-cfce8ea6-83f5-4535-9846-0e8b380dcf26 req-c363acde-f078-400a-a7db-800424d61063 service nova] Releasing lock "refresh_cache-62452efb-3a12-4aff-9359-217d17fc052a" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:44:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG nova.compute.manager [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:44:51 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Creating image(s)
Apr 12 12:44:51 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Did not create local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Ensure instance console log exists: /opt/stack/data/nova/instances/62452efb-3a12-4aff-9359-217d17fc052a/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Start _get_guest_xml network_info=[{"id": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "address": "fa:16:3e:c6:61:66", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea59aa7-b9", "ovs_interfaceid": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2ed74214-1546-4d82-9301-1d30acb59f75', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utelFAnj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '62452efb-3a12-4aff-9359-217d17fc052a', 'attached_at': '', 'detached_at': '', 'volume_id': '3f8c0fb4-a50b-4195-ba6a-8e98f3360491', 'serial': '3f8c0fb4-a50b-4195-ba6a-8e98f3360491'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:44:51 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:44:51 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:44:51 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utelFAnj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:44:51 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:44:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:44:51 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:44:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:44:51 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3977577-0118-46ea-9137-47a2b21c3e3a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:44:51 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63b4fae-79d1-4930-80c0-ae36049311cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491] added
Apr 12 12:44:51 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fae32c-ae45-4f8e-858d-93d2c53f3711]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e2f20b-f68c-4335-9ee7-c310fbc54896]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v utelFAnj {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v utelFAnj" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0b4372-f04e-4b68-bd05-3b096a85965e]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'utelFAnj'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8cf19d-28a6-4887-94b8-ed1d396869e8]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b0a995-1bc4-4d1f-b9e8-52ed9fedee19]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:44:51 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:44:51 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0aa566-ef65-4cce-9d5d-7d42ad3a685c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491, portal: 172.16.0.220,3260]
Apr 12 12:44:51 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491, portal: 172.16.0.220,3260] successful.
Apr 12 12:44:51 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa36c575-5549-40bb-bfa7-0e81b156d691]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[056dd784-77dd-4278-95b3-fd077c6c6b2a]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:44:51 user nova-compute[71321]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)
Apr 12 12:44:51 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:44:51 user nova-compute[71321]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)
Apr 12 12:44:51 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[518b65ee-838c-4162-833f-66ca3108c482]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:44:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utelFAnj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:44:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:52 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:44:52 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26530313735376261', 'path': '/dev/sdb'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:44:52 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530313735376261', 'path': '/dev/sdb'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:44:52 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:44:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-540928137',display_name='tempest-ServerActionsTestJSON-server-540928137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-540928137',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9e64miZ/iyVASS4OS8AZthMPT8KBHm0byN/8NFP7U1AgI9/hOw/R+BSPozX14usgKt+VEqTE1BPs7aRGcfyuCZ/K0LBkD7enTbPYgw3NHHlO3PWScCWY1ae7IFb2uJEw==',key_name='tempest-keypair-1245622558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ba5375005114c8594e0ae86b2f19093',ramdisk_id='',reservation_id='r-87f60efn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1233797030',owner_user_name='tempest-ServerActionsTestJSON-1233797030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:44:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29f7f46d32f4465ba3e8b504c645c22f',uuid=62452efb-3a12-4aff-9359-217d17fc052a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "address": "fa:16:3e:c6:61:66", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea59aa7-b9", "ovs_interfaceid": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:44:52 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converting VIF {"id": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "address": "fa:16:3e:c6:61:66", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea59aa7-b9", "ovs_interfaceid": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:44:52 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:61:66,bridge_name='br-int',has_traffic_filtering=True,id=6ea59aa7-b979-4fa0-b26b-cf96ad5addb2,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ea59aa7-b9') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:44:52 user nova-compute[71321]: DEBUG nova.objects.instance [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lazy-loading 'pci_devices' on Instance uuid 62452efb-3a12-4aff-9359-217d17fc052a {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:44:52 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:44:52 user nova-compute[71321]:   <uuid>62452efb-3a12-4aff-9359-217d17fc052a</uuid>
Apr 12 12:44:52 user nova-compute[71321]:   <name>instance-0000001f</name>
Apr 12 12:44:52 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:44:52 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:44:52 user nova-compute[71321]:   <metadata>
Apr 12 12:44:52 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:44:52 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:44:52 user nova-compute[71321]:       <nova:name>tempest-ServerActionsTestJSON-server-540928137</nova:name>
Apr 12 12:44:52 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:44:51</nova:creationTime>
Apr 12 12:44:52 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:44:52 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:44:52 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:44:52 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:44:52 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:44:52 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:44:52 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:44:52 user nova-compute[71321]:       <nova:owner>
Apr 12 12:44:52 user nova-compute[71321]:         <nova:user uuid="29f7f46d32f4465ba3e8b504c645c22f">tempest-ServerActionsTestJSON-1233797030-project-member</nova:user>
Apr 12 12:44:52 user nova-compute[71321]:         <nova:project uuid="7ba5375005114c8594e0ae86b2f19093">tempest-ServerActionsTestJSON-1233797030</nova:project>
Apr 12 12:44:52 user nova-compute[71321]:       </nova:owner>
Apr 12 12:44:52 user nova-compute[71321]:       <nova:ports>
Apr 12 12:44:52 user nova-compute[71321]:         <nova:port uuid="6ea59aa7-b979-4fa0-b26b-cf96ad5addb2">
Apr 12 12:44:52 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 12:44:52 user nova-compute[71321]:         </nova:port>
Apr 12 12:44:52 user nova-compute[71321]:       </nova:ports>
Apr 12 12:44:52 user nova-compute[71321]:     </nova:instance>
Apr 12 12:44:52 user nova-compute[71321]:   </metadata>
Apr 12 12:44:52 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:44:52 user nova-compute[71321]:     <system>
Apr 12 12:44:52 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:44:52 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:44:52 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:44:52 user nova-compute[71321]:       <entry name="serial">62452efb-3a12-4aff-9359-217d17fc052a</entry>
Apr 12 12:44:52 user nova-compute[71321]:       <entry name="uuid">62452efb-3a12-4aff-9359-217d17fc052a</entry>
Apr 12 12:44:52 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:44:52 user nova-compute[71321]:     </system>
Apr 12 12:44:52 user nova-compute[71321]:   </sysinfo>
Apr 12 12:44:52 user nova-compute[71321]:   <os>
Apr 12 12:44:52 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:44:52 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:44:52 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:44:52 user nova-compute[71321]:   </os>
Apr 12 12:44:52 user nova-compute[71321]:   <features>
Apr 12 12:44:52 user nova-compute[71321]:     <acpi/>
Apr 12 12:44:52 user nova-compute[71321]:     <apic/>
Apr 12 12:44:52 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:44:52 user nova-compute[71321]:   </features>
Apr 12 12:44:52 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:44:52 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:44:52 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:44:52 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:44:52 user nova-compute[71321]:   </clock>
Apr 12 12:44:52 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:44:52 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:44:52 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:44:52 user nova-compute[71321]:   </cpu>
Apr 12 12:44:52 user nova-compute[71321]:   <devices>
Apr 12 12:44:52 user nova-compute[71321]:     <disk type="block" device="disk">
Apr 12 12:44:52 user nova-compute[71321]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:44:52 user nova-compute[71321]:       <source dev="/dev/sdb"/>
Apr 12 12:44:52 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:44:52 user nova-compute[71321]:       <serial>3f8c0fb4-a50b-4195-ba6a-8e98f3360491</serial>
Apr 12 12:44:52 user nova-compute[71321]:     </disk>
Apr 12 12:44:52 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:44:52 user nova-compute[71321]:       <mac address="fa:16:3e:c6:61:66"/>
Apr 12 12:44:52 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:44:52 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:44:52 user nova-compute[71321]:       <target dev="tap6ea59aa7-b9"/>
Apr 12 12:44:52 user nova-compute[71321]:     </interface>
Apr 12 12:44:52 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:44:52 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/62452efb-3a12-4aff-9359-217d17fc052a/console.log" append="off"/>
Apr 12 12:44:52 user nova-compute[71321]:     </serial>
Apr 12 12:44:52 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:44:52 user nova-compute[71321]:     <video>
Apr 12 12:44:52 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:44:52 user nova-compute[71321]:     </video>
Apr 12 12:44:52 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:44:52 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:44:52 user nova-compute[71321]:     </rng>
Apr 12 12:44:52 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:44:52 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:44:52 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:44:52 user nova-compute[71321]:     </memballoon>
Apr 12 12:44:52 user nova-compute[71321]:   </devices>
Apr 12 12:44:52 user nova-compute[71321]: </domain>
Apr 12 12:44:52 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:44:52 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:44:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-540928137',display_name='tempest-ServerActionsTestJSON-server-540928137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-540928137',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9e64miZ/iyVASS4OS8AZthMPT8KBHm0byN/8NFP7U1AgI9/hOw/R+BSPozX14usgKt+VEqTE1BPs7aRGcfyuCZ/K0LBkD7enTbPYgw3NHHlO3PWScCWY1ae7IFb2uJEw==',key_name='tempest-keypair-1245622558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ba5375005114c8594e0ae86b2f19093',ramdisk_id='',reservation_id='r-87f60efn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1233797030',owner_user_name='tempest-ServerActionsTestJSON-1233797030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:44:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29f7f46d32f4465ba3e8b504c645c22f',uuid=62452efb-3a12-4aff-9359-217d17fc052a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "address": "fa:16:3e:c6:61:66", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea59aa7-b9", "ovs_interfaceid": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:44:52 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converting VIF {"id": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "address": "fa:16:3e:c6:61:66", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea59aa7-b9", "ovs_interfaceid": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:44:52 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:61:66,bridge_name='br-int',has_traffic_filtering=True,id=6ea59aa7-b979-4fa0-b26b-cf96ad5addb2,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ea59aa7-b9') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:44:52 user nova-compute[71321]: DEBUG os_vif [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:61:66,bridge_name='br-int',has_traffic_filtering=True,id=6ea59aa7-b979-4fa0-b26b-cf96ad5addb2,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ea59aa7-b9') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:44:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:44:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:44:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ea59aa7-b9, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:44:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6ea59aa7-b9, col_values=(('external_ids', {'iface-id': '6ea59aa7-b979-4fa0-b26b-cf96ad5addb2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:61:66', 'vm-uuid': '62452efb-3a12-4aff-9359-217d17fc052a'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:44:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:44:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:52 user nova-compute[71321]: INFO os_vif [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:61:66,bridge_name='br-int',has_traffic_filtering=True,id=6ea59aa7-b979-4fa0-b26b-cf96ad5addb2,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ea59aa7-b9')
Apr 12 12:44:52 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:44:52 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] No VIF found with MAC fa:16:3e:c6:61:66, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:44:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:54 user nova-compute[71321]: DEBUG nova.compute.manager [req-00007461-3d5e-40a7-89b2-1cbbc779ab32 req-ea1dd13f-0c60-4e01-b60c-6f4207b0b5f5 service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Received event network-vif-plugged-6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:44:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-00007461-3d5e-40a7-89b2-1cbbc779ab32 req-ea1dd13f-0c60-4e01-b60c-6f4207b0b5f5 service nova] Acquiring lock "62452efb-3a12-4aff-9359-217d17fc052a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:44:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-00007461-3d5e-40a7-89b2-1cbbc779ab32 req-ea1dd13f-0c60-4e01-b60c-6f4207b0b5f5 service nova] Lock "62452efb-3a12-4aff-9359-217d17fc052a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:44:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-00007461-3d5e-40a7-89b2-1cbbc779ab32 req-ea1dd13f-0c60-4e01-b60c-6f4207b0b5f5 service nova] Lock "62452efb-3a12-4aff-9359-217d17fc052a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:44:54 user nova-compute[71321]: DEBUG nova.compute.manager [req-00007461-3d5e-40a7-89b2-1cbbc779ab32 req-ea1dd13f-0c60-4e01-b60c-6f4207b0b5f5 service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] No waiting events found dispatching network-vif-plugged-6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:44:54 user nova-compute[71321]: WARNING nova.compute.manager [req-00007461-3d5e-40a7-89b2-1cbbc779ab32 req-ea1dd13f-0c60-4e01-b60c-6f4207b0b5f5 service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Received unexpected event network-vif-plugged-6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 for instance with vm_state building and task_state spawning.
Apr 12 12:44:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:44:56 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303496.2421405, 62452efb-3a12-4aff-9359-217d17fc052a => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:44:56 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] VM Resumed (Lifecycle Event)
Apr 12 12:44:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:44:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:44:56 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Instance spawned successfully.
Apr 12 12:44:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:44:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:44:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:44:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:44:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:44:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:44:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:44:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:44:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:44:56 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:44:56 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303496.243574, 62452efb-3a12-4aff-9359-217d17fc052a => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:44:56 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] VM Started (Lifecycle Event)
Apr 12 12:44:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:44:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:44:56 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:44:56 user nova-compute[71321]: INFO nova.compute.manager [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Took 5.00 seconds to spawn the instance on the hypervisor.
Apr 12 12:44:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:44:56 user nova-compute[71321]: DEBUG nova.compute.manager [req-f87be7d4-622f-49a5-9db7-fa054830196d req-f80ac743-baea-4b6d-a31c-7e9b6b873c98 service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Received event network-vif-plugged-6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:44:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f87be7d4-622f-49a5-9db7-fa054830196d req-f80ac743-baea-4b6d-a31c-7e9b6b873c98 service nova] Acquiring lock "62452efb-3a12-4aff-9359-217d17fc052a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:44:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f87be7d4-622f-49a5-9db7-fa054830196d req-f80ac743-baea-4b6d-a31c-7e9b6b873c98 service nova] Lock "62452efb-3a12-4aff-9359-217d17fc052a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:44:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f87be7d4-622f-49a5-9db7-fa054830196d req-f80ac743-baea-4b6d-a31c-7e9b6b873c98 service nova] Lock "62452efb-3a12-4aff-9359-217d17fc052a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:44:56 user nova-compute[71321]: DEBUG nova.compute.manager [req-f87be7d4-622f-49a5-9db7-fa054830196d req-f80ac743-baea-4b6d-a31c-7e9b6b873c98 service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] No waiting events found dispatching network-vif-plugged-6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:44:56 user nova-compute[71321]: WARNING nova.compute.manager [req-f87be7d4-622f-49a5-9db7-fa054830196d req-f80ac743-baea-4b6d-a31c-7e9b6b873c98 service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Received unexpected event network-vif-plugged-6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 for instance with vm_state building and task_state spawning.
Apr 12 12:44:56 user nova-compute[71321]: INFO nova.compute.manager [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Took 10.10 seconds to build instance.
Apr 12 12:44:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "62452efb-3a12-4aff-9359-217d17fc052a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.202s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:44:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "10116da0-785c-41cf-96bb-95721af863db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:45:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "10116da0-785c-41cf-96bb-95721af863db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:45:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "10116da0-785c-41cf-96bb-95721af863db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:45:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "10116da0-785c-41cf-96bb-95721af863db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:45:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "10116da0-785c-41cf-96bb-95721af863db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:45:06 user nova-compute[71321]: INFO nova.compute.manager [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Terminating instance
Apr 12 12:45:06 user nova-compute[71321]: DEBUG nova.compute.manager [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:45:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:07 user nova-compute[71321]: DEBUG nova.compute.manager [req-a9ca0510-e38f-44d3-94a5-4c93545e9b30 req-734232a4-e267-42b2-b3b6-a26e5b14c387 service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] Received event network-vif-unplugged-cbb69638-6a5f-4d12-8737-45850145fa0e {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:45:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a9ca0510-e38f-44d3-94a5-4c93545e9b30 req-734232a4-e267-42b2-b3b6-a26e5b14c387 service nova] Acquiring lock "10116da0-785c-41cf-96bb-95721af863db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:45:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a9ca0510-e38f-44d3-94a5-4c93545e9b30 req-734232a4-e267-42b2-b3b6-a26e5b14c387 service nova] Lock "10116da0-785c-41cf-96bb-95721af863db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:45:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a9ca0510-e38f-44d3-94a5-4c93545e9b30 req-734232a4-e267-42b2-b3b6-a26e5b14c387 service nova] Lock "10116da0-785c-41cf-96bb-95721af863db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:45:07 user nova-compute[71321]: DEBUG nova.compute.manager [req-a9ca0510-e38f-44d3-94a5-4c93545e9b30 req-734232a4-e267-42b2-b3b6-a26e5b14c387 service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] No waiting events found dispatching network-vif-unplugged-cbb69638-6a5f-4d12-8737-45850145fa0e {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:45:07 user nova-compute[71321]: DEBUG nova.compute.manager [req-a9ca0510-e38f-44d3-94a5-4c93545e9b30 req-734232a4-e267-42b2-b3b6-a26e5b14c387 service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] Received event network-vif-unplugged-cbb69638-6a5f-4d12-8737-45850145fa0e for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:45:07 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 10116da0-785c-41cf-96bb-95721af863db] Instance destroyed successfully.
Apr 12 12:45:07 user nova-compute[71321]: DEBUG nova.objects.instance [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'resources' on Instance uuid 10116da0-785c-41cf-96bb-95721af863db {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:45:07 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:28:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1720191836',display_name='tempest-ServerRescueNegativeTestJSON-server-1720191836',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1720191836',id=1,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:33:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9ec9671123c4a00a2880de4b4df8d3e',ramdisk_id='',reservation_id='r-68hyvfbd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1979263125',owner_user_name='tempest-ServerRescueNegativeTestJSON-1979263125-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:34:57Z,user_data=None,user_id='1db0203a6e6f4cc3bccbf19577a0c82f',uuid=10116da0-785c-41cf-96bb-95721af863db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cbb69638-6a5f-4d12-8737-45850145fa0e", "address": "fa:16:3e:57:7c:99", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb69638-6a", "ovs_interfaceid": "cbb69638-6a5f-4d12-8737-45850145fa0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:45:07 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Converting VIF {"id": "cbb69638-6a5f-4d12-8737-45850145fa0e", "address": "fa:16:3e:57:7c:99", "network": {"id": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1981561410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ec9671123c4a00a2880de4b4df8d3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb69638-6a", "ovs_interfaceid": "cbb69638-6a5f-4d12-8737-45850145fa0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:45:07 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:7c:99,bridge_name='br-int',has_traffic_filtering=True,id=cbb69638-6a5f-4d12-8737-45850145fa0e,network=Network(0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbb69638-6a') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:45:07 user nova-compute[71321]: DEBUG os_vif [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:7c:99,bridge_name='br-int',has_traffic_filtering=True,id=cbb69638-6a5f-4d12-8737-45850145fa0e,network=Network(0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbb69638-6a') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:45:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcbb69638-6a, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:45:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:45:07 user nova-compute[71321]: INFO os_vif [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:7c:99,bridge_name='br-int',has_traffic_filtering=True,id=cbb69638-6a5f-4d12-8737-45850145fa0e,network=Network(0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbb69638-6a')
Apr 12 12:45:07 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Deleting instance files /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db_del
Apr 12 12:45:07 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Deletion of /opt/stack/data/nova/instances/10116da0-785c-41cf-96bb-95721af863db_del complete
Apr 12 12:45:07 user nova-compute[71321]: INFO nova.compute.manager [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Took 0.66 seconds to destroy the instance on the hypervisor.
Apr 12 12:45:07 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:45:07 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: 10116da0-785c-41cf-96bb-95721af863db] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:45:07 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 10116da0-785c-41cf-96bb-95721af863db] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:45:08 user nova-compute[71321]: DEBUG nova.compute.manager [req-d90968f7-7e56-4cc6-bcac-755bef7a33c0 req-729294fd-771a-487f-bdf6-e03cc352d3bf service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] Received event network-vif-deleted-cbb69638-6a5f-4d12-8737-45850145fa0e {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:45:08 user nova-compute[71321]: INFO nova.compute.manager [req-d90968f7-7e56-4cc6-bcac-755bef7a33c0 req-729294fd-771a-487f-bdf6-e03cc352d3bf service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] Neutron deleted interface cbb69638-6a5f-4d12-8737-45850145fa0e; detaching it from the instance and deleting it from the info cache
Apr 12 12:45:08 user nova-compute[71321]: DEBUG nova.network.neutron [req-d90968f7-7e56-4cc6-bcac-755bef7a33c0 req-729294fd-771a-487f-bdf6-e03cc352d3bf service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:45:08 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 10116da0-785c-41cf-96bb-95721af863db] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:45:08 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 10116da0-785c-41cf-96bb-95721af863db] Took 0.52 seconds to deallocate network for instance.
Apr 12 12:45:08 user nova-compute[71321]: DEBUG nova.compute.manager [req-d90968f7-7e56-4cc6-bcac-755bef7a33c0 req-729294fd-771a-487f-bdf6-e03cc352d3bf service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] Detach interface failed, port_id=cbb69638-6a5f-4d12-8737-45850145fa0e, reason: Instance 10116da0-785c-41cf-96bb-95721af863db could not be found. {{(pid=71321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 12:45:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:45:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:45:08 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Refreshing inventories for resource provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 12:45:08 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Updating ProviderTree inventory for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 12:45:08 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Updating inventory in ProviderTree for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 12:45:08 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Refreshing aggregate associations for resource provider 7ca624fd-d5cc-42af-93e3-9d62256fa231, aggregates: None {{(pid=71321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 12:45:08 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Refreshing trait associations for resource provider 7ca624fd-d5cc-42af-93e3-9d62256fa231, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=71321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 12:45:08 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:45:08 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:45:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.772s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:45:08 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Deleted allocations for instance 10116da0-785c-41cf-96bb-95721af863db
Apr 12 12:45:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "10116da0-785c-41cf-96bb-95721af863db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.157s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:45:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:45:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:45:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:45:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:45:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:45:09 user nova-compute[71321]: DEBUG nova.compute.manager [req-1f8c9da3-5b14-4412-9a85-31a190915f1b req-3704659c-81ed-40a4-930e-543829e00eac service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] Received event network-vif-plugged-cbb69638-6a5f-4d12-8737-45850145fa0e {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:45:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-1f8c9da3-5b14-4412-9a85-31a190915f1b req-3704659c-81ed-40a4-930e-543829e00eac service nova] Acquiring lock "10116da0-785c-41cf-96bb-95721af863db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:45:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-1f8c9da3-5b14-4412-9a85-31a190915f1b req-3704659c-81ed-40a4-930e-543829e00eac service nova] Lock "10116da0-785c-41cf-96bb-95721af863db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:45:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-1f8c9da3-5b14-4412-9a85-31a190915f1b req-3704659c-81ed-40a4-930e-543829e00eac service nova] Lock "10116da0-785c-41cf-96bb-95721af863db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:45:09 user nova-compute[71321]: DEBUG nova.compute.manager [req-1f8c9da3-5b14-4412-9a85-31a190915f1b req-3704659c-81ed-40a4-930e-543829e00eac service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] No waiting events found dispatching network-vif-plugged-cbb69638-6a5f-4d12-8737-45850145fa0e {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:45:09 user nova-compute[71321]: WARNING nova.compute.manager [req-1f8c9da3-5b14-4412-9a85-31a190915f1b req-3704659c-81ed-40a4-930e-543829e00eac service nova] [instance: 10116da0-785c-41cf-96bb-95721af863db] Received unexpected event network-vif-plugged-cbb69638-6a5f-4d12-8737-45850145fa0e for instance with vm_state deleted and task_state None.
Apr 12 12:45:09 user nova-compute[71321]: INFO nova.compute.manager [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Terminating instance
Apr 12 12:45:09 user nova-compute[71321]: DEBUG nova.compute.manager [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:45:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:10 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Instance destroyed successfully.
Apr 12 12:45:10 user nova-compute[71321]: DEBUG nova.objects.instance [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lazy-loading 'resources' on Instance uuid 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:40:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1424711161',display_name='tempest-TestVolumeBootPattern-server-1424711161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1424711161',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsgnjp9DU7mhDKOnejfarx74lKPsdA7XFVVac0IXQsHunQgmiZdnkpBnb9o+2GfDpfLr3Vtu/GonERs5AS6wpKwmtd3eb4XJchkGev4GCvYiSWT7o/Zl3+nrrnYoAMm1w==',key_name='tempest-TestVolumeBootPattern-1044387718',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:40:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ada441da2124adda751365952320e81',ramdisk_id='',reservation_id='r-8oedf15o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-310589135',owner_user_name='tempest-TestVolumeBootPattern-310589135-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:40:33Z,user_data=None,user_id='076e65b43f664765ad1d48be6e814f40',uuid=2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c", "address": "fa:16:3e:ab:22:27", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d914f7-c4", "ovs_interfaceid": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converting VIF {"id": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c", "address": "fa:16:3e:ab:22:27", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d914f7-c4", "ovs_interfaceid": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:22:27,bridge_name='br-int',has_traffic_filtering=True,id=f6d914f7-c468-4bda-80d4-b6f37e3bea3c,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6d914f7-c4') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG os_vif [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:22:27,bridge_name='br-int',has_traffic_filtering=True,id=f6d914f7-c468-4bda-80d4-b6f37e3bea3c,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6d914f7-c4') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6d914f7-c4, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG nova.compute.manager [req-57631bd4-a91a-4158-83fe-65417d11ff0f req-59b8b8ca-fcbe-4e17-8482-2fe31ab63d45 service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Received event network-changed-f6d914f7-c468-4bda-80d4-b6f37e3bea3c {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG nova.compute.manager [req-57631bd4-a91a-4158-83fe-65417d11ff0f req-59b8b8ca-fcbe-4e17-8482-2fe31ab63d45 service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Refreshing instance network info cache due to event network-changed-f6d914f7-c468-4bda-80d4-b6f37e3bea3c. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-57631bd4-a91a-4158-83fe-65417d11ff0f req-59b8b8ca-fcbe-4e17-8482-2fe31ab63d45 service nova] Acquiring lock "refresh_cache-2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-57631bd4-a91a-4158-83fe-65417d11ff0f req-59b8b8ca-fcbe-4e17-8482-2fe31ab63d45 service nova] Acquired lock "refresh_cache-2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG nova.network.neutron [req-57631bd4-a91a-4158-83fe-65417d11ff0f req-59b8b8ca-fcbe-4e17-8482-2fe31ab63d45 service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Refreshing network info cache for port f6d914f7-c468-4bda-80d4-b6f37e3bea3c {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:45:10 user nova-compute[71321]: INFO os_vif [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:22:27,bridge_name='br-int',has_traffic_filtering=True,id=f6d914f7-c468-4bda-80d4-b6f37e3bea3c,network=Network(7b2275f8-865d-4425-a1b0-0d308b5dcd1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6d914f7-c4')
Apr 12 12:45:10 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qYwGFrzb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:45:10 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:45:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba434ac-40ee-4b46-9e80-87cb167ab2de]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:45:10 user nova-compute[71321]: No targets found.
Apr 12 12:45:10 user nova-compute[71321]: iSNS:
Apr 12 12:45:10 user nova-compute[71321]: No targets found.
Apr 12 12:45:10 user nova-compute[71321]: STATIC:
Apr 12 12:45:10 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5
Apr 12 12:45:10 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:45:10 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:45:10 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491
Apr 12 12:45:10 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:45:10 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:45:10 user nova-compute[71321]: FIRMWARE:
Apr 12 12:45:10 user nova-compute[71321]: No targets found.
Apr 12 12:45:10 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:45:10 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:45:10 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc0427f-2513-42c3-92ec-49b15d32cdf6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56d4f6b-21f7-4d2e-939e-a3e36d3ab5ae]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:45:10 user nova-compute[71321]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)
Apr 12 12:45:10 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 (non-flash)
Apr 12 12:45:10 user nova-compute[71321]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)
Apr 12 12:45:10 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef44570940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5'): ({'sdd'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Removing single pathed devices sdd {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86fe7bd-eb6f-42d5-9d63-a588581a2fc3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.031s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1facb6b-55ab-487f-be9d-e292343c04a0]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Flushing IO for device /dev/sdd {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e5ae36-bd22-4dcb-bb47-e44801a7094f]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.059s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7d6d36-8865-4c9e-a412-c1aa11724a34]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] SCSI volumes sdd have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[99756491-bc90-4927-ad10-a44dfef55b93]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26cb7b4-3313-4841-a699-7c7a39c55dea]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5, portal: 172.16.0.220,3260]
Apr 12 12:45:10 user nova-compute[71321]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5, portal: 172.16.0.220,3260] successful.
Apr 12 12:45:10 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b02750fc-665e-4715-9399-bb359cf6b1a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ebbe58-ff71-48dc-be14-72e8cfba645c]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] <== disconnect_volume: return (423ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:45:10 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Deleting instance files /opt/stack/data/nova/instances/2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67_del
Apr 12 12:45:10 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Deletion of /opt/stack/data/nova/instances/2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67_del complete
Apr 12 12:45:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:10 user nova-compute[71321]: INFO nova.compute.manager [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Took 1.50 seconds to destroy the instance on the hypervisor.
Apr 12 12:45:10 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:45:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:11 user nova-compute[71321]: DEBUG nova.network.neutron [req-57631bd4-a91a-4158-83fe-65417d11ff0f req-59b8b8ca-fcbe-4e17-8482-2fe31ab63d45 service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Updated VIF entry in instance network info cache for port f6d914f7-c468-4bda-80d4-b6f37e3bea3c. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:45:11 user nova-compute[71321]: DEBUG nova.network.neutron [req-57631bd4-a91a-4158-83fe-65417d11ff0f req-59b8b8ca-fcbe-4e17-8482-2fe31ab63d45 service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Updating instance_info_cache with network_info: [{"id": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c", "address": "fa:16:3e:ab:22:27", "network": {"id": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-95854109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ada441da2124adda751365952320e81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d914f7-c4", "ovs_interfaceid": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:45:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-57631bd4-a91a-4158-83fe-65417d11ff0f req-59b8b8ca-fcbe-4e17-8482-2fe31ab63d45 service nova] Releasing lock "refresh_cache-2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:45:11 user nova-compute[71321]: DEBUG nova.compute.manager [req-57631bd4-a91a-4158-83fe-65417d11ff0f req-59b8b8ca-fcbe-4e17-8482-2fe31ab63d45 service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Received event network-vif-unplugged-f6d914f7-c468-4bda-80d4-b6f37e3bea3c {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:45:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-57631bd4-a91a-4158-83fe-65417d11ff0f req-59b8b8ca-fcbe-4e17-8482-2fe31ab63d45 service nova] Acquiring lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:45:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-57631bd4-a91a-4158-83fe-65417d11ff0f req-59b8b8ca-fcbe-4e17-8482-2fe31ab63d45 service nova] Lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:45:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-57631bd4-a91a-4158-83fe-65417d11ff0f req-59b8b8ca-fcbe-4e17-8482-2fe31ab63d45 service nova] Lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:45:11 user nova-compute[71321]: DEBUG nova.compute.manager [req-57631bd4-a91a-4158-83fe-65417d11ff0f req-59b8b8ca-fcbe-4e17-8482-2fe31ab63d45 service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] No waiting events found dispatching network-vif-unplugged-f6d914f7-c468-4bda-80d4-b6f37e3bea3c {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:45:11 user nova-compute[71321]: DEBUG nova.compute.manager [req-57631bd4-a91a-4158-83fe-65417d11ff0f req-59b8b8ca-fcbe-4e17-8482-2fe31ab63d45 service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Received event network-vif-unplugged-f6d914f7-c468-4bda-80d4-b6f37e3bea3c for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:45:11 user nova-compute[71321]: DEBUG nova.compute.manager [req-57631bd4-a91a-4158-83fe-65417d11ff0f req-59b8b8ca-fcbe-4e17-8482-2fe31ab63d45 service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Received event network-vif-plugged-f6d914f7-c468-4bda-80d4-b6f37e3bea3c {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:45:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-57631bd4-a91a-4158-83fe-65417d11ff0f req-59b8b8ca-fcbe-4e17-8482-2fe31ab63d45 service nova] Acquiring lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:45:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-57631bd4-a91a-4158-83fe-65417d11ff0f req-59b8b8ca-fcbe-4e17-8482-2fe31ab63d45 service nova] Lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:45:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-57631bd4-a91a-4158-83fe-65417d11ff0f req-59b8b8ca-fcbe-4e17-8482-2fe31ab63d45 service nova] Lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:45:11 user nova-compute[71321]: DEBUG nova.compute.manager [req-57631bd4-a91a-4158-83fe-65417d11ff0f req-59b8b8ca-fcbe-4e17-8482-2fe31ab63d45 service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] No waiting events found dispatching network-vif-plugged-f6d914f7-c468-4bda-80d4-b6f37e3bea3c {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:45:11 user nova-compute[71321]: WARNING nova.compute.manager [req-57631bd4-a91a-4158-83fe-65417d11ff0f req-59b8b8ca-fcbe-4e17-8482-2fe31ab63d45 service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Received unexpected event network-vif-plugged-f6d914f7-c468-4bda-80d4-b6f37e3bea3c for instance with vm_state active and task_state deleting.
Apr 12 12:45:11 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:45:11 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Took 0.73 seconds to deallocate network for instance.
Apr 12 12:45:12 user nova-compute[71321]: DEBUG nova.compute.manager [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Received event network-vif-plugged-f6d914f7-c468-4bda-80d4-b6f37e3bea3c {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:45:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] Acquiring lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:45:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] Lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:45:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] Lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:45:12 user nova-compute[71321]: DEBUG nova.compute.manager [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] No waiting events found dispatching network-vif-plugged-f6d914f7-c468-4bda-80d4-b6f37e3bea3c {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:45:12 user nova-compute[71321]: WARNING nova.compute.manager [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Received unexpected event network-vif-plugged-f6d914f7-c468-4bda-80d4-b6f37e3bea3c for instance with vm_state active and task_state deleting.
Apr 12 12:45:12 user nova-compute[71321]: DEBUG nova.compute.manager [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Received event network-vif-plugged-f6d914f7-c468-4bda-80d4-b6f37e3bea3c {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:45:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] Acquiring lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:45:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] Lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:45:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] Lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:45:12 user nova-compute[71321]: DEBUG nova.compute.manager [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] No waiting events found dispatching network-vif-plugged-f6d914f7-c468-4bda-80d4-b6f37e3bea3c {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:45:12 user nova-compute[71321]: WARNING nova.compute.manager [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Received unexpected event network-vif-plugged-f6d914f7-c468-4bda-80d4-b6f37e3bea3c for instance with vm_state active and task_state deleting.
Apr 12 12:45:12 user nova-compute[71321]: DEBUG nova.compute.manager [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Received event network-vif-unplugged-f6d914f7-c468-4bda-80d4-b6f37e3bea3c {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:45:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] Acquiring lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:45:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] Lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:45:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] Lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:45:12 user nova-compute[71321]: DEBUG nova.compute.manager [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] No waiting events found dispatching network-vif-unplugged-f6d914f7-c468-4bda-80d4-b6f37e3bea3c {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:45:12 user nova-compute[71321]: DEBUG nova.compute.manager [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Received event network-vif-unplugged-f6d914f7-c468-4bda-80d4-b6f37e3bea3c for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:45:12 user nova-compute[71321]: DEBUG nova.compute.manager [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Received event network-vif-plugged-f6d914f7-c468-4bda-80d4-b6f37e3bea3c {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:45:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] Acquiring lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:45:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] Lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:45:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] Lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:45:12 user nova-compute[71321]: DEBUG nova.compute.manager [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] No waiting events found dispatching network-vif-plugged-f6d914f7-c468-4bda-80d4-b6f37e3bea3c {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:45:12 user nova-compute[71321]: WARNING nova.compute.manager [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Received unexpected event network-vif-plugged-f6d914f7-c468-4bda-80d4-b6f37e3bea3c for instance with vm_state active and task_state deleting.
Apr 12 12:45:12 user nova-compute[71321]: DEBUG nova.compute.manager [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Received event network-vif-deleted-f6d914f7-c468-4bda-80d4-b6f37e3bea3c {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:45:12 user nova-compute[71321]: INFO nova.compute.manager [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Took 0.78 seconds to detach 1 volumes for instance.
Apr 12 12:45:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:45:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:45:12 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:45:12 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:45:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:45:12 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Deleted allocations for instance 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67
Apr 12 12:45:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.403s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:45:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:22 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681303507.4478774, 10116da0-785c-41cf-96bb-95721af863db => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:45:22 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 10116da0-785c-41cf-96bb-95721af863db] VM Stopped (Lifecycle Event)
Apr 12 12:45:22 user nova-compute[71321]: DEBUG nova.compute.manager [None req-76f66afe-0783-48c0-88b5-3aaa40041d39 None None] [instance: 10116da0-785c-41cf-96bb-95721af863db] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:45:24 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:45:25 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681303510.0592272, 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:45:25 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] VM Stopped (Lifecycle Event)
Apr 12 12:45:25 user nova-compute[71321]: DEBUG nova.compute.manager [None req-909c71c7-ef67-408e-9e2b-3f2b57be9985 None None] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:45:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:45:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 12:45:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 12:45:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 12:45:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:25 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:45:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:45:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:45:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:45:25 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:45:25 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:45:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:45:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:45:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:45:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:45:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:45:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:45:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:45:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:45:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0592fff-d30d-40dc-95d3-263aab10a70e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:45:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0592fff-d30d-40dc-95d3-263aab10a70e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:45:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0592fff-d30d-40dc-95d3-263aab10a70e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:45:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0592fff-d30d-40dc-95d3-263aab10a70e/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:45:27 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:45:27 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:45:27 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8364MB free_disk=26.448482513427734GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:45:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:45:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:45:27 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:45:27 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance d0592fff-d30d-40dc-95d3-263aab10a70e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:45:27 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:45:27 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 62452efb-3a12-4aff-9359-217d17fc052a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:45:27 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:45:27 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:45:27 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:45:27 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:45:27 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:45:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.307s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:45:29 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:45:29 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:45:29 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:45:29 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:45:29 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:45:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:30 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:45:31 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:45:31 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:45:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:45:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:45:31 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 12:45:31 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Updating instance_info_cache with network_info: [{"id": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "address": "fa:16:3e:bc:a8:83", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e54d3ba-dd", "ovs_interfaceid": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:45:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:45:31 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 12:45:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-237aaf4f-f878-4b2c-8ea9-f2e5654c7ae2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "d0592fff-d30d-40dc-95d3-263aab10a70e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:45:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-237aaf4f-f878-4b2c-8ea9-f2e5654c7ae2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "d0592fff-d30d-40dc-95d3-263aab10a70e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:45:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-237aaf4f-f878-4b2c-8ea9-f2e5654c7ae2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "d0592fff-d30d-40dc-95d3-263aab10a70e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:45:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-237aaf4f-f878-4b2c-8ea9-f2e5654c7ae2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "d0592fff-d30d-40dc-95d3-263aab10a70e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:45:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-237aaf4f-f878-4b2c-8ea9-f2e5654c7ae2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "d0592fff-d30d-40dc-95d3-263aab10a70e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:45:33 user nova-compute[71321]: INFO nova.compute.manager [None req-237aaf4f-f878-4b2c-8ea9-f2e5654c7ae2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Terminating instance
Apr 12 12:45:33 user nova-compute[71321]: DEBUG nova.compute.manager [None req-237aaf4f-f878-4b2c-8ea9-f2e5654c7ae2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:45:33 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:33 user nova-compute[71321]: DEBUG nova.compute.manager [req-75c34f76-d692-4aa9-a26d-684ef8bc21e2 req-a1c8a272-903d-4cc6-847b-666fc58006e1 service nova] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Received event network-vif-unplugged-92c07803-de20-43a3-98cc-f663ecf1c733 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:45:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-75c34f76-d692-4aa9-a26d-684ef8bc21e2 req-a1c8a272-903d-4cc6-847b-666fc58006e1 service nova] Acquiring lock "d0592fff-d30d-40dc-95d3-263aab10a70e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:45:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-75c34f76-d692-4aa9-a26d-684ef8bc21e2 req-a1c8a272-903d-4cc6-847b-666fc58006e1 service nova] Lock "d0592fff-d30d-40dc-95d3-263aab10a70e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:45:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-75c34f76-d692-4aa9-a26d-684ef8bc21e2 req-a1c8a272-903d-4cc6-847b-666fc58006e1 service nova] Lock "d0592fff-d30d-40dc-95d3-263aab10a70e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:45:33 user nova-compute[71321]: DEBUG nova.compute.manager [req-75c34f76-d692-4aa9-a26d-684ef8bc21e2 req-a1c8a272-903d-4cc6-847b-666fc58006e1 service nova] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] No waiting events found dispatching network-vif-unplugged-92c07803-de20-43a3-98cc-f663ecf1c733 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:45:33 user nova-compute[71321]: DEBUG nova.compute.manager [req-75c34f76-d692-4aa9-a26d-684ef8bc21e2 req-a1c8a272-903d-4cc6-847b-666fc58006e1 service nova] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Received event network-vif-unplugged-92c07803-de20-43a3-98cc-f663ecf1c733 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:45:34 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Instance destroyed successfully.
Apr 12 12:45:34 user nova-compute[71321]: DEBUG nova.objects.instance [None req-237aaf4f-f878-4b2c-8ea9-f2e5654c7ae2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lazy-loading 'resources' on Instance uuid d0592fff-d30d-40dc-95d3-263aab10a70e {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:45:34 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-237aaf4f-f878-4b2c-8ea9-f2e5654c7ae2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:43:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1074373312',display_name='tempest-VolumesActionsTest-instance-1074373312',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1074373312',id=30,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:43:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bfd0006105e24edb9516d52c5af63054',ramdisk_id='',reservation_id='r-45kh0v0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1646592366',owner_user_name='tempest-VolumesActionsTest-1646592366-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:43:49Z,user_data=None,user_id='2b3792e5a3b24583bbf50fb2b275b6d0',uuid=d0592fff-d30d-40dc-95d3-263aab10a70e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92c07803-de20-43a3-98cc-f663ecf1c733", "address": "fa:16:3e:c0:90:8b", "network": {"id": "eaded3a8-c825-4731-95bc-3f39f32603da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1058349103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bfd0006105e24edb9516d52c5af63054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92c07803-de", "ovs_interfaceid": "92c07803-de20-43a3-98cc-f663ecf1c733", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:45:34 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-237aaf4f-f878-4b2c-8ea9-f2e5654c7ae2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Converting VIF {"id": "92c07803-de20-43a3-98cc-f663ecf1c733", "address": "fa:16:3e:c0:90:8b", "network": {"id": "eaded3a8-c825-4731-95bc-3f39f32603da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1058349103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bfd0006105e24edb9516d52c5af63054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92c07803-de", "ovs_interfaceid": "92c07803-de20-43a3-98cc-f663ecf1c733", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:45:34 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-237aaf4f-f878-4b2c-8ea9-f2e5654c7ae2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:90:8b,bridge_name='br-int',has_traffic_filtering=True,id=92c07803-de20-43a3-98cc-f663ecf1c733,network=Network(eaded3a8-c825-4731-95bc-3f39f32603da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92c07803-de') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:45:34 user nova-compute[71321]: DEBUG os_vif [None req-237aaf4f-f878-4b2c-8ea9-f2e5654c7ae2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:90:8b,bridge_name='br-int',has_traffic_filtering=True,id=92c07803-de20-43a3-98cc-f663ecf1c733,network=Network(eaded3a8-c825-4731-95bc-3f39f32603da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92c07803-de') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:45:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92c07803-de, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:45:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:45:34 user nova-compute[71321]: INFO os_vif [None req-237aaf4f-f878-4b2c-8ea9-f2e5654c7ae2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:90:8b,bridge_name='br-int',has_traffic_filtering=True,id=92c07803-de20-43a3-98cc-f663ecf1c733,network=Network(eaded3a8-c825-4731-95bc-3f39f32603da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92c07803-de')
Apr 12 12:45:34 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-237aaf4f-f878-4b2c-8ea9-f2e5654c7ae2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Deleting instance files /opt/stack/data/nova/instances/d0592fff-d30d-40dc-95d3-263aab10a70e_del
Apr 12 12:45:34 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-237aaf4f-f878-4b2c-8ea9-f2e5654c7ae2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Deletion of /opt/stack/data/nova/instances/d0592fff-d30d-40dc-95d3-263aab10a70e_del complete
Apr 12 12:45:34 user nova-compute[71321]: INFO nova.compute.manager [None req-237aaf4f-f878-4b2c-8ea9-f2e5654c7ae2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Took 0.66 seconds to destroy the instance on the hypervisor.
Apr 12 12:45:34 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-237aaf4f-f878-4b2c-8ea9-f2e5654c7ae2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:45:34 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:45:34 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:45:34 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:45:34 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Took 0.45 seconds to deallocate network for instance.
Apr 12 12:45:34 user nova-compute[71321]: DEBUG nova.compute.manager [req-dca1acad-5c28-434c-95bd-0280891cc38a req-463182c4-b697-4346-98b9-8b2f856ea1b2 service nova] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Received event network-vif-deleted-92c07803-de20-43a3-98cc-f663ecf1c733 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:45:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-237aaf4f-f878-4b2c-8ea9-f2e5654c7ae2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:45:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-237aaf4f-f878-4b2c-8ea9-f2e5654c7ae2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:45:34 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-237aaf4f-f878-4b2c-8ea9-f2e5654c7ae2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:45:35 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-237aaf4f-f878-4b2c-8ea9-f2e5654c7ae2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:45:35 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-237aaf4f-f878-4b2c-8ea9-f2e5654c7ae2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:45:35 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-237aaf4f-f878-4b2c-8ea9-f2e5654c7ae2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Deleted allocations for instance d0592fff-d30d-40dc-95d3-263aab10a70e
Apr 12 12:45:35 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-237aaf4f-f878-4b2c-8ea9-f2e5654c7ae2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "d0592fff-d30d-40dc-95d3-263aab10a70e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.451s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:45:36 user nova-compute[71321]: DEBUG nova.compute.manager [req-39fe292c-7807-4886-9e64-25c1c005a34f req-c28f32ce-5fc7-4c96-a7b2-5caf1524adf1 service nova] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Received event network-vif-plugged-92c07803-de20-43a3-98cc-f663ecf1c733 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:45:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-39fe292c-7807-4886-9e64-25c1c005a34f req-c28f32ce-5fc7-4c96-a7b2-5caf1524adf1 service nova] Acquiring lock "d0592fff-d30d-40dc-95d3-263aab10a70e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:45:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-39fe292c-7807-4886-9e64-25c1c005a34f req-c28f32ce-5fc7-4c96-a7b2-5caf1524adf1 service nova] Lock "d0592fff-d30d-40dc-95d3-263aab10a70e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:45:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-39fe292c-7807-4886-9e64-25c1c005a34f req-c28f32ce-5fc7-4c96-a7b2-5caf1524adf1 service nova] Lock "d0592fff-d30d-40dc-95d3-263aab10a70e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:45:36 user nova-compute[71321]: DEBUG nova.compute.manager [req-39fe292c-7807-4886-9e64-25c1c005a34f req-c28f32ce-5fc7-4c96-a7b2-5caf1524adf1 service nova] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] No waiting events found dispatching network-vif-plugged-92c07803-de20-43a3-98cc-f663ecf1c733 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:45:36 user nova-compute[71321]: WARNING nova.compute.manager [req-39fe292c-7807-4886-9e64-25c1c005a34f req-c28f32ce-5fc7-4c96-a7b2-5caf1524adf1 service nova] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Received unexpected event network-vif-plugged-92c07803-de20-43a3-98cc-f663ecf1c733 for instance with vm_state deleted and task_state None.
Apr 12 12:45:37 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:45:39 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c24e0045-dc9f-4e38-a9fa-7ecf6ffcca8e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:45:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c24e0045-dc9f-4e38-a9fa-7ecf6ffcca8e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:45:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c24e0045-dc9f-4e38-a9fa-7ecf6ffcca8e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:45:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c24e0045-dc9f-4e38-a9fa-7ecf6ffcca8e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:45:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c24e0045-dc9f-4e38-a9fa-7ecf6ffcca8e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:45:40 user nova-compute[71321]: INFO nova.compute.manager [None req-c24e0045-dc9f-4e38-a9fa-7ecf6ffcca8e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Terminating instance
Apr 12 12:45:40 user nova-compute[71321]: DEBUG nova.compute.manager [None req-c24e0045-dc9f-4e38-a9fa-7ecf6ffcca8e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:45:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:40 user nova-compute[71321]: DEBUG nova.compute.manager [req-403fb490-5b76-42b2-b5a0-0305267f0603 req-3f313a6c-76e5-42e0-b2a6-d28366ae3c14 service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Received event network-vif-unplugged-7e54d3ba-dd94-4d8c-adca-16b108135e54 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:45:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-403fb490-5b76-42b2-b5a0-0305267f0603 req-3f313a6c-76e5-42e0-b2a6-d28366ae3c14 service nova] Acquiring lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:45:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-403fb490-5b76-42b2-b5a0-0305267f0603 req-3f313a6c-76e5-42e0-b2a6-d28366ae3c14 service nova] Lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:45:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-403fb490-5b76-42b2-b5a0-0305267f0603 req-3f313a6c-76e5-42e0-b2a6-d28366ae3c14 service nova] Lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:45:40 user nova-compute[71321]: DEBUG nova.compute.manager [req-403fb490-5b76-42b2-b5a0-0305267f0603 req-3f313a6c-76e5-42e0-b2a6-d28366ae3c14 service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] No waiting events found dispatching network-vif-unplugged-7e54d3ba-dd94-4d8c-adca-16b108135e54 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:45:40 user nova-compute[71321]: DEBUG nova.compute.manager [req-403fb490-5b76-42b2-b5a0-0305267f0603 req-3f313a6c-76e5-42e0-b2a6-d28366ae3c14 service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Received event network-vif-unplugged-7e54d3ba-dd94-4d8c-adca-16b108135e54 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:45:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:40 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Instance destroyed successfully.
Apr 12 12:45:40 user nova-compute[71321]: DEBUG nova.objects.instance [None req-c24e0045-dc9f-4e38-a9fa-7ecf6ffcca8e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lazy-loading 'resources' on Instance uuid 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:45:40 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-c24e0045-dc9f-4e38-a9fa-7ecf6ffcca8e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T12:40:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-615902404',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-615902404',id=26,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEkOEoNk45Nbu+gKXPJrgeuFyxP14yDmjujq5KBzAf1jdooM7if7PjnwRiQIghyJu3/D7EhyMQG3CM2jiTOS6YDsVIzsRhBe/9QtuVP0Mga6D+4x7iy56z4kNHaQEC8tg==',key_name='tempest-keypair-2116396079',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:44:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fec0c6dc7ab46b0b6b0a580252f40e3',ramdisk_id='',reservation_id='r-hw62w5cz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2036744628',owner_user_name='tempest-AttachVolumeShelveTestJSON-2036744628-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:44:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e4935eed324b868477f8e88918364a',uuid=08f95333-8c01-4fb1-a2cb-4501e6b0d2a5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "address": "fa:16:3e:bc:a8:83", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e54d3ba-dd", "ovs_interfaceid": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:45:40 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-c24e0045-dc9f-4e38-a9fa-7ecf6ffcca8e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Converting VIF {"id": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "address": "fa:16:3e:bc:a8:83", "network": {"id": "4ba97279-e122-4c2b-b931-dde33e1d71df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-523035693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fec0c6dc7ab46b0b6b0a580252f40e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e54d3ba-dd", "ovs_interfaceid": "7e54d3ba-dd94-4d8c-adca-16b108135e54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:45:40 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-c24e0045-dc9f-4e38-a9fa-7ecf6ffcca8e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:a8:83,bridge_name='br-int',has_traffic_filtering=True,id=7e54d3ba-dd94-4d8c-adca-16b108135e54,network=Network(4ba97279-e122-4c2b-b931-dde33e1d71df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e54d3ba-dd') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:45:40 user nova-compute[71321]: DEBUG os_vif [None req-c24e0045-dc9f-4e38-a9fa-7ecf6ffcca8e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:a8:83,bridge_name='br-int',has_traffic_filtering=True,id=7e54d3ba-dd94-4d8c-adca-16b108135e54,network=Network(4ba97279-e122-4c2b-b931-dde33e1d71df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e54d3ba-dd') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:45:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e54d3ba-dd, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:45:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:45:40 user nova-compute[71321]: INFO os_vif [None req-c24e0045-dc9f-4e38-a9fa-7ecf6ffcca8e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:a8:83,bridge_name='br-int',has_traffic_filtering=True,id=7e54d3ba-dd94-4d8c-adca-16b108135e54,network=Network(4ba97279-e122-4c2b-b931-dde33e1d71df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e54d3ba-dd')
Apr 12 12:45:40 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-c24e0045-dc9f-4e38-a9fa-7ecf6ffcca8e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Deleting instance files /opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5_del
Apr 12 12:45:40 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-c24e0045-dc9f-4e38-a9fa-7ecf6ffcca8e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Deletion of /opt/stack/data/nova/instances/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5_del complete
Apr 12 12:45:40 user nova-compute[71321]: INFO nova.compute.manager [None req-c24e0045-dc9f-4e38-a9fa-7ecf6ffcca8e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Took 0.64 seconds to destroy the instance on the hypervisor.
Apr 12 12:45:40 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-c24e0045-dc9f-4e38-a9fa-7ecf6ffcca8e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:45:40 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:45:40 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:45:41 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:45:41 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Took 0.75 seconds to deallocate network for instance.
Apr 12 12:45:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c24e0045-dc9f-4e38-a9fa-7ecf6ffcca8e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:45:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c24e0045-dc9f-4e38-a9fa-7ecf6ffcca8e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:45:41 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-c24e0045-dc9f-4e38-a9fa-7ecf6ffcca8e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:45:41 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-c24e0045-dc9f-4e38-a9fa-7ecf6ffcca8e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:45:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c24e0045-dc9f-4e38-a9fa-7ecf6ffcca8e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.211s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:45:41 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-c24e0045-dc9f-4e38-a9fa-7ecf6ffcca8e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Deleted allocations for instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5
Apr 12 12:45:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c24e0045-dc9f-4e38-a9fa-7ecf6ffcca8e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.805s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:45:42 user nova-compute[71321]: DEBUG nova.compute.manager [req-0bfe870e-0db4-4ac1-949e-25a5d1b6a309 req-8ee8fc44-aa1b-46a6-8a49-de1318c24b50 service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Received event network-vif-plugged-7e54d3ba-dd94-4d8c-adca-16b108135e54 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:45:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0bfe870e-0db4-4ac1-949e-25a5d1b6a309 req-8ee8fc44-aa1b-46a6-8a49-de1318c24b50 service nova] Acquiring lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:45:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0bfe870e-0db4-4ac1-949e-25a5d1b6a309 req-8ee8fc44-aa1b-46a6-8a49-de1318c24b50 service nova] Lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:45:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0bfe870e-0db4-4ac1-949e-25a5d1b6a309 req-8ee8fc44-aa1b-46a6-8a49-de1318c24b50 service nova] Lock "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:45:42 user nova-compute[71321]: DEBUG nova.compute.manager [req-0bfe870e-0db4-4ac1-949e-25a5d1b6a309 req-8ee8fc44-aa1b-46a6-8a49-de1318c24b50 service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] No waiting events found dispatching network-vif-plugged-7e54d3ba-dd94-4d8c-adca-16b108135e54 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:45:42 user nova-compute[71321]: WARNING nova.compute.manager [req-0bfe870e-0db4-4ac1-949e-25a5d1b6a309 req-8ee8fc44-aa1b-46a6-8a49-de1318c24b50 service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Received unexpected event network-vif-plugged-7e54d3ba-dd94-4d8c-adca-16b108135e54 for instance with vm_state deleted and task_state None.
Apr 12 12:45:42 user nova-compute[71321]: DEBUG nova.compute.manager [req-0bfe870e-0db4-4ac1-949e-25a5d1b6a309 req-8ee8fc44-aa1b-46a6-8a49-de1318c24b50 service nova] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Received event network-vif-deleted-7e54d3ba-dd94-4d8c-adca-16b108135e54 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:45:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:49 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681303534.2601411, d0592fff-d30d-40dc-95d3-263aab10a70e => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:45:49 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] VM Stopped (Lifecycle Event)
Apr 12 12:45:49 user nova-compute[71321]: DEBUG nova.compute.manager [None req-2672f776-0278-4c79-a618-de79ea88716e None None] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:45:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:55 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681303540.7442582, 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:45:55 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] VM Stopped (Lifecycle Event)
Apr 12 12:45:55 user nova-compute[71321]: DEBUG nova.compute.manager [None req-594cf45c-1cc5-4a49-91bf-a755b04c3d7e None None] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:45:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:45:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 12:45:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 12:45:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 12:45:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:45:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:46:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:46:10 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:46:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:46:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:46:10 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:46:10 user nova-compute[71321]: INFO nova.compute.claims [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Claim successful on node user
Apr 12 12:46:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:11 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:46:11 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:46:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.284s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:46:11 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:46:11 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:46:11 user nova-compute[71321]: DEBUG nova.network.neutron [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:46:11 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:46:11 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:46:11 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:46:11 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:46:11 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Creating image(s)
Apr 12 12:46:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "/opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:46:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "/opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:46:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "/opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:46:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:11 user nova-compute[71321]: DEBUG nova.policy [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a3d9f4516bee4f8d9af7a40ed1298f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61975273ccb41229e0138b96eb7f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:46:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.138s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:46:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:46:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.139s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/disk 1073741824" returned: 0 in 0.051s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:46:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.143s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:11 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:46:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:11 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Cannot resize image /opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:46:11 user nova-compute[71321]: DEBUG nova.objects.instance [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lazy-loading 'migration_context' on Instance uuid 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:46:11 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:46:11 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Ensure instance console log exists: /opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:46:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:46:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:46:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:46:12 user nova-compute[71321]: DEBUG nova.network.neutron [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Successfully created port: 968b45e2-1ead-4fdd-a879-52ebb15f5b6a {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG nova.network.neutron [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Successfully updated port: 968b45e2-1ead-4fdd-a879-52ebb15f5b6a {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "refresh_cache-9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquired lock "refresh_cache-9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG nova.network.neutron [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG nova.compute.manager [req-1bba77ad-b428-48dc-8fd8-3d119fc1396c req-4ba9ad0b-d482-44bf-81c7-021bd0b5e2ed service nova] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Received event network-changed-968b45e2-1ead-4fdd-a879-52ebb15f5b6a {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG nova.compute.manager [req-1bba77ad-b428-48dc-8fd8-3d119fc1396c req-4ba9ad0b-d482-44bf-81c7-021bd0b5e2ed service nova] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Refreshing instance network info cache due to event network-changed-968b45e2-1ead-4fdd-a879-52ebb15f5b6a. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-1bba77ad-b428-48dc-8fd8-3d119fc1396c req-4ba9ad0b-d482-44bf-81c7-021bd0b5e2ed service nova] Acquiring lock "refresh_cache-9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG nova.network.neutron [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG nova.network.neutron [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Updating instance_info_cache with network_info: [{"id": "968b45e2-1ead-4fdd-a879-52ebb15f5b6a", "address": "fa:16:3e:d7:03:df", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap968b45e2-1e", "ovs_interfaceid": "968b45e2-1ead-4fdd-a879-52ebb15f5b6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Releasing lock "refresh_cache-9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Instance network_info: |[{"id": "968b45e2-1ead-4fdd-a879-52ebb15f5b6a", "address": "fa:16:3e:d7:03:df", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap968b45e2-1e", "ovs_interfaceid": "968b45e2-1ead-4fdd-a879-52ebb15f5b6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-1bba77ad-b428-48dc-8fd8-3d119fc1396c req-4ba9ad0b-d482-44bf-81c7-021bd0b5e2ed service nova] Acquired lock "refresh_cache-9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG nova.network.neutron [req-1bba77ad-b428-48dc-8fd8-3d119fc1396c req-4ba9ad0b-d482-44bf-81c7-021bd0b5e2ed service nova] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Refreshing network info cache for port 968b45e2-1ead-4fdd-a879-52ebb15f5b6a {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Start _get_guest_xml network_info=[{"id": "968b45e2-1ead-4fdd-a879-52ebb15f5b6a", "address": "fa:16:3e:d7:03:df", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap968b45e2-1e", "ovs_interfaceid": "968b45e2-1ead-4fdd-a879-52ebb15f5b6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:46:13 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:46:13 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:46:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1943413206',display_name='tempest-AttachVolumeNegativeTest-server-1943413206',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1943413206',id=32,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdv55R/PFH7G3bAV+mLRNThOwZSl0ftMmxmYj5aU4BWLXfSGPog2OCXU22X8M1HmirOFjQTWnVswKvjPWgBWSuIO/2PPSCD+tkDfXlkxKDDKfnzAYyOJsq3Ofrf95xrQg==',key_name='tempest-keypair-1664165816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e61975273ccb41229e0138b96eb7f5e9',ramdisk_id='',reservation_id='r-x80dxl2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-941338837',owner_user_name='tempest-AttachVolumeNegativeTest-941338837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:46:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3d9f4516bee4f8d9af7a40ed1298f03',uuid=9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "968b45e2-1ead-4fdd-a879-52ebb15f5b6a", "address": "fa:16:3e:d7:03:df", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap968b45e2-1e", "ovs_interfaceid": "968b45e2-1ead-4fdd-a879-52ebb15f5b6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Converting VIF {"id": "968b45e2-1ead-4fdd-a879-52ebb15f5b6a", "address": "fa:16:3e:d7:03:df", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap968b45e2-1e", "ovs_interfaceid": "968b45e2-1ead-4fdd-a879-52ebb15f5b6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:03:df,bridge_name='br-int',has_traffic_filtering=True,id=968b45e2-1ead-4fdd-a879-52ebb15f5b6a,network=Network(e211a286-ade0-4930-a327-4c6a41785094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap968b45e2-1e') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG nova.objects.instance [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:46:13 user nova-compute[71321]:   <uuid>9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9</uuid>
Apr 12 12:46:13 user nova-compute[71321]:   <name>instance-00000020</name>
Apr 12 12:46:13 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:46:13 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:46:13 user nova-compute[71321]:   <metadata>
Apr 12 12:46:13 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:46:13 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:46:13 user nova-compute[71321]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1943413206</nova:name>
Apr 12 12:46:13 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:46:13</nova:creationTime>
Apr 12 12:46:13 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:46:13 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:46:13 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:46:13 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:46:13 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:46:13 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:46:13 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:46:13 user nova-compute[71321]:       <nova:owner>
Apr 12 12:46:13 user nova-compute[71321]:         <nova:user uuid="a3d9f4516bee4f8d9af7a40ed1298f03">tempest-AttachVolumeNegativeTest-941338837-project-member</nova:user>
Apr 12 12:46:13 user nova-compute[71321]:         <nova:project uuid="e61975273ccb41229e0138b96eb7f5e9">tempest-AttachVolumeNegativeTest-941338837</nova:project>
Apr 12 12:46:13 user nova-compute[71321]:       </nova:owner>
Apr 12 12:46:13 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:46:13 user nova-compute[71321]:       <nova:ports>
Apr 12 12:46:13 user nova-compute[71321]:         <nova:port uuid="968b45e2-1ead-4fdd-a879-52ebb15f5b6a">
Apr 12 12:46:13 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 12:46:13 user nova-compute[71321]:         </nova:port>
Apr 12 12:46:13 user nova-compute[71321]:       </nova:ports>
Apr 12 12:46:13 user nova-compute[71321]:     </nova:instance>
Apr 12 12:46:13 user nova-compute[71321]:   </metadata>
Apr 12 12:46:13 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:46:13 user nova-compute[71321]:     <system>
Apr 12 12:46:13 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:46:13 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:46:13 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:46:13 user nova-compute[71321]:       <entry name="serial">9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9</entry>
Apr 12 12:46:13 user nova-compute[71321]:       <entry name="uuid">9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9</entry>
Apr 12 12:46:13 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:46:13 user nova-compute[71321]:     </system>
Apr 12 12:46:13 user nova-compute[71321]:   </sysinfo>
Apr 12 12:46:13 user nova-compute[71321]:   <os>
Apr 12 12:46:13 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:46:13 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:46:13 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:46:13 user nova-compute[71321]:   </os>
Apr 12 12:46:13 user nova-compute[71321]:   <features>
Apr 12 12:46:13 user nova-compute[71321]:     <acpi/>
Apr 12 12:46:13 user nova-compute[71321]:     <apic/>
Apr 12 12:46:13 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:46:13 user nova-compute[71321]:   </features>
Apr 12 12:46:13 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:46:13 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:46:13 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:46:13 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:46:13 user nova-compute[71321]:   </clock>
Apr 12 12:46:13 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:46:13 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:46:13 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:46:13 user nova-compute[71321]:   </cpu>
Apr 12 12:46:13 user nova-compute[71321]:   <devices>
Apr 12 12:46:13 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:46:13 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:46:13 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/disk"/>
Apr 12 12:46:13 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:46:13 user nova-compute[71321]:     </disk>
Apr 12 12:46:13 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:46:13 user nova-compute[71321]:       <mac address="fa:16:3e:d7:03:df"/>
Apr 12 12:46:13 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:46:13 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:46:13 user nova-compute[71321]:       <target dev="tap968b45e2-1e"/>
Apr 12 12:46:13 user nova-compute[71321]:     </interface>
Apr 12 12:46:13 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:46:13 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/console.log" append="off"/>
Apr 12 12:46:13 user nova-compute[71321]:     </serial>
Apr 12 12:46:13 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:46:13 user nova-compute[71321]:     <video>
Apr 12 12:46:13 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:46:13 user nova-compute[71321]:     </video>
Apr 12 12:46:13 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:46:13 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:46:13 user nova-compute[71321]:     </rng>
Apr 12 12:46:13 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:46:13 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:46:13 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:46:13 user nova-compute[71321]:     </memballoon>
Apr 12 12:46:13 user nova-compute[71321]:   </devices>
Apr 12 12:46:13 user nova-compute[71321]: </domain>
Apr 12 12:46:13 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1943413206',display_name='tempest-AttachVolumeNegativeTest-server-1943413206',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1943413206',id=32,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdv55R/PFH7G3bAV+mLRNThOwZSl0ftMmxmYj5aU4BWLXfSGPog2OCXU22X8M1HmirOFjQTWnVswKvjPWgBWSuIO/2PPSCD+tkDfXlkxKDDKfnzAYyOJsq3Ofrf95xrQg==',key_name='tempest-keypair-1664165816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e61975273ccb41229e0138b96eb7f5e9',ramdisk_id='',reservation_id='r-x80dxl2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-941338837',owner_user_name='tempest-AttachVolumeNegativeTest-941338837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:46:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3d9f4516bee4f8d9af7a40ed1298f03',uuid=9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "968b45e2-1ead-4fdd-a879-52ebb15f5b6a", "address": "fa:16:3e:d7:03:df", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap968b45e2-1e", "ovs_interfaceid": "968b45e2-1ead-4fdd-a879-52ebb15f5b6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Converting VIF {"id": "968b45e2-1ead-4fdd-a879-52ebb15f5b6a", "address": "fa:16:3e:d7:03:df", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap968b45e2-1e", "ovs_interfaceid": "968b45e2-1ead-4fdd-a879-52ebb15f5b6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:03:df,bridge_name='br-int',has_traffic_filtering=True,id=968b45e2-1ead-4fdd-a879-52ebb15f5b6a,network=Network(e211a286-ade0-4930-a327-4c6a41785094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap968b45e2-1e') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG os_vif [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:03:df,bridge_name='br-int',has_traffic_filtering=True,id=968b45e2-1ead-4fdd-a879-52ebb15f5b6a,network=Network(e211a286-ade0-4930-a327-4c6a41785094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap968b45e2-1e') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap968b45e2-1e, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap968b45e2-1e, col_values=(('external_ids', {'iface-id': '968b45e2-1ead-4fdd-a879-52ebb15f5b6a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:03:df', 'vm-uuid': '9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:13 user nova-compute[71321]: INFO os_vif [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:03:df,bridge_name='br-int',has_traffic_filtering=True,id=968b45e2-1ead-4fdd-a879-52ebb15f5b6a,network=Network(e211a286-ade0-4930-a327-4c6a41785094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap968b45e2-1e')
Apr 12 12:46:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:46:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] No VIF found with MAC fa:16:3e:d7:03:df, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:46:14 user nova-compute[71321]: DEBUG nova.network.neutron [req-1bba77ad-b428-48dc-8fd8-3d119fc1396c req-4ba9ad0b-d482-44bf-81c7-021bd0b5e2ed service nova] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Updated VIF entry in instance network info cache for port 968b45e2-1ead-4fdd-a879-52ebb15f5b6a. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:46:14 user nova-compute[71321]: DEBUG nova.network.neutron [req-1bba77ad-b428-48dc-8fd8-3d119fc1396c req-4ba9ad0b-d482-44bf-81c7-021bd0b5e2ed service nova] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Updating instance_info_cache with network_info: [{"id": "968b45e2-1ead-4fdd-a879-52ebb15f5b6a", "address": "fa:16:3e:d7:03:df", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap968b45e2-1e", "ovs_interfaceid": "968b45e2-1ead-4fdd-a879-52ebb15f5b6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:46:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-1bba77ad-b428-48dc-8fd8-3d119fc1396c req-4ba9ad0b-d482-44bf-81c7-021bd0b5e2ed service nova] Releasing lock "refresh_cache-9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:46:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:15 user nova-compute[71321]: DEBUG nova.compute.manager [req-5c2ca4f2-0cf8-4d47-96a8-442d0b94d19b req-b308148b-9338-4276-9830-af5414e7450f service nova] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Received event network-vif-plugged-968b45e2-1ead-4fdd-a879-52ebb15f5b6a {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:46:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-5c2ca4f2-0cf8-4d47-96a8-442d0b94d19b req-b308148b-9338-4276-9830-af5414e7450f service nova] Acquiring lock "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:46:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-5c2ca4f2-0cf8-4d47-96a8-442d0b94d19b req-b308148b-9338-4276-9830-af5414e7450f service nova] Lock "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:46:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-5c2ca4f2-0cf8-4d47-96a8-442d0b94d19b req-b308148b-9338-4276-9830-af5414e7450f service nova] Lock "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:46:15 user nova-compute[71321]: DEBUG nova.compute.manager [req-5c2ca4f2-0cf8-4d47-96a8-442d0b94d19b req-b308148b-9338-4276-9830-af5414e7450f service nova] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] No waiting events found dispatching network-vif-plugged-968b45e2-1ead-4fdd-a879-52ebb15f5b6a {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:46:15 user nova-compute[71321]: WARNING nova.compute.manager [req-5c2ca4f2-0cf8-4d47-96a8-442d0b94d19b req-b308148b-9338-4276-9830-af5414e7450f service nova] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Received unexpected event network-vif-plugged-968b45e2-1ead-4fdd-a879-52ebb15f5b6a for instance with vm_state building and task_state spawning.
Apr 12 12:46:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:17 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303577.2264566, 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:46:17 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] VM Resumed (Lifecycle Event)
Apr 12 12:46:17 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:46:17 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:46:17 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Instance spawned successfully.
Apr 12 12:46:17 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:46:17 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:46:17 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:46:17 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:46:17 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:46:17 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:46:17 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:46:17 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:46:17 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:46:17 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:46:17 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303577.2282777, 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:46:17 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] VM Started (Lifecycle Event)
Apr 12 12:46:17 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:46:17 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:46:17 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:46:17 user nova-compute[71321]: INFO nova.compute.manager [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Took 6.02 seconds to spawn the instance on the hypervisor.
Apr 12 12:46:17 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:46:17 user nova-compute[71321]: DEBUG nova.compute.manager [req-b3deeb74-4bfd-46c5-a655-70049500ad7b req-a31f72b5-6031-402b-97fd-1bc04f2d0148 service nova] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Received event network-vif-plugged-968b45e2-1ead-4fdd-a879-52ebb15f5b6a {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:46:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b3deeb74-4bfd-46c5-a655-70049500ad7b req-a31f72b5-6031-402b-97fd-1bc04f2d0148 service nova] Acquiring lock "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:46:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b3deeb74-4bfd-46c5-a655-70049500ad7b req-a31f72b5-6031-402b-97fd-1bc04f2d0148 service nova] Lock "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:46:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b3deeb74-4bfd-46c5-a655-70049500ad7b req-a31f72b5-6031-402b-97fd-1bc04f2d0148 service nova] Lock "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:46:17 user nova-compute[71321]: DEBUG nova.compute.manager [req-b3deeb74-4bfd-46c5-a655-70049500ad7b req-a31f72b5-6031-402b-97fd-1bc04f2d0148 service nova] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] No waiting events found dispatching network-vif-plugged-968b45e2-1ead-4fdd-a879-52ebb15f5b6a {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:46:17 user nova-compute[71321]: WARNING nova.compute.manager [req-b3deeb74-4bfd-46c5-a655-70049500ad7b req-a31f72b5-6031-402b-97fd-1bc04f2d0148 service nova] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Received unexpected event network-vif-plugged-968b45e2-1ead-4fdd-a879-52ebb15f5b6a for instance with vm_state building and task_state spawning.
Apr 12 12:46:17 user nova-compute[71321]: INFO nova.compute.manager [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Took 6.70 seconds to build instance.
Apr 12 12:46:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.789s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:46:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:23 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "e702924c-a079-4744-a112-985304a861ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:46:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "e702924c-a079-4744-a112-985304a861ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:46:25 user nova-compute[71321]: DEBUG nova.compute.manager [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:46:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:46:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:46:25 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:46:25 user nova-compute[71321]: INFO nova.compute.claims [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Claim successful on node user
Apr 12 12:46:25 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:46:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:46:25 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:46:25 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:46:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:46:25 user nova-compute[71321]: DEBUG nova.compute.manager [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:46:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.341s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:46:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:46:25 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:46:25 user nova-compute[71321]: DEBUG nova.compute.manager [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:46:25 user nova-compute[71321]: DEBUG nova.network.neutron [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:46:25 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:46:25 user nova-compute[71321]: DEBUG nova.compute.manager [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:46:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:26 user nova-compute[71321]: DEBUG nova.policy [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b3792e5a3b24583bbf50fb2b275b6d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd0006105e24edb9516d52c5af63054', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:46:26 user nova-compute[71321]: DEBUG nova.compute.manager [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:46:26 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:46:26 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Creating image(s)
Apr 12 12:46:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "/opt/stack/data/nova/instances/e702924c-a079-4744-a112-985304a861ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:46:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "/opt/stack/data/nova/instances/e702924c-a079-4744-a112-985304a861ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:46:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "/opt/stack/data/nova/instances/e702924c-a079-4744-a112-985304a861ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:46:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:26 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:46:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.204s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:46:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:46:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.182s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/e702924c-a079-4744-a112-985304a861ea/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/e702924c-a079-4744-a112-985304a861ea/disk 1073741824" returned: 0 in 0.055s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:46:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:27 user nova-compute[71321]: DEBUG nova.network.neutron [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Successfully created port: ec18f93d-7e1c-4140-bd72-4945caafc3b0 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:46:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.601s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:27 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e702924c-a079-4744-a112-985304a861ea/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:46:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e702924c-a079-4744-a112-985304a861ea/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:27 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:46:27 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:46:27 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8404MB free_disk=26.474803924560547GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:46:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:46:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:46:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e702924c-a079-4744-a112-985304a861ea/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:27 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Cannot resize image /opt/stack/data/nova/instances/e702924c-a079-4744-a112-985304a861ea/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:46:27 user nova-compute[71321]: DEBUG nova.objects.instance [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lazy-loading 'migration_context' on Instance uuid e702924c-a079-4744-a112-985304a861ea {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:46:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:46:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Ensure instance console log exists: /opt/stack/data/nova/instances/e702924c-a079-4744-a112-985304a861ea/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:46:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:46:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:46:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:46:27 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:46:27 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 62452efb-3a12-4aff-9359-217d17fc052a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:46:27 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:46:27 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance e702924c-a079-4744-a112-985304a861ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:46:27 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:46:27 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:46:27 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:46:27 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:46:27 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:46:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.307s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:46:27 user nova-compute[71321]: DEBUG nova.network.neutron [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Successfully updated port: ec18f93d-7e1c-4140-bd72-4945caafc3b0 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:46:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "refresh_cache-e702924c-a079-4744-a112-985304a861ea" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:46:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquired lock "refresh_cache-e702924c-a079-4744-a112-985304a861ea" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:46:27 user nova-compute[71321]: DEBUG nova.network.neutron [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG nova.compute.manager [req-33d00a8e-8017-4ab9-be0e-db823c2ad1f7 req-edd55dae-78e2-4080-8d9a-cd58fb710775 service nova] [instance: e702924c-a079-4744-a112-985304a861ea] Received event network-changed-ec18f93d-7e1c-4140-bd72-4945caafc3b0 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG nova.compute.manager [req-33d00a8e-8017-4ab9-be0e-db823c2ad1f7 req-edd55dae-78e2-4080-8d9a-cd58fb710775 service nova] [instance: e702924c-a079-4744-a112-985304a861ea] Refreshing instance network info cache due to event network-changed-ec18f93d-7e1c-4140-bd72-4945caafc3b0. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-33d00a8e-8017-4ab9-be0e-db823c2ad1f7 req-edd55dae-78e2-4080-8d9a-cd58fb710775 service nova] Acquiring lock "refresh_cache-e702924c-a079-4744-a112-985304a861ea" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG nova.network.neutron [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG nova.network.neutron [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Updating instance_info_cache with network_info: [{"id": "ec18f93d-7e1c-4140-bd72-4945caafc3b0", "address": "fa:16:3e:96:e2:63", "network": {"id": "eaded3a8-c825-4731-95bc-3f39f32603da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1058349103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bfd0006105e24edb9516d52c5af63054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec18f93d-7e", "ovs_interfaceid": "ec18f93d-7e1c-4140-bd72-4945caafc3b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Releasing lock "refresh_cache-e702924c-a079-4744-a112-985304a861ea" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG nova.compute.manager [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Instance network_info: |[{"id": "ec18f93d-7e1c-4140-bd72-4945caafc3b0", "address": "fa:16:3e:96:e2:63", "network": {"id": "eaded3a8-c825-4731-95bc-3f39f32603da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1058349103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bfd0006105e24edb9516d52c5af63054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec18f93d-7e", "ovs_interfaceid": "ec18f93d-7e1c-4140-bd72-4945caafc3b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-33d00a8e-8017-4ab9-be0e-db823c2ad1f7 req-edd55dae-78e2-4080-8d9a-cd58fb710775 service nova] Acquired lock "refresh_cache-e702924c-a079-4744-a112-985304a861ea" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG nova.network.neutron [req-33d00a8e-8017-4ab9-be0e-db823c2ad1f7 req-edd55dae-78e2-4080-8d9a-cd58fb710775 service nova] [instance: e702924c-a079-4744-a112-985304a861ea] Refreshing network info cache for port ec18f93d-7e1c-4140-bd72-4945caafc3b0 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Start _get_guest_xml network_info=[{"id": "ec18f93d-7e1c-4140-bd72-4945caafc3b0", "address": "fa:16:3e:96:e2:63", "network": {"id": "eaded3a8-c825-4731-95bc-3f39f32603da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1058349103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bfd0006105e24edb9516d52c5af63054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec18f93d-7e", "ovs_interfaceid": "ec18f93d-7e1c-4140-bd72-4945caafc3b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:46:28 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:46:28 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:46:28 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:46:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-293731119',display_name='tempest-VolumesActionsTest-instance-293731119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-293731119',id=33,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfd0006105e24edb9516d52c5af63054',ramdisk_id='',reservation_id='r-8436yj01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1646592366',owner_user_name='tempest-VolumesActionsTest-1646592366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:46:26Z,user_data=None,user_id='2b3792e5a3b24583bbf50fb2b275b6d0',uuid=e702924c-a079-4744-a112-985304a861ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec18f93d-7e1c-4140-bd72-4945caafc3b0", "address": "fa:16:3e:96:e2:63", "network": {"id": "eaded3a8-c825-4731-95bc-3f39f32603da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1058349103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bfd0006105e24edb9516d52c5af63054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec18f93d-7e", "ovs_interfaceid": "ec18f93d-7e1c-4140-bd72-4945caafc3b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Converting VIF {"id": "ec18f93d-7e1c-4140-bd72-4945caafc3b0", "address": "fa:16:3e:96:e2:63", "network": {"id": "eaded3a8-c825-4731-95bc-3f39f32603da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1058349103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bfd0006105e24edb9516d52c5af63054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec18f93d-7e", "ovs_interfaceid": "ec18f93d-7e1c-4140-bd72-4945caafc3b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:e2:63,bridge_name='br-int',has_traffic_filtering=True,id=ec18f93d-7e1c-4140-bd72-4945caafc3b0,network=Network(eaded3a8-c825-4731-95bc-3f39f32603da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec18f93d-7e') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG nova.objects.instance [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lazy-loading 'pci_devices' on Instance uuid e702924c-a079-4744-a112-985304a861ea {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:46:28 user nova-compute[71321]:   <uuid>e702924c-a079-4744-a112-985304a861ea</uuid>
Apr 12 12:46:28 user nova-compute[71321]:   <name>instance-00000021</name>
Apr 12 12:46:28 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:46:28 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:46:28 user nova-compute[71321]:   <metadata>
Apr 12 12:46:28 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:46:28 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:46:28 user nova-compute[71321]:       <nova:name>tempest-VolumesActionsTest-instance-293731119</nova:name>
Apr 12 12:46:28 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:46:28</nova:creationTime>
Apr 12 12:46:28 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:46:28 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:46:28 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:46:28 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:46:28 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:46:28 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:46:28 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:46:28 user nova-compute[71321]:       <nova:owner>
Apr 12 12:46:28 user nova-compute[71321]:         <nova:user uuid="2b3792e5a3b24583bbf50fb2b275b6d0">tempest-VolumesActionsTest-1646592366-project-member</nova:user>
Apr 12 12:46:28 user nova-compute[71321]:         <nova:project uuid="bfd0006105e24edb9516d52c5af63054">tempest-VolumesActionsTest-1646592366</nova:project>
Apr 12 12:46:28 user nova-compute[71321]:       </nova:owner>
Apr 12 12:46:28 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:46:28 user nova-compute[71321]:       <nova:ports>
Apr 12 12:46:28 user nova-compute[71321]:         <nova:port uuid="ec18f93d-7e1c-4140-bd72-4945caafc3b0">
Apr 12 12:46:28 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 12:46:28 user nova-compute[71321]:         </nova:port>
Apr 12 12:46:28 user nova-compute[71321]:       </nova:ports>
Apr 12 12:46:28 user nova-compute[71321]:     </nova:instance>
Apr 12 12:46:28 user nova-compute[71321]:   </metadata>
Apr 12 12:46:28 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:46:28 user nova-compute[71321]:     <system>
Apr 12 12:46:28 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:46:28 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:46:28 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:46:28 user nova-compute[71321]:       <entry name="serial">e702924c-a079-4744-a112-985304a861ea</entry>
Apr 12 12:46:28 user nova-compute[71321]:       <entry name="uuid">e702924c-a079-4744-a112-985304a861ea</entry>
Apr 12 12:46:28 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:46:28 user nova-compute[71321]:     </system>
Apr 12 12:46:28 user nova-compute[71321]:   </sysinfo>
Apr 12 12:46:28 user nova-compute[71321]:   <os>
Apr 12 12:46:28 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:46:28 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:46:28 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:46:28 user nova-compute[71321]:   </os>
Apr 12 12:46:28 user nova-compute[71321]:   <features>
Apr 12 12:46:28 user nova-compute[71321]:     <acpi/>
Apr 12 12:46:28 user nova-compute[71321]:     <apic/>
Apr 12 12:46:28 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:46:28 user nova-compute[71321]:   </features>
Apr 12 12:46:28 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:46:28 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:46:28 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:46:28 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:46:28 user nova-compute[71321]:   </clock>
Apr 12 12:46:28 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:46:28 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:46:28 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:46:28 user nova-compute[71321]:   </cpu>
Apr 12 12:46:28 user nova-compute[71321]:   <devices>
Apr 12 12:46:28 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:46:28 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:46:28 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/e702924c-a079-4744-a112-985304a861ea/disk"/>
Apr 12 12:46:28 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:46:28 user nova-compute[71321]:     </disk>
Apr 12 12:46:28 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:46:28 user nova-compute[71321]:       <mac address="fa:16:3e:96:e2:63"/>
Apr 12 12:46:28 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:46:28 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:46:28 user nova-compute[71321]:       <target dev="tapec18f93d-7e"/>
Apr 12 12:46:28 user nova-compute[71321]:     </interface>
Apr 12 12:46:28 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:46:28 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/e702924c-a079-4744-a112-985304a861ea/console.log" append="off"/>
Apr 12 12:46:28 user nova-compute[71321]:     </serial>
Apr 12 12:46:28 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:46:28 user nova-compute[71321]:     <video>
Apr 12 12:46:28 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:46:28 user nova-compute[71321]:     </video>
Apr 12 12:46:28 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:46:28 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:46:28 user nova-compute[71321]:     </rng>
Apr 12 12:46:28 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:46:28 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:46:28 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:46:28 user nova-compute[71321]:     </memballoon>
Apr 12 12:46:28 user nova-compute[71321]:   </devices>
Apr 12 12:46:28 user nova-compute[71321]: </domain>
Apr 12 12:46:28 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:46:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-293731119',display_name='tempest-VolumesActionsTest-instance-293731119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-293731119',id=33,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfd0006105e24edb9516d52c5af63054',ramdisk_id='',reservation_id='r-8436yj01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1646592366',owner_user_name='tempest-VolumesActionsTest-1646592366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:46:26Z,user_data=None,user_id='2b3792e5a3b24583bbf50fb2b275b6d0',uuid=e702924c-a079-4744-a112-985304a861ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec18f93d-7e1c-4140-bd72-4945caafc3b0", "address": "fa:16:3e:96:e2:63", "network": {"id": "eaded3a8-c825-4731-95bc-3f39f32603da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1058349103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bfd0006105e24edb9516d52c5af63054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec18f93d-7e", "ovs_interfaceid": "ec18f93d-7e1c-4140-bd72-4945caafc3b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Converting VIF {"id": "ec18f93d-7e1c-4140-bd72-4945caafc3b0", "address": "fa:16:3e:96:e2:63", "network": {"id": "eaded3a8-c825-4731-95bc-3f39f32603da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1058349103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bfd0006105e24edb9516d52c5af63054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec18f93d-7e", "ovs_interfaceid": "ec18f93d-7e1c-4140-bd72-4945caafc3b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:e2:63,bridge_name='br-int',has_traffic_filtering=True,id=ec18f93d-7e1c-4140-bd72-4945caafc3b0,network=Network(eaded3a8-c825-4731-95bc-3f39f32603da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec18f93d-7e') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG os_vif [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:e2:63,bridge_name='br-int',has_traffic_filtering=True,id=ec18f93d-7e1c-4140-bd72-4945caafc3b0,network=Network(eaded3a8-c825-4731-95bc-3f39f32603da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec18f93d-7e') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec18f93d-7e, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapec18f93d-7e, col_values=(('external_ids', {'iface-id': 'ec18f93d-7e1c-4140-bd72-4945caafc3b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:e2:63', 'vm-uuid': 'e702924c-a079-4744-a112-985304a861ea'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:28 user nova-compute[71321]: INFO os_vif [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:e2:63,bridge_name='br-int',has_traffic_filtering=True,id=ec18f93d-7e1c-4140-bd72-4945caafc3b0,network=Network(eaded3a8-c825-4731-95bc-3f39f32603da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec18f93d-7e')
Apr 12 12:46:28 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] No VIF found with MAC fa:16:3e:96:e2:63, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG nova.network.neutron [req-33d00a8e-8017-4ab9-be0e-db823c2ad1f7 req-edd55dae-78e2-4080-8d9a-cd58fb710775 service nova] [instance: e702924c-a079-4744-a112-985304a861ea] Updated VIF entry in instance network info cache for port ec18f93d-7e1c-4140-bd72-4945caafc3b0. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG nova.network.neutron [req-33d00a8e-8017-4ab9-be0e-db823c2ad1f7 req-edd55dae-78e2-4080-8d9a-cd58fb710775 service nova] [instance: e702924c-a079-4744-a112-985304a861ea] Updating instance_info_cache with network_info: [{"id": "ec18f93d-7e1c-4140-bd72-4945caafc3b0", "address": "fa:16:3e:96:e2:63", "network": {"id": "eaded3a8-c825-4731-95bc-3f39f32603da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1058349103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bfd0006105e24edb9516d52c5af63054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec18f93d-7e", "ovs_interfaceid": "ec18f93d-7e1c-4140-bd72-4945caafc3b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:46:28 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-33d00a8e-8017-4ab9-be0e-db823c2ad1f7 req-edd55dae-78e2-4080-8d9a-cd58fb710775 service nova] Releasing lock "refresh_cache-e702924c-a079-4744-a112-985304a861ea" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:46:29 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:46:29 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:46:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:30 user nova-compute[71321]: DEBUG nova.compute.manager [req-507c45c0-c332-4160-8558-20f5d34d1d71 req-8cb04ef0-63d4-4d95-8c68-6849ad9be38a service nova] [instance: e702924c-a079-4744-a112-985304a861ea] Received event network-vif-plugged-ec18f93d-7e1c-4140-bd72-4945caafc3b0 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:46:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-507c45c0-c332-4160-8558-20f5d34d1d71 req-8cb04ef0-63d4-4d95-8c68-6849ad9be38a service nova] Acquiring lock "e702924c-a079-4744-a112-985304a861ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:46:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-507c45c0-c332-4160-8558-20f5d34d1d71 req-8cb04ef0-63d4-4d95-8c68-6849ad9be38a service nova] Lock "e702924c-a079-4744-a112-985304a861ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:46:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-507c45c0-c332-4160-8558-20f5d34d1d71 req-8cb04ef0-63d4-4d95-8c68-6849ad9be38a service nova] Lock "e702924c-a079-4744-a112-985304a861ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:46:30 user nova-compute[71321]: DEBUG nova.compute.manager [req-507c45c0-c332-4160-8558-20f5d34d1d71 req-8cb04ef0-63d4-4d95-8c68-6849ad9be38a service nova] [instance: e702924c-a079-4744-a112-985304a861ea] No waiting events found dispatching network-vif-plugged-ec18f93d-7e1c-4140-bd72-4945caafc3b0 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:46:30 user nova-compute[71321]: WARNING nova.compute.manager [req-507c45c0-c332-4160-8558-20f5d34d1d71 req-8cb04ef0-63d4-4d95-8c68-6849ad9be38a service nova] [instance: e702924c-a079-4744-a112-985304a861ea] Received unexpected event network-vif-plugged-ec18f93d-7e1c-4140-bd72-4945caafc3b0 for instance with vm_state building and task_state spawning.
Apr 12 12:46:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:30 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:46:31 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303591.9737422, e702924c-a079-4744-a112-985304a861ea => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:46:31 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: e702924c-a079-4744-a112-985304a861ea] VM Resumed (Lifecycle Event)
Apr 12 12:46:31 user nova-compute[71321]: DEBUG nova.compute.manager [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:46:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:46:31 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: e702924c-a079-4744-a112-985304a861ea] Instance spawned successfully.
Apr 12 12:46:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:46:31 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: e702924c-a079-4744-a112-985304a861ea] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:46:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: e702924c-a079-4744-a112-985304a861ea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:46:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:46:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:46:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:46:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:46:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:46:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:46:32 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: e702924c-a079-4744-a112-985304a861ea] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:46:32 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303591.9750125, e702924c-a079-4744-a112-985304a861ea => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:46:32 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: e702924c-a079-4744-a112-985304a861ea] VM Started (Lifecycle Event)
Apr 12 12:46:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: e702924c-a079-4744-a112-985304a861ea] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:46:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: e702924c-a079-4744-a112-985304a861ea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:46:32 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: e702924c-a079-4744-a112-985304a861ea] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:46:32 user nova-compute[71321]: INFO nova.compute.manager [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Took 5.97 seconds to spawn the instance on the hypervisor.
Apr 12 12:46:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:46:32 user nova-compute[71321]: DEBUG nova.compute.manager [req-56680874-c310-4e20-9a07-97bd1dc11a69 req-2b804d08-7073-4a1d-8f5a-1f946f5436f7 service nova] [instance: e702924c-a079-4744-a112-985304a861ea] Received event network-vif-plugged-ec18f93d-7e1c-4140-bd72-4945caafc3b0 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:46:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-56680874-c310-4e20-9a07-97bd1dc11a69 req-2b804d08-7073-4a1d-8f5a-1f946f5436f7 service nova] Acquiring lock "e702924c-a079-4744-a112-985304a861ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:46:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-56680874-c310-4e20-9a07-97bd1dc11a69 req-2b804d08-7073-4a1d-8f5a-1f946f5436f7 service nova] Lock "e702924c-a079-4744-a112-985304a861ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:46:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-56680874-c310-4e20-9a07-97bd1dc11a69 req-2b804d08-7073-4a1d-8f5a-1f946f5436f7 service nova] Lock "e702924c-a079-4744-a112-985304a861ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:46:32 user nova-compute[71321]: DEBUG nova.compute.manager [req-56680874-c310-4e20-9a07-97bd1dc11a69 req-2b804d08-7073-4a1d-8f5a-1f946f5436f7 service nova] [instance: e702924c-a079-4744-a112-985304a861ea] No waiting events found dispatching network-vif-plugged-ec18f93d-7e1c-4140-bd72-4945caafc3b0 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:46:32 user nova-compute[71321]: WARNING nova.compute.manager [req-56680874-c310-4e20-9a07-97bd1dc11a69 req-2b804d08-7073-4a1d-8f5a-1f946f5436f7 service nova] [instance: e702924c-a079-4744-a112-985304a861ea] Received unexpected event network-vif-plugged-ec18f93d-7e1c-4140-bd72-4945caafc3b0 for instance with vm_state building and task_state spawning.
Apr 12 12:46:32 user nova-compute[71321]: INFO nova.compute.manager [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Took 6.81 seconds to build instance.
Apr 12 12:46:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "e702924c-a079-4744-a112-985304a861ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.051s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:46:32 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:46:33 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:46:33 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:46:33 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:46:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:46:33 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 12:46:34 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Updating instance_info_cache with network_info: [{"id": "01ee163a-4590-4b09-bcb5-a53d238252d8", "address": "fa:16:3e:36:a3:07", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01ee163a-45", "ovs_interfaceid": "01ee163a-4590-4b09-bcb5-a53d238252d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:46:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:46:34 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 12:46:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:37 user nova-compute[71321]: DEBUG nova.compute.manager [req-61eb1ce4-56e9-411c-a984-f0a3d2126b82 req-2746602a-c8ff-467b-bd88-5883b7b2e2fb service nova] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Received event network-changed-01ee163a-4590-4b09-bcb5-a53d238252d8 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:46:37 user nova-compute[71321]: DEBUG nova.compute.manager [req-61eb1ce4-56e9-411c-a984-f0a3d2126b82 req-2746602a-c8ff-467b-bd88-5883b7b2e2fb service nova] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Refreshing instance network info cache due to event network-changed-01ee163a-4590-4b09-bcb5-a53d238252d8. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:46:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-61eb1ce4-56e9-411c-a984-f0a3d2126b82 req-2746602a-c8ff-467b-bd88-5883b7b2e2fb service nova] Acquiring lock "refresh_cache-a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:46:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-61eb1ce4-56e9-411c-a984-f0a3d2126b82 req-2746602a-c8ff-467b-bd88-5883b7b2e2fb service nova] Acquired lock "refresh_cache-a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:46:37 user nova-compute[71321]: DEBUG nova.network.neutron [req-61eb1ce4-56e9-411c-a984-f0a3d2126b82 req-2746602a-c8ff-467b-bd88-5883b7b2e2fb service nova] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Refreshing network info cache for port 01ee163a-4590-4b09-bcb5-a53d238252d8 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:46:38 user nova-compute[71321]: DEBUG nova.network.neutron [req-61eb1ce4-56e9-411c-a984-f0a3d2126b82 req-2746602a-c8ff-467b-bd88-5883b7b2e2fb service nova] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Updated VIF entry in instance network info cache for port 01ee163a-4590-4b09-bcb5-a53d238252d8. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:46:38 user nova-compute[71321]: DEBUG nova.network.neutron [req-61eb1ce4-56e9-411c-a984-f0a3d2126b82 req-2746602a-c8ff-467b-bd88-5883b7b2e2fb service nova] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Updating instance_info_cache with network_info: [{"id": "01ee163a-4590-4b09-bcb5-a53d238252d8", "address": "fa:16:3e:36:a3:07", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01ee163a-45", "ovs_interfaceid": "01ee163a-4590-4b09-bcb5-a53d238252d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:46:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-61eb1ce4-56e9-411c-a984-f0a3d2126b82 req-2746602a-c8ff-467b-bd88-5883b7b2e2fb service nova] Releasing lock "refresh_cache-a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:46:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:39 user nova-compute[71321]: DEBUG nova.compute.manager [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Stashing vm_state: active {{(pid=71321) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 12 12:46:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-4af0917c-10d8-40d8-88cc-cccad6cedb0d req-8d1aae32-5b54-47e8-aa85-0e9b8065dc00 service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Received event network-changed-6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:46:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-4af0917c-10d8-40d8-88cc-cccad6cedb0d req-8d1aae32-5b54-47e8-aa85-0e9b8065dc00 service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Refreshing instance network info cache due to event network-changed-6ea59aa7-b979-4fa0-b26b-cf96ad5addb2. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:46:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4af0917c-10d8-40d8-88cc-cccad6cedb0d req-8d1aae32-5b54-47e8-aa85-0e9b8065dc00 service nova] Acquiring lock "refresh_cache-62452efb-3a12-4aff-9359-217d17fc052a" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:46:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4af0917c-10d8-40d8-88cc-cccad6cedb0d req-8d1aae32-5b54-47e8-aa85-0e9b8065dc00 service nova] Acquired lock "refresh_cache-62452efb-3a12-4aff-9359-217d17fc052a" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:46:39 user nova-compute[71321]: DEBUG nova.network.neutron [req-4af0917c-10d8-40d8-88cc-cccad6cedb0d req-8d1aae32-5b54-47e8-aa85-0e9b8065dc00 service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Refreshing network info cache for port 6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:46:39 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:46:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:46:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:46:39 user nova-compute[71321]: DEBUG nova.objects.instance [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lazy-loading 'pci_requests' on Instance uuid 62452efb-3a12-4aff-9359-217d17fc052a {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:46:39 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:46:39 user nova-compute[71321]: INFO nova.compute.claims [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Claim successful on node user
Apr 12 12:46:39 user nova-compute[71321]: DEBUG nova.objects.instance [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lazy-loading 'resources' on Instance uuid 62452efb-3a12-4aff-9359-217d17fc052a {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:46:39 user nova-compute[71321]: DEBUG nova.objects.instance [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lazy-loading 'pci_devices' on Instance uuid 62452efb-3a12-4aff-9359-217d17fc052a {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:46:39 user nova-compute[71321]: INFO nova.compute.resource_tracker [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Updating resource usage from migration 1690aedb-b803-4256-a452-934af08125fb
Apr 12 12:46:39 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:46:39 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:46:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.394s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:46:39 user nova-compute[71321]: INFO nova.compute.manager [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Migrating
Apr 12 12:46:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "refresh_cache-62452efb-3a12-4aff-9359-217d17fc052a" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:46:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:40 user nova-compute[71321]: DEBUG nova.network.neutron [req-4af0917c-10d8-40d8-88cc-cccad6cedb0d req-8d1aae32-5b54-47e8-aa85-0e9b8065dc00 service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Updated VIF entry in instance network info cache for port 6ea59aa7-b979-4fa0-b26b-cf96ad5addb2. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:46:40 user nova-compute[71321]: DEBUG nova.network.neutron [req-4af0917c-10d8-40d8-88cc-cccad6cedb0d req-8d1aae32-5b54-47e8-aa85-0e9b8065dc00 service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Updating instance_info_cache with network_info: [{"id": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "address": "fa:16:3e:c6:61:66", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea59aa7-b9", "ovs_interfaceid": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:46:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4af0917c-10d8-40d8-88cc-cccad6cedb0d req-8d1aae32-5b54-47e8-aa85-0e9b8065dc00 service nova] Releasing lock "refresh_cache-62452efb-3a12-4aff-9359-217d17fc052a" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:46:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquired lock "refresh_cache-62452efb-3a12-4aff-9359-217d17fc052a" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:46:40 user nova-compute[71321]: DEBUG nova.network.neutron [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:46:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:40 user nova-compute[71321]: DEBUG nova.network.neutron [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Updating instance_info_cache with network_info: [{"id": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "address": "fa:16:3e:c6:61:66", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea59aa7-b9", "ovs_interfaceid": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:46:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Releasing lock "refresh_cache-62452efb-3a12-4aff-9359-217d17fc052a" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:46:41 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Starting migrate_disk_and_power_off {{(pid=71321) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 12 12:46:41 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:41 user nova-compute[71321]: DEBUG nova.compute.manager [req-e4caa6a4-9a81-4c0a-94d0-687c1ce80025 req-54c42cca-c516-472e-bb02-a328cee1588c service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Received event network-vif-unplugged-6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:46:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e4caa6a4-9a81-4c0a-94d0-687c1ce80025 req-54c42cca-c516-472e-bb02-a328cee1588c service nova] Acquiring lock "62452efb-3a12-4aff-9359-217d17fc052a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:46:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e4caa6a4-9a81-4c0a-94d0-687c1ce80025 req-54c42cca-c516-472e-bb02-a328cee1588c service nova] Lock "62452efb-3a12-4aff-9359-217d17fc052a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:46:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e4caa6a4-9a81-4c0a-94d0-687c1ce80025 req-54c42cca-c516-472e-bb02-a328cee1588c service nova] Lock "62452efb-3a12-4aff-9359-217d17fc052a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:46:41 user nova-compute[71321]: DEBUG nova.compute.manager [req-e4caa6a4-9a81-4c0a-94d0-687c1ce80025 req-54c42cca-c516-472e-bb02-a328cee1588c service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] No waiting events found dispatching network-vif-unplugged-6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:46:41 user nova-compute[71321]: WARNING nova.compute.manager [req-e4caa6a4-9a81-4c0a-94d0-687c1ce80025 req-54c42cca-c516-472e-bb02-a328cee1588c service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Received unexpected event network-vif-unplugged-6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 for instance with vm_state active and task_state resize_migrating.
Apr 12 12:46:41 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:41 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:41 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Instance destroyed successfully.
Apr 12 12:46:41 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:44:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-540928137',display_name='tempest-ServerActionsTestJSON-server-540928137',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-540928137',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9e64miZ/iyVASS4OS8AZthMPT8KBHm0byN/8NFP7U1AgI9/hOw/R+BSPozX14usgKt+VEqTE1BPs7aRGcfyuCZ/K0LBkD7enTbPYgw3NHHlO3PWScCWY1ae7IFb2uJEw==',key_name='tempest-keypair-1245622558',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:44:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7ba5375005114c8594e0ae86b2f19093',ramdisk_id='',reservation_id='r-87f60efn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1233797030',owner_user_name='tempest-ServerActionsTestJSON-1233797030-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:46:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29f7f46d32f4465ba3e8b504c645c22f',uuid=62452efb-3a12-4aff-9359-217d17fc052a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "address": "fa:16:3e:c6:61:66", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1652638760-network", "vif_mac": "fa:16:3e:c6:61:66"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea59aa7-b9", "ovs_interfaceid": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:46:41 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converting VIF {"id": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "address": "fa:16:3e:c6:61:66", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1652638760-network", "vif_mac": "fa:16:3e:c6:61:66"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea59aa7-b9", "ovs_interfaceid": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:46:41 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:61:66,bridge_name='br-int',has_traffic_filtering=True,id=6ea59aa7-b979-4fa0-b26b-cf96ad5addb2,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ea59aa7-b9') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:46:41 user nova-compute[71321]: DEBUG os_vif [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:61:66,bridge_name='br-int',has_traffic_filtering=True,id=6ea59aa7-b979-4fa0-b26b-cf96ad5addb2,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ea59aa7-b9') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:46:41 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:41 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ea59aa7-b9, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:46:41 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:41 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:46:41 user nova-compute[71321]: INFO os_vif [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:61:66,bridge_name='br-int',has_traffic_filtering=True,id=6ea59aa7-b979-4fa0-b26b-cf96ad5addb2,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ea59aa7-b9')
Apr 12 12:46:41 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:46:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utelFAnj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:46:41 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:46:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:46:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:46:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78ccffd-d298-4aee-b295-02c2bf6a7832]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:46:42 user nova-compute[71321]: No targets found.
Apr 12 12:46:42 user nova-compute[71321]: iSNS:
Apr 12 12:46:42 user nova-compute[71321]: No targets found.
Apr 12 12:46:42 user nova-compute[71321]: STATIC:
Apr 12 12:46:42 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491
Apr 12 12:46:42 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:46:42 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:46:42 user nova-compute[71321]: FIRMWARE:
Apr 12 12:46:42 user nova-compute[71321]: No targets found.
Apr 12 12:46:42 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:46:42 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:46:42 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0394632b-e845-44c7-a83e-95ae046e863d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3c1d8c-b12e-486f-9b22-3049cc63a7ff]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)
Apr 12 12:46:42 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)
Apr 12 12:46:42 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef44574f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491'): ({'sdb'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Removing single pathed devices sdb {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03780fe-89e7-4e1d-aa08-6ddc245132a1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[975d1b94-3605-4d74-af68-5ce9f0bef050]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Flushing IO for device /dev/sdb {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cff98c-60e3-403d-81b1-4bc241e870f1]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7487ce5-42f2-4b44-a709-2ec519cbd3b2]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] SCSI volumes sdb have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOb5201127-e01757ba91f7c12b', '/dev/disk/by-id/scsi-26530313735376261', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b5201127') {{(pid=81736) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[026d0992-107c-4f55-ba18-828aad0e02ae]: (4, None) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c908066a-169d-441f-a2be-44480e725e70]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f809fd-0b6e-4a3a-924e-75928fa8adb3]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491, portal: 172.16.0.220,3260]
Apr 12 12:46:42 user nova-compute[71321]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491, portal: 172.16.0.220,3260] successful.
Apr 12 12:46:42 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03968c7-91f5-4d11-ae2b-621701472991]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] <== disconnect_volume: return (368ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:46:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:46:43 user nova-compute[71321]: DEBUG nova.compute.manager [req-b9e6b6b6-381d-4079-9244-05a38fe9ecf7 req-f5934b5d-84e0-414f-bfca-4bfb919bc0b7 service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Received event network-vif-plugged-6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:46:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b9e6b6b6-381d-4079-9244-05a38fe9ecf7 req-f5934b5d-84e0-414f-bfca-4bfb919bc0b7 service nova] Acquiring lock "62452efb-3a12-4aff-9359-217d17fc052a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:46:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b9e6b6b6-381d-4079-9244-05a38fe9ecf7 req-f5934b5d-84e0-414f-bfca-4bfb919bc0b7 service nova] Lock "62452efb-3a12-4aff-9359-217d17fc052a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:46:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b9e6b6b6-381d-4079-9244-05a38fe9ecf7 req-f5934b5d-84e0-414f-bfca-4bfb919bc0b7 service nova] Lock "62452efb-3a12-4aff-9359-217d17fc052a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:46:43 user nova-compute[71321]: DEBUG nova.compute.manager [req-b9e6b6b6-381d-4079-9244-05a38fe9ecf7 req-f5934b5d-84e0-414f-bfca-4bfb919bc0b7 service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] No waiting events found dispatching network-vif-plugged-6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:46:43 user nova-compute[71321]: WARNING nova.compute.manager [req-b9e6b6b6-381d-4079-9244-05a38fe9ecf7 req-f5934b5d-84e0-414f-bfca-4bfb919bc0b7 service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Received unexpected event network-vif-plugged-6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 for instance with vm_state active and task_state resize_migrating.
Apr 12 12:46:43 user nova-compute[71321]: DEBUG nova.network.neutron [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Port 6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 binding to destination host user is already ACTIVE {{(pid=71321) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 12 12:46:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "62452efb-3a12-4aff-9359-217d17fc052a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:46:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "62452efb-3a12-4aff-9359-217d17fc052a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.005s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:46:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "62452efb-3a12-4aff-9359-217d17fc052a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.004s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:46:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "refresh_cache-62452efb-3a12-4aff-9359-217d17fc052a" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:46:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquired lock "refresh_cache-62452efb-3a12-4aff-9359-217d17fc052a" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:46:43 user nova-compute[71321]: DEBUG nova.network.neutron [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:46:44 user nova-compute[71321]: DEBUG nova.network.neutron [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Updating instance_info_cache with network_info: [{"id": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "address": "fa:16:3e:c6:61:66", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea59aa7-b9", "ovs_interfaceid": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:46:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Releasing lock "refresh_cache-62452efb-3a12-4aff-9359-217d17fc052a" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:46:44 user nova-compute[71321]: DEBUG os_brick.utils [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:46:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8ae083-07ca-4399-9833-9a9580782d90]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:46:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[28162be5-fce0-4192-a1c3-76eb2ded71bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:46:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[39dfdf15-13af-4297-8f99-1aa16df6f430]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:46:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4b1217-2efb-426e-b1cf-f0c822fc6603]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:46:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:46:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:46:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:44 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:46:44 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:46:44 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff3ebe1-6b3c-4ed6-a07d-963b180695f6]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:46:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:46:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:46:44 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:46:44 user nova-compute[71321]: DEBUG os_brick.utils [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:46:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Starting finish_migration {{(pid=71321) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Instance directory exists: not creating {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 12:46:49 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Creating image(s)
Apr 12 12:46:49 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Did not create local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Ensure instance console log exists: /opt/stack/data/nova/instances/62452efb-3a12-4aff-9359-217d17fc052a/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Start _get_guest_xml network_info=[{"id": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "address": "fa:16:3e:c6:61:66", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1652638760-network", "vif_mac": "fa:16:3e:c6:61:66"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea59aa7-b9", "ovs_interfaceid": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '37a71d36-2c25-40ee-b99e-51eb6d3c9bab', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utelFAnj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '62452efb-3a12-4aff-9359-217d17fc052a', 'attached_at': '2023-04-12T12:46:49.000000', 'detached_at': '', 'volume_id': '3f8c0fb4-a50b-4195-ba6a-8e98f3360491', 'serial': '3f8c0fb4-a50b-4195-ba6a-8e98f3360491'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:46:49 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:46:49 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:46:49 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG nova.objects.instance [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lazy-loading 'vcpu_model' on Instance uuid 62452efb-3a12-4aff-9359-217d17fc052a {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utelFAnj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:46:49 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:46:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:46:49 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:46:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:46:49 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0edcb0-023d-4d4e-902d-50fbbb9a99d7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:46:49 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f2ddce-6556-4b8a-8075-f1bd46c352f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491] added
Apr 12 12:46:49 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.060s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79c6f5a-abd5-4595-afcd-e4de5eaaf0be]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8338a71c-03d5-4096-86e6-78d0743f1a56]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v utelFAnj {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v utelFAnj" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9020e47e-4204-4c3e-883c-e993234dfd6f]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'utelFAnj'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9470dd-e33e-4a36-abe4-03d8bd9186d2]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d01ec8-5fbd-4b1d-b62d-7bcae46c1e81]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 12:46:49 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 12:46:49 user nova-compute[71321]:  {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:46:49 user nova-compute[71321]: WARNING os_brick.initiator.connectors.iscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 12:46:49 user nova-compute[71321]: 
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[28622d42-700f-448d-9a73-c25ae21a655a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491, portal: 172.16.0.220,3260]
Apr 12 12:46:49 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491, portal: 172.16.0.220,3260] successful.
Apr 12 12:46:49 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9533a830-516c-4248-a8c6-add575495978]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[49415f9a-b56f-4e55-8f8a-567f549d74a8]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)
Apr 12 12:46:49 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)
Apr 12 12:46:49 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fe63ef-fd78-4c76-8735-8e1f454bf630]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:46:49 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utelFAnj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:46:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:50 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:46:50 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '26530313735376261', 'path': '/dev/sdb'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:46:50 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530313735376261', 'path': '/dev/sdb'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:46:50 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:44:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-540928137',display_name='tempest-ServerActionsTestJSON-server-540928137',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-540928137',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9e64miZ/iyVASS4OS8AZthMPT8KBHm0byN/8NFP7U1AgI9/hOw/R+BSPozX14usgKt+VEqTE1BPs7aRGcfyuCZ/K0LBkD7enTbPYgw3NHHlO3PWScCWY1ae7IFb2uJEw==',key_name='tempest-keypair-1245622558',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:44:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7ba5375005114c8594e0ae86b2f19093',ramdisk_id='',reservation_id='r-87f60efn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1233797030',owner_user_name='tempest-ServerActionsTestJSON-1233797030-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:46:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29f7f46d32f4465ba3e8b504c645c22f',uuid=62452efb-3a12-4aff-9359-217d17fc052a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "address": "fa:16:3e:c6:61:66", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1652638760-network", "vif_mac": "fa:16:3e:c6:61:66"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea59aa7-b9", "ovs_interfaceid": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:46:50 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converting VIF {"id": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "address": "fa:16:3e:c6:61:66", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1652638760-network", "vif_mac": "fa:16:3e:c6:61:66"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea59aa7-b9", "ovs_interfaceid": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:46:50 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:61:66,bridge_name='br-int',has_traffic_filtering=True,id=6ea59aa7-b979-4fa0-b26b-cf96ad5addb2,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ea59aa7-b9') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:46:50 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:46:50 user nova-compute[71321]:   <uuid>62452efb-3a12-4aff-9359-217d17fc052a</uuid>
Apr 12 12:46:50 user nova-compute[71321]:   <name>instance-0000001f</name>
Apr 12 12:46:50 user nova-compute[71321]:   <memory>196608</memory>
Apr 12 12:46:50 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:46:50 user nova-compute[71321]:   <metadata>
Apr 12 12:46:50 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:46:50 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:46:50 user nova-compute[71321]:       <nova:name>tempest-ServerActionsTestJSON-server-540928137</nova:name>
Apr 12 12:46:50 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:46:49</nova:creationTime>
Apr 12 12:46:50 user nova-compute[71321]:       <nova:flavor name="m1.micro">
Apr 12 12:46:50 user nova-compute[71321]:         <nova:memory>192</nova:memory>
Apr 12 12:46:50 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:46:50 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:46:50 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:46:50 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:46:50 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:46:50 user nova-compute[71321]:       <nova:owner>
Apr 12 12:46:50 user nova-compute[71321]:         <nova:user uuid="29f7f46d32f4465ba3e8b504c645c22f">tempest-ServerActionsTestJSON-1233797030-project-member</nova:user>
Apr 12 12:46:50 user nova-compute[71321]:         <nova:project uuid="7ba5375005114c8594e0ae86b2f19093">tempest-ServerActionsTestJSON-1233797030</nova:project>
Apr 12 12:46:50 user nova-compute[71321]:       </nova:owner>
Apr 12 12:46:50 user nova-compute[71321]:       <nova:ports>
Apr 12 12:46:50 user nova-compute[71321]:         <nova:port uuid="6ea59aa7-b979-4fa0-b26b-cf96ad5addb2">
Apr 12 12:46:50 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 12:46:50 user nova-compute[71321]:         </nova:port>
Apr 12 12:46:50 user nova-compute[71321]:       </nova:ports>
Apr 12 12:46:50 user nova-compute[71321]:     </nova:instance>
Apr 12 12:46:50 user nova-compute[71321]:   </metadata>
Apr 12 12:46:50 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:46:50 user nova-compute[71321]:     <system>
Apr 12 12:46:50 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:46:50 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:46:50 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:46:50 user nova-compute[71321]:       <entry name="serial">62452efb-3a12-4aff-9359-217d17fc052a</entry>
Apr 12 12:46:50 user nova-compute[71321]:       <entry name="uuid">62452efb-3a12-4aff-9359-217d17fc052a</entry>
Apr 12 12:46:50 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:46:50 user nova-compute[71321]:     </system>
Apr 12 12:46:50 user nova-compute[71321]:   </sysinfo>
Apr 12 12:46:50 user nova-compute[71321]:   <os>
Apr 12 12:46:50 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:46:50 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:46:50 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:46:50 user nova-compute[71321]:   </os>
Apr 12 12:46:50 user nova-compute[71321]:   <features>
Apr 12 12:46:50 user nova-compute[71321]:     <acpi/>
Apr 12 12:46:50 user nova-compute[71321]:     <apic/>
Apr 12 12:46:50 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:46:50 user nova-compute[71321]:   </features>
Apr 12 12:46:50 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:46:50 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:46:50 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:46:50 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:46:50 user nova-compute[71321]:   </clock>
Apr 12 12:46:50 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:46:50 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:46:50 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:46:50 user nova-compute[71321]:   </cpu>
Apr 12 12:46:50 user nova-compute[71321]:   <devices>
Apr 12 12:46:50 user nova-compute[71321]:     <disk type="block" device="disk">
Apr 12 12:46:50 user nova-compute[71321]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:46:50 user nova-compute[71321]:       <source dev="/dev/sdb"/>
Apr 12 12:46:50 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:46:50 user nova-compute[71321]:       <serial>3f8c0fb4-a50b-4195-ba6a-8e98f3360491</serial>
Apr 12 12:46:50 user nova-compute[71321]:     </disk>
Apr 12 12:46:50 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:46:50 user nova-compute[71321]:       <mac address="fa:16:3e:c6:61:66"/>
Apr 12 12:46:50 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:46:50 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:46:50 user nova-compute[71321]:       <target dev="tap6ea59aa7-b9"/>
Apr 12 12:46:50 user nova-compute[71321]:     </interface>
Apr 12 12:46:50 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:46:50 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/62452efb-3a12-4aff-9359-217d17fc052a/console.log" append="off"/>
Apr 12 12:46:50 user nova-compute[71321]:     </serial>
Apr 12 12:46:50 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:46:50 user nova-compute[71321]:     <video>
Apr 12 12:46:50 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:46:50 user nova-compute[71321]:     </video>
Apr 12 12:46:50 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:46:50 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:46:50 user nova-compute[71321]:     </rng>
Apr 12 12:46:50 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:46:50 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:46:50 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:46:50 user nova-compute[71321]:     </memballoon>
Apr 12 12:46:50 user nova-compute[71321]:   </devices>
Apr 12 12:46:50 user nova-compute[71321]: </domain>
Apr 12 12:46:50 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:46:50 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:44:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-540928137',display_name='tempest-ServerActionsTestJSON-server-540928137',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-540928137',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9e64miZ/iyVASS4OS8AZthMPT8KBHm0byN/8NFP7U1AgI9/hOw/R+BSPozX14usgKt+VEqTE1BPs7aRGcfyuCZ/K0LBkD7enTbPYgw3NHHlO3PWScCWY1ae7IFb2uJEw==',key_name='tempest-keypair-1245622558',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:44:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7ba5375005114c8594e0ae86b2f19093',ramdisk_id='',reservation_id='r-87f60efn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1233797030',owner_user_name='tempest-ServerActionsTestJSON-1233797030-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:46:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29f7f46d32f4465ba3e8b504c645c22f',uuid=62452efb-3a12-4aff-9359-217d17fc052a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "address": "fa:16:3e:c6:61:66", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1652638760-network", "vif_mac": "fa:16:3e:c6:61:66"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea59aa7-b9", "ovs_interfaceid": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:46:50 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converting VIF {"id": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "address": "fa:16:3e:c6:61:66", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1652638760-network", "vif_mac": "fa:16:3e:c6:61:66"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea59aa7-b9", "ovs_interfaceid": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:46:50 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:61:66,bridge_name='br-int',has_traffic_filtering=True,id=6ea59aa7-b979-4fa0-b26b-cf96ad5addb2,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ea59aa7-b9') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:46:50 user nova-compute[71321]: DEBUG os_vif [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:61:66,bridge_name='br-int',has_traffic_filtering=True,id=6ea59aa7-b979-4fa0-b26b-cf96ad5addb2,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ea59aa7-b9') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:46:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:46:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:46:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ea59aa7-b9, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:46:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6ea59aa7-b9, col_values=(('external_ids', {'iface-id': '6ea59aa7-b979-4fa0-b26b-cf96ad5addb2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:61:66', 'vm-uuid': '62452efb-3a12-4aff-9359-217d17fc052a'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:46:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:46:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:50 user nova-compute[71321]: INFO os_vif [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:61:66,bridge_name='br-int',has_traffic_filtering=True,id=6ea59aa7-b979-4fa0-b26b-cf96ad5addb2,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ea59aa7-b9')
Apr 12 12:46:50 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:46:50 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] No VIF found with MAC fa:16:3e:c6:61:66, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:46:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:52 user nova-compute[71321]: DEBUG nova.compute.manager [req-70df182f-6f9a-4a42-b13b-69cf29f31506 req-fc9595ef-d6b4-4f58-b8e8-830f20133f96 service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Received event network-vif-plugged-6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:46:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-70df182f-6f9a-4a42-b13b-69cf29f31506 req-fc9595ef-d6b4-4f58-b8e8-830f20133f96 service nova] Acquiring lock "62452efb-3a12-4aff-9359-217d17fc052a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:46:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-70df182f-6f9a-4a42-b13b-69cf29f31506 req-fc9595ef-d6b4-4f58-b8e8-830f20133f96 service nova] Lock "62452efb-3a12-4aff-9359-217d17fc052a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:46:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-70df182f-6f9a-4a42-b13b-69cf29f31506 req-fc9595ef-d6b4-4f58-b8e8-830f20133f96 service nova] Lock "62452efb-3a12-4aff-9359-217d17fc052a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:46:52 user nova-compute[71321]: DEBUG nova.compute.manager [req-70df182f-6f9a-4a42-b13b-69cf29f31506 req-fc9595ef-d6b4-4f58-b8e8-830f20133f96 service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] No waiting events found dispatching network-vif-plugged-6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:46:52 user nova-compute[71321]: WARNING nova.compute.manager [req-70df182f-6f9a-4a42-b13b-69cf29f31506 req-fc9595ef-d6b4-4f58-b8e8-830f20133f96 service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Received unexpected event network-vif-plugged-6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 for instance with vm_state active and task_state resize_finish.
Apr 12 12:46:54 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Removed pending event for 62452efb-3a12-4aff-9359-217d17fc052a due to event {{(pid=71321) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 12:46:54 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303614.1043582, 62452efb-3a12-4aff-9359-217d17fc052a => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:46:54 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] VM Resumed (Lifecycle Event)
Apr 12 12:46:54 user nova-compute[71321]: DEBUG nova.compute.manager [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:46:54 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Instance running successfully.
Apr 12 12:46:54 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Failed to set time: agent not configured {{(pid=71321) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 12 12:46:54 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] finish_migration finished successfully. {{(pid=71321) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 12 12:46:54 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:46:54 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:46:54 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 12 12:46:54 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303614.1099901, 62452efb-3a12-4aff-9359-217d17fc052a => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:46:54 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] VM Started (Lifecycle Event)
Apr 12 12:46:54 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:46:54 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:46:54 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 12 12:46:54 user nova-compute[71321]: DEBUG nova.compute.manager [req-d5809e9e-b155-47ee-a14f-5103abf069e6 req-df7d544a-5175-4347-b523-fdbf2199ee1b service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Received event network-vif-plugged-6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:46:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d5809e9e-b155-47ee-a14f-5103abf069e6 req-df7d544a-5175-4347-b523-fdbf2199ee1b service nova] Acquiring lock "62452efb-3a12-4aff-9359-217d17fc052a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:46:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d5809e9e-b155-47ee-a14f-5103abf069e6 req-df7d544a-5175-4347-b523-fdbf2199ee1b service nova] Lock "62452efb-3a12-4aff-9359-217d17fc052a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:46:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d5809e9e-b155-47ee-a14f-5103abf069e6 req-df7d544a-5175-4347-b523-fdbf2199ee1b service nova] Lock "62452efb-3a12-4aff-9359-217d17fc052a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:46:54 user nova-compute[71321]: DEBUG nova.compute.manager [req-d5809e9e-b155-47ee-a14f-5103abf069e6 req-df7d544a-5175-4347-b523-fdbf2199ee1b service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] No waiting events found dispatching network-vif-plugged-6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:46:54 user nova-compute[71321]: WARNING nova.compute.manager [req-d5809e9e-b155-47ee-a14f-5103abf069e6 req-df7d544a-5175-4347-b523-fdbf2199ee1b service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Received unexpected event network-vif-plugged-6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 for instance with vm_state active and task_state resize_finish.
Apr 12 12:46:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "db9f1454-9e3c-40d4-849b-c13537d6be97" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:46:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:46:54 user nova-compute[71321]: DEBUG nova.compute.manager [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:46:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:46:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:46:54 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:46:54 user nova-compute[71321]: INFO nova.compute.claims [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Claim successful on node user
Apr 12 12:46:55 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:46:55 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:46:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:46:55 user nova-compute[71321]: DEBUG nova.compute.manager [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:46:55 user nova-compute[71321]: DEBUG nova.compute.manager [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:46:55 user nova-compute[71321]: DEBUG nova.network.neutron [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:46:55 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:46:55 user nova-compute[71321]: DEBUG nova.compute.manager [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:46:55 user nova-compute[71321]: DEBUG nova.policy [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8a9c54033c7547c2bae91e6c1dba0976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e6aaaa9a634f349d371f7c6c15eca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:46:55 user nova-compute[71321]: DEBUG nova.compute.manager [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:46:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:46:55 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Creating image(s)
Apr 12 12:46:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "/opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:46:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "/opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:46:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "/opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:46:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.137s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:46:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:46:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.138s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk 1073741824" returned: 0 in 0.051s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:46:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.139s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:55 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:46:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:46:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:46:55 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Cannot resize image /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:46:55 user nova-compute[71321]: DEBUG nova.objects.instance [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'migration_context' on Instance uuid db9f1454-9e3c-40d4-849b-c13537d6be97 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:46:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:46:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Ensure instance console log exists: /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:46:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:46:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:46:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:46:56 user nova-compute[71321]: DEBUG nova.network.neutron [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Successfully created port: 9c30bdfa-5f39-4454-af8b-f2ccd880807b {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:46:56 user nova-compute[71321]: DEBUG nova.network.neutron [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Successfully updated port: 9c30bdfa-5f39-4454-af8b-f2ccd880807b {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:46:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "refresh_cache-db9f1454-9e3c-40d4-849b-c13537d6be97" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:46:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquired lock "refresh_cache-db9f1454-9e3c-40d4-849b-c13537d6be97" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:46:56 user nova-compute[71321]: DEBUG nova.network.neutron [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:46:56 user nova-compute[71321]: DEBUG nova.compute.manager [req-efca2f51-3257-4290-bd20-18178aa6002d req-43076fd9-f2a6-4cf4-afdb-a4683670af54 service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Received event network-changed-9c30bdfa-5f39-4454-af8b-f2ccd880807b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:46:56 user nova-compute[71321]: DEBUG nova.compute.manager [req-efca2f51-3257-4290-bd20-18178aa6002d req-43076fd9-f2a6-4cf4-afdb-a4683670af54 service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Refreshing instance network info cache due to event network-changed-9c30bdfa-5f39-4454-af8b-f2ccd880807b. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:46:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-efca2f51-3257-4290-bd20-18178aa6002d req-43076fd9-f2a6-4cf4-afdb-a4683670af54 service nova] Acquiring lock "refresh_cache-db9f1454-9e3c-40d4-849b-c13537d6be97" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:46:56 user nova-compute[71321]: DEBUG nova.network.neutron [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG nova.network.neutron [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Updating instance_info_cache with network_info: [{"id": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "address": "fa:16:3e:c8:2c:e7", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30bdfa-5f", "ovs_interfaceid": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Releasing lock "refresh_cache-db9f1454-9e3c-40d4-849b-c13537d6be97" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG nova.compute.manager [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Instance network_info: |[{"id": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "address": "fa:16:3e:c8:2c:e7", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30bdfa-5f", "ovs_interfaceid": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-efca2f51-3257-4290-bd20-18178aa6002d req-43076fd9-f2a6-4cf4-afdb-a4683670af54 service nova] Acquired lock "refresh_cache-db9f1454-9e3c-40d4-849b-c13537d6be97" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG nova.network.neutron [req-efca2f51-3257-4290-bd20-18178aa6002d req-43076fd9-f2a6-4cf4-afdb-a4683670af54 service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Refreshing network info cache for port 9c30bdfa-5f39-4454-af8b-f2ccd880807b {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Start _get_guest_xml network_info=[{"id": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "address": "fa:16:3e:c8:2c:e7", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30bdfa-5f", "ovs_interfaceid": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:46:57 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:46:57 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:46:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:46:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1788527008',display_name='tempest-AttachVolumeTestJSON-server-1788527008',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1788527008',id=34,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuwf936taYEtQ87HL5K7RLSYNC7EYwzjJGVWMdDWY17MG7jKDK8n6UiYp0Wx2O8W7vbPN1WZy4g++M2EnVpaeEZHV1BaHycanzlOj8OAfSm/y0qUI9XhqdtXcmqo6mDGg==',key_name='tempest-keypair-1238241126',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0e6aaaa9a634f349d371f7c6c15eca2',ramdisk_id='',reservation_id='r-mamvz059',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-905742219',owner_user_name='tempest-AttachVolumeTestJSON-905742219-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:46:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a9c54033c7547c2bae91e6c1dba0976',uuid=db9f1454-9e3c-40d4-849b-c13537d6be97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "address": "fa:16:3e:c8:2c:e7", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30bdfa-5f", "ovs_interfaceid": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Converting VIF {"id": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "address": "fa:16:3e:c8:2c:e7", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30bdfa-5f", "ovs_interfaceid": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:2c:e7,bridge_name='br-int',has_traffic_filtering=True,id=9c30bdfa-5f39-4454-af8b-f2ccd880807b,network=Network(e1afe3b3-a919-4800-9f1c-c8e602defd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c30bdfa-5f') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG nova.objects.instance [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'pci_devices' on Instance uuid db9f1454-9e3c-40d4-849b-c13537d6be97 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:46:57 user nova-compute[71321]:   <uuid>db9f1454-9e3c-40d4-849b-c13537d6be97</uuid>
Apr 12 12:46:57 user nova-compute[71321]:   <name>instance-00000022</name>
Apr 12 12:46:57 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:46:57 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:46:57 user nova-compute[71321]:   <metadata>
Apr 12 12:46:57 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:46:57 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:46:57 user nova-compute[71321]:       <nova:name>tempest-AttachVolumeTestJSON-server-1788527008</nova:name>
Apr 12 12:46:57 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:46:57</nova:creationTime>
Apr 12 12:46:57 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:46:57 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:46:57 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:46:57 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:46:57 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:46:57 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:46:57 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:46:57 user nova-compute[71321]:       <nova:owner>
Apr 12 12:46:57 user nova-compute[71321]:         <nova:user uuid="8a9c54033c7547c2bae91e6c1dba0976">tempest-AttachVolumeTestJSON-905742219-project-member</nova:user>
Apr 12 12:46:57 user nova-compute[71321]:         <nova:project uuid="a0e6aaaa9a634f349d371f7c6c15eca2">tempest-AttachVolumeTestJSON-905742219</nova:project>
Apr 12 12:46:57 user nova-compute[71321]:       </nova:owner>
Apr 12 12:46:57 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:46:57 user nova-compute[71321]:       <nova:ports>
Apr 12 12:46:57 user nova-compute[71321]:         <nova:port uuid="9c30bdfa-5f39-4454-af8b-f2ccd880807b">
Apr 12 12:46:57 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 12:46:57 user nova-compute[71321]:         </nova:port>
Apr 12 12:46:57 user nova-compute[71321]:       </nova:ports>
Apr 12 12:46:57 user nova-compute[71321]:     </nova:instance>
Apr 12 12:46:57 user nova-compute[71321]:   </metadata>
Apr 12 12:46:57 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:46:57 user nova-compute[71321]:     <system>
Apr 12 12:46:57 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:46:57 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:46:57 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:46:57 user nova-compute[71321]:       <entry name="serial">db9f1454-9e3c-40d4-849b-c13537d6be97</entry>
Apr 12 12:46:57 user nova-compute[71321]:       <entry name="uuid">db9f1454-9e3c-40d4-849b-c13537d6be97</entry>
Apr 12 12:46:57 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:46:57 user nova-compute[71321]:     </system>
Apr 12 12:46:57 user nova-compute[71321]:   </sysinfo>
Apr 12 12:46:57 user nova-compute[71321]:   <os>
Apr 12 12:46:57 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:46:57 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:46:57 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:46:57 user nova-compute[71321]:   </os>
Apr 12 12:46:57 user nova-compute[71321]:   <features>
Apr 12 12:46:57 user nova-compute[71321]:     <acpi/>
Apr 12 12:46:57 user nova-compute[71321]:     <apic/>
Apr 12 12:46:57 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:46:57 user nova-compute[71321]:   </features>
Apr 12 12:46:57 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:46:57 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:46:57 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:46:57 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:46:57 user nova-compute[71321]:   </clock>
Apr 12 12:46:57 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:46:57 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:46:57 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:46:57 user nova-compute[71321]:   </cpu>
Apr 12 12:46:57 user nova-compute[71321]:   <devices>
Apr 12 12:46:57 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:46:57 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:46:57 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk"/>
Apr 12 12:46:57 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:46:57 user nova-compute[71321]:     </disk>
Apr 12 12:46:57 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:46:57 user nova-compute[71321]:       <mac address="fa:16:3e:c8:2c:e7"/>
Apr 12 12:46:57 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:46:57 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:46:57 user nova-compute[71321]:       <target dev="tap9c30bdfa-5f"/>
Apr 12 12:46:57 user nova-compute[71321]:     </interface>
Apr 12 12:46:57 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:46:57 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/console.log" append="off"/>
Apr 12 12:46:57 user nova-compute[71321]:     </serial>
Apr 12 12:46:57 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:46:57 user nova-compute[71321]:     <video>
Apr 12 12:46:57 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:46:57 user nova-compute[71321]:     </video>
Apr 12 12:46:57 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:46:57 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:46:57 user nova-compute[71321]:     </rng>
Apr 12 12:46:57 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:46:57 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:46:57 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:46:57 user nova-compute[71321]:     </memballoon>
Apr 12 12:46:57 user nova-compute[71321]:   </devices>
Apr 12 12:46:57 user nova-compute[71321]: </domain>
Apr 12 12:46:57 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:46:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1788527008',display_name='tempest-AttachVolumeTestJSON-server-1788527008',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1788527008',id=34,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuwf936taYEtQ87HL5K7RLSYNC7EYwzjJGVWMdDWY17MG7jKDK8n6UiYp0Wx2O8W7vbPN1WZy4g++M2EnVpaeEZHV1BaHycanzlOj8OAfSm/y0qUI9XhqdtXcmqo6mDGg==',key_name='tempest-keypair-1238241126',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0e6aaaa9a634f349d371f7c6c15eca2',ramdisk_id='',reservation_id='r-mamvz059',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-905742219',owner_user_name='tempest-AttachVolumeTestJSON-905742219-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:46:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a9c54033c7547c2bae91e6c1dba0976',uuid=db9f1454-9e3c-40d4-849b-c13537d6be97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "address": "fa:16:3e:c8:2c:e7", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30bdfa-5f", "ovs_interfaceid": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Converting VIF {"id": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "address": "fa:16:3e:c8:2c:e7", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30bdfa-5f", "ovs_interfaceid": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:2c:e7,bridge_name='br-int',has_traffic_filtering=True,id=9c30bdfa-5f39-4454-af8b-f2ccd880807b,network=Network(e1afe3b3-a919-4800-9f1c-c8e602defd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c30bdfa-5f') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG os_vif [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:2c:e7,bridge_name='br-int',has_traffic_filtering=True,id=9c30bdfa-5f39-4454-af8b-f2ccd880807b,network=Network(e1afe3b3-a919-4800-9f1c-c8e602defd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c30bdfa-5f') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c30bdfa-5f, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9c30bdfa-5f, col_values=(('external_ids', {'iface-id': '9c30bdfa-5f39-4454-af8b-f2ccd880807b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:2c:e7', 'vm-uuid': 'db9f1454-9e3c-40d4-849b-c13537d6be97'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:57 user nova-compute[71321]: INFO os_vif [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:2c:e7,bridge_name='br-int',has_traffic_filtering=True,id=9c30bdfa-5f39-4454-af8b-f2ccd880807b,network=Network(e1afe3b3-a919-4800-9f1c-c8e602defd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c30bdfa-5f')
Apr 12 12:46:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] No VIF found with MAC fa:16:3e:c8:2c:e7, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG nova.network.neutron [req-efca2f51-3257-4290-bd20-18178aa6002d req-43076fd9-f2a6-4cf4-afdb-a4683670af54 service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Updated VIF entry in instance network info cache for port 9c30bdfa-5f39-4454-af8b-f2ccd880807b. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG nova.network.neutron [req-efca2f51-3257-4290-bd20-18178aa6002d req-43076fd9-f2a6-4cf4-afdb-a4683670af54 service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Updating instance_info_cache with network_info: [{"id": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "address": "fa:16:3e:c8:2c:e7", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30bdfa-5f", "ovs_interfaceid": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:46:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-efca2f51-3257-4290-bd20-18178aa6002d req-43076fd9-f2a6-4cf4-afdb-a4683670af54 service nova] Releasing lock "refresh_cache-db9f1454-9e3c-40d4-849b-c13537d6be97" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:46:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:59 user nova-compute[71321]: DEBUG nova.compute.manager [req-9fe9578c-e2a7-4c07-bc58-06e66aff3ca9 req-6ed8a23d-5c38-426c-bf6a-4c2b62bc26ef service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Received event network-vif-plugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:46:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9fe9578c-e2a7-4c07-bc58-06e66aff3ca9 req-6ed8a23d-5c38-426c-bf6a-4c2b62bc26ef service nova] Acquiring lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:46:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9fe9578c-e2a7-4c07-bc58-06e66aff3ca9 req-6ed8a23d-5c38-426c-bf6a-4c2b62bc26ef service nova] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:46:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9fe9578c-e2a7-4c07-bc58-06e66aff3ca9 req-6ed8a23d-5c38-426c-bf6a-4c2b62bc26ef service nova] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:46:59 user nova-compute[71321]: DEBUG nova.compute.manager [req-9fe9578c-e2a7-4c07-bc58-06e66aff3ca9 req-6ed8a23d-5c38-426c-bf6a-4c2b62bc26ef service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] No waiting events found dispatching network-vif-plugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:46:59 user nova-compute[71321]: WARNING nova.compute.manager [req-9fe9578c-e2a7-4c07-bc58-06e66aff3ca9 req-6ed8a23d-5c38-426c-bf6a-4c2b62bc26ef service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Received unexpected event network-vif-plugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b for instance with vm_state building and task_state spawning.
Apr 12 12:46:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:46:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:47:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:47:01 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303621.1040456, db9f1454-9e3c-40d4-849b-c13537d6be97 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:47:01 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] VM Resumed (Lifecycle Event)
Apr 12 12:47:01 user nova-compute[71321]: DEBUG nova.compute.manager [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:47:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:47:01 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Instance spawned successfully.
Apr 12 12:47:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:47:01 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:47:01 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:47:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:47:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:47:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:47:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:47:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:47:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:47:01 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:47:01 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303621.1088748, db9f1454-9e3c-40d4-849b-c13537d6be97 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:47:01 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] VM Started (Lifecycle Event)
Apr 12 12:47:01 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:47:01 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:47:01 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:47:01 user nova-compute[71321]: INFO nova.compute.manager [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Took 5.96 seconds to spawn the instance on the hypervisor.
Apr 12 12:47:01 user nova-compute[71321]: DEBUG nova.compute.manager [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:47:01 user nova-compute[71321]: DEBUG nova.compute.manager [req-6782a4db-4714-4f69-8eb5-6a09d2ce471b req-02c96b6f-a857-4713-99c6-098e96842da5 service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Received event network-vif-plugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:47:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-6782a4db-4714-4f69-8eb5-6a09d2ce471b req-02c96b6f-a857-4713-99c6-098e96842da5 service nova] Acquiring lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:47:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-6782a4db-4714-4f69-8eb5-6a09d2ce471b req-02c96b6f-a857-4713-99c6-098e96842da5 service nova] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:47:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-6782a4db-4714-4f69-8eb5-6a09d2ce471b req-02c96b6f-a857-4713-99c6-098e96842da5 service nova] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:47:01 user nova-compute[71321]: DEBUG nova.compute.manager [req-6782a4db-4714-4f69-8eb5-6a09d2ce471b req-02c96b6f-a857-4713-99c6-098e96842da5 service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] No waiting events found dispatching network-vif-plugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:47:01 user nova-compute[71321]: WARNING nova.compute.manager [req-6782a4db-4714-4f69-8eb5-6a09d2ce471b req-02c96b6f-a857-4713-99c6-098e96842da5 service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Received unexpected event network-vif-plugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b for instance with vm_state building and task_state spawning.
Apr 12 12:47:01 user nova-compute[71321]: INFO nova.compute.manager [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Took 6.65 seconds to build instance.
Apr 12 12:47:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.749s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:47:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:47:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:47:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:47:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:47:12 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:47:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:47:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:47:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:47:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:47:25 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:47:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:47:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:47:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:47:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:47:25 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:47:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:47:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:47:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:47:25 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:47:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e702924c-a079-4744-a112-985304a861ea/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:47:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e702924c-a079-4744-a112-985304a861ea/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:47:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e702924c-a079-4744-a112-985304a861ea/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:47:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e702924c-a079-4744-a112-985304a861ea/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:47:26 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:47:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:47:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:47:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:47:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:47:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:47:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:47:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:47:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:47:27 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:47:27 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:47:27 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8270MB free_disk=26.411190032958984GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:47:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:47:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:47:27 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Applying migration context for instance 62452efb-3a12-4aff-9359-217d17fc052a as it has an incoming, in-progress migration 1690aedb-b803-4256-a452-934af08125fb. Migration status is finished {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 12 12:47:27 user nova-compute[71321]: INFO nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Updating resource usage from migration 1690aedb-b803-4256-a452-934af08125fb
Apr 12 12:47:27 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:47:27 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:47:27 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance e702924c-a079-4744-a112-985304a861ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:47:27 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Migration 1690aedb-b803-4256-a452-934af08125fb is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 12 12:47:27 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 62452efb-3a12-4aff-9359-217d17fc052a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:47:27 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance db9f1454-9e3c-40d4-849b-c13537d6be97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:47:27 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:47:27 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=1344MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:47:27 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:47:27 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:47:27 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:47:27 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:47:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.344s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:47:28 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:47:28 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:47:28 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:47:28 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:47:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:47:31 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:47:31 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:47:31 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:47:32 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:47:35 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:47:35 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:47:35 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Didn't find any instances for network info cache update. {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 12:47:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:47:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:47:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 12:47:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 12:47:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 12:47:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:47:40 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:47:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:47:42 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:47:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:47:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:47:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:47:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:47:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:47:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:47:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 12:47:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 12:47:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 12:47:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:01 user nova-compute[71321]: DEBUG nova.compute.manager [req-68069c5e-8460-4dcb-b7c6-b8ef2722192e req-a62afb58-5b82-4c6e-96c1-e8cec516d441 service nova] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Received event network-changed-968b45e2-1ead-4fdd-a879-52ebb15f5b6a {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:48:01 user nova-compute[71321]: DEBUG nova.compute.manager [req-68069c5e-8460-4dcb-b7c6-b8ef2722192e req-a62afb58-5b82-4c6e-96c1-e8cec516d441 service nova] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Refreshing instance network info cache due to event network-changed-968b45e2-1ead-4fdd-a879-52ebb15f5b6a. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:48:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-68069c5e-8460-4dcb-b7c6-b8ef2722192e req-a62afb58-5b82-4c6e-96c1-e8cec516d441 service nova] Acquiring lock "refresh_cache-9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:48:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-68069c5e-8460-4dcb-b7c6-b8ef2722192e req-a62afb58-5b82-4c6e-96c1-e8cec516d441 service nova] Acquired lock "refresh_cache-9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:48:01 user nova-compute[71321]: DEBUG nova.network.neutron [req-68069c5e-8460-4dcb-b7c6-b8ef2722192e req-a62afb58-5b82-4c6e-96c1-e8cec516d441 service nova] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Refreshing network info cache for port 968b45e2-1ead-4fdd-a879-52ebb15f5b6a {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:48:02 user nova-compute[71321]: DEBUG nova.network.neutron [req-68069c5e-8460-4dcb-b7c6-b8ef2722192e req-a62afb58-5b82-4c6e-96c1-e8cec516d441 service nova] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Updated VIF entry in instance network info cache for port 968b45e2-1ead-4fdd-a879-52ebb15f5b6a. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:48:02 user nova-compute[71321]: DEBUG nova.network.neutron [req-68069c5e-8460-4dcb-b7c6-b8ef2722192e req-a62afb58-5b82-4c6e-96c1-e8cec516d441 service nova] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Updating instance_info_cache with network_info: [{"id": "968b45e2-1ead-4fdd-a879-52ebb15f5b6a", "address": "fa:16:3e:d7:03:df", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap968b45e2-1e", "ovs_interfaceid": "968b45e2-1ead-4fdd-a879-52ebb15f5b6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:48:02 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-68069c5e-8460-4dcb-b7c6-b8ef2722192e req-a62afb58-5b82-4c6e-96c1-e8cec516d441 service nova] Releasing lock "refresh_cache-9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:48:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:48:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 12:48:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 12:48:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 12:48:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:48:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:48:03 user nova-compute[71321]: DEBUG nova.objects.instance [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lazy-loading 'flavor' on Instance uuid 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:48:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:48:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:48:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:48:03 user nova-compute[71321]: INFO nova.compute.manager [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Attaching volume 641c3b5e-f9ca-48ab-8b0c-cb013f333010 to /dev/vdb
Apr 12 12:48:03 user nova-compute[71321]: DEBUG os_brick.utils [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:48:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6eb238-8f48-49c0-a09b-4eb2a76480a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:48:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[56efc893-3c0c-4c7a-b66c-1b9396449677]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:48:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9911005-693a-4d73-8aa4-b9c721d68e9c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:48:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc87baf-23d8-4bbb-9ef0-c93382aaa9d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:48:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:48:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:48:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:48:03 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:48:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[600611e3-536b-4972-8258-98bc3a492ca9]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:48:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:48:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:48:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:48:03 user nova-compute[71321]: DEBUG os_brick.utils [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:48:03 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Updating existing volume attachment record: d94fd97e-dc7b-463d-b024-cbe30817428d {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:48:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xiBfQJFu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:48:07 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:48:07 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:48:07 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:48:07 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:48:07 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:48:07 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9c1d3a-de1d-4b92-a68d-4709e03a9846]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:48:07 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b338f60-004b-46e9-8460-1c4c0d42fe43]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010] added
Apr 12 12:48:07 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09e55c0-061b-43b5-af33-686f53664354]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff316005-5a82-4168-a57b-d2e2074c9147]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xiBfQJFu {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xiBfQJFu" returned: 0 in 0.030s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4459aa01-00f8-4cec-860e-470d969d9c6b]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xiBfQJFu'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f4e7e4-2845-4b48-8f37-0e458e847412]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c50be89-4688-48ce-ad9b-874f3c8a9161]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)
Apr 12 12:48:07 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)
Apr 12 12:48:07 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d796bf7-014e-4a41-bf42-7c2f5f76a62b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010, portal: 172.16.0.220,3260]
Apr 12 12:48:07 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010, portal: 172.16.0.220,3260] successful.
Apr 12 12:48:07 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb34c0e8-3d4f-4e56-9758-93c16fcbc5ce]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf9bcb7-cb5b-4e29-9ed1-82880483c28e]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)
Apr 12 12:48:07 user nova-compute[71321]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 (non-flash)
Apr 12 12:48:07 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)
Apr 12 12:48:07 user nova-compute[71321]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 (non-flash)
Apr 12 12:48:07 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c570801d-aef4-418c-b79d-166b26397bde]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:48:07 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: None {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:48:08 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:48:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xiBfQJFu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:48:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:48:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26337633033393163', 'path': '/dev/sdc'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:48:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337633033393163', 'path': '/dev/sdc'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:48:09 user nova-compute[71321]: DEBUG nova.objects.instance [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lazy-loading 'flavor' on Instance uuid 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:48:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 12:48:09 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:48:09 user nova-compute[71321]:   <source dev="/dev/sdc"/>
Apr 12 12:48:09 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:48:09 user nova-compute[71321]:   <serial>641c3b5e-f9ca-48ab-8b0c-cb013f333010</serial>
Apr 12 12:48:09 user nova-compute[71321]: </disk>
Apr 12 12:48:09 user nova-compute[71321]:  {{(pid=71321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 12:48:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:48:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:48:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] No VIF found with MAC fa:16:3e:d7:03:df, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:48:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.179s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:48:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:12 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "c11aafa6-a6fa-44f2-8357-23d838a0b65a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:48:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "c11aafa6-a6fa-44f2-8357-23d838a0b65a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:48:12 user nova-compute[71321]: DEBUG nova.compute.manager [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:48:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:48:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:48:12 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:48:12 user nova-compute[71321]: INFO nova.compute.claims [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Claim successful on node user
Apr 12 12:48:13 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:48:13 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:48:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.744s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:48:13 user nova-compute[71321]: DEBUG nova.compute.manager [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:48:13 user nova-compute[71321]: DEBUG nova.compute.manager [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:48:13 user nova-compute[71321]: DEBUG nova.network.neutron [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:48:13 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:48:13 user nova-compute[71321]: DEBUG nova.compute.manager [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:48:13 user nova-compute[71321]: DEBUG nova.policy [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a3d9f4516bee4f8d9af7a40ed1298f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61975273ccb41229e0138b96eb7f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:48:13 user nova-compute[71321]: DEBUG nova.compute.manager [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:48:13 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:48:13 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Creating image(s)
Apr 12 12:48:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "/opt/stack/data/nova/instances/c11aafa6-a6fa-44f2-8357-23d838a0b65a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:48:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "/opt/stack/data/nova/instances/c11aafa6-a6fa-44f2-8357-23d838a0b65a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:48:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "/opt/stack/data/nova/instances/c11aafa6-a6fa-44f2-8357-23d838a0b65a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:48:13 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:13 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.132s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:48:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:48:13 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.135s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/c11aafa6-a6fa-44f2-8357-23d838a0b65a/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/c11aafa6-a6fa-44f2-8357-23d838a0b65a/disk 1073741824" returned: 0 in 0.045s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:48:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.129s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:14 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c11aafa6-a6fa-44f2-8357-23d838a0b65a/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:48:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c11aafa6-a6fa-44f2-8357-23d838a0b65a/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:14 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c11aafa6-a6fa-44f2-8357-23d838a0b65a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:14 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Cannot resize image /opt/stack/data/nova/instances/c11aafa6-a6fa-44f2-8357-23d838a0b65a/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:48:14 user nova-compute[71321]: DEBUG nova.objects.instance [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lazy-loading 'migration_context' on Instance uuid c11aafa6-a6fa-44f2-8357-23d838a0b65a {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:48:14 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:48:14 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Ensure instance console log exists: /opt/stack/data/nova/instances/c11aafa6-a6fa-44f2-8357-23d838a0b65a/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:48:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:48:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:48:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:48:14 user nova-compute[71321]: DEBUG nova.network.neutron [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Successfully created port: d5393827-131c-4d5f-8135-1cfab67f5779 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.network.neutron [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Successfully updated port: d5393827-131c-4d5f-8135-1cfab67f5779 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "refresh_cache-c11aafa6-a6fa-44f2-8357-23d838a0b65a" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquired lock "refresh_cache-c11aafa6-a6fa-44f2-8357-23d838a0b65a" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.network.neutron [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.compute.manager [req-92533b49-d874-401d-930f-7147192f443f req-11648d87-fc21-46f9-bc39-54f6e65c8433 service nova] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Received event network-changed-d5393827-131c-4d5f-8135-1cfab67f5779 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.compute.manager [req-92533b49-d874-401d-930f-7147192f443f req-11648d87-fc21-46f9-bc39-54f6e65c8433 service nova] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Refreshing instance network info cache due to event network-changed-d5393827-131c-4d5f-8135-1cfab67f5779. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-92533b49-d874-401d-930f-7147192f443f req-11648d87-fc21-46f9-bc39-54f6e65c8433 service nova] Acquiring lock "refresh_cache-c11aafa6-a6fa-44f2-8357-23d838a0b65a" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.network.neutron [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.network.neutron [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Updating instance_info_cache with network_info: [{"id": "d5393827-131c-4d5f-8135-1cfab67f5779", "address": "fa:16:3e:36:3f:d5", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5393827-13", "ovs_interfaceid": "d5393827-131c-4d5f-8135-1cfab67f5779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Releasing lock "refresh_cache-c11aafa6-a6fa-44f2-8357-23d838a0b65a" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.compute.manager [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Instance network_info: |[{"id": "d5393827-131c-4d5f-8135-1cfab67f5779", "address": "fa:16:3e:36:3f:d5", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5393827-13", "ovs_interfaceid": "d5393827-131c-4d5f-8135-1cfab67f5779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-92533b49-d874-401d-930f-7147192f443f req-11648d87-fc21-46f9-bc39-54f6e65c8433 service nova] Acquired lock "refresh_cache-c11aafa6-a6fa-44f2-8357-23d838a0b65a" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.network.neutron [req-92533b49-d874-401d-930f-7147192f443f req-11648d87-fc21-46f9-bc39-54f6e65c8433 service nova] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Refreshing network info cache for port d5393827-131c-4d5f-8135-1cfab67f5779 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Start _get_guest_xml network_info=[{"id": "d5393827-131c-4d5f-8135-1cfab67f5779", "address": "fa:16:3e:36:3f:d5", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5393827-13", "ovs_interfaceid": "d5393827-131c-4d5f-8135-1cfab67f5779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:48:15 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:48:15 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:48:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1049944683',display_name='tempest-AttachVolumeNegativeTest-server-1049944683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1049944683',id=35,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKvgz8aLXkL1UKXgloE5a0NO7Dnov3h6aO83UrmYprW5fb0WDb7wXSnzJjb5RIqLorBqNq22tT9Q0H5PncM/xbLBZ+QGt4OD9dIDTA8doC20Ehow9LLFhPvQBMpGLeJjw==',key_name='tempest-keypair-465886863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e61975273ccb41229e0138b96eb7f5e9',ramdisk_id='',reservation_id='r-3p34eqr6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-941338837',owner_user_name='tempest-AttachVolumeNegativeTest-941338837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:48:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3d9f4516bee4f8d9af7a40ed1298f03',uuid=c11aafa6-a6fa-44f2-8357-23d838a0b65a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5393827-131c-4d5f-8135-1cfab67f5779", "address": "fa:16:3e:36:3f:d5", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5393827-13", "ovs_interfaceid": "d5393827-131c-4d5f-8135-1cfab67f5779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Converting VIF {"id": "d5393827-131c-4d5f-8135-1cfab67f5779", "address": "fa:16:3e:36:3f:d5", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5393827-13", "ovs_interfaceid": "d5393827-131c-4d5f-8135-1cfab67f5779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:3f:d5,bridge_name='br-int',has_traffic_filtering=True,id=d5393827-131c-4d5f-8135-1cfab67f5779,network=Network(e211a286-ade0-4930-a327-4c6a41785094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5393827-13') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.objects.instance [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lazy-loading 'pci_devices' on Instance uuid c11aafa6-a6fa-44f2-8357-23d838a0b65a {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:48:15 user nova-compute[71321]:   <uuid>c11aafa6-a6fa-44f2-8357-23d838a0b65a</uuid>
Apr 12 12:48:15 user nova-compute[71321]:   <name>instance-00000023</name>
Apr 12 12:48:15 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:48:15 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:48:15 user nova-compute[71321]:   <metadata>
Apr 12 12:48:15 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:48:15 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:48:15 user nova-compute[71321]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1049944683</nova:name>
Apr 12 12:48:15 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:48:15</nova:creationTime>
Apr 12 12:48:15 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:48:15 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:48:15 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:48:15 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:48:15 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:48:15 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:48:15 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:48:15 user nova-compute[71321]:       <nova:owner>
Apr 12 12:48:15 user nova-compute[71321]:         <nova:user uuid="a3d9f4516bee4f8d9af7a40ed1298f03">tempest-AttachVolumeNegativeTest-941338837-project-member</nova:user>
Apr 12 12:48:15 user nova-compute[71321]:         <nova:project uuid="e61975273ccb41229e0138b96eb7f5e9">tempest-AttachVolumeNegativeTest-941338837</nova:project>
Apr 12 12:48:15 user nova-compute[71321]:       </nova:owner>
Apr 12 12:48:15 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:48:15 user nova-compute[71321]:       <nova:ports>
Apr 12 12:48:15 user nova-compute[71321]:         <nova:port uuid="d5393827-131c-4d5f-8135-1cfab67f5779">
Apr 12 12:48:15 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 12:48:15 user nova-compute[71321]:         </nova:port>
Apr 12 12:48:15 user nova-compute[71321]:       </nova:ports>
Apr 12 12:48:15 user nova-compute[71321]:     </nova:instance>
Apr 12 12:48:15 user nova-compute[71321]:   </metadata>
Apr 12 12:48:15 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:48:15 user nova-compute[71321]:     <system>
Apr 12 12:48:15 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:48:15 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:48:15 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:48:15 user nova-compute[71321]:       <entry name="serial">c11aafa6-a6fa-44f2-8357-23d838a0b65a</entry>
Apr 12 12:48:15 user nova-compute[71321]:       <entry name="uuid">c11aafa6-a6fa-44f2-8357-23d838a0b65a</entry>
Apr 12 12:48:15 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:48:15 user nova-compute[71321]:     </system>
Apr 12 12:48:15 user nova-compute[71321]:   </sysinfo>
Apr 12 12:48:15 user nova-compute[71321]:   <os>
Apr 12 12:48:15 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:48:15 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:48:15 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:48:15 user nova-compute[71321]:   </os>
Apr 12 12:48:15 user nova-compute[71321]:   <features>
Apr 12 12:48:15 user nova-compute[71321]:     <acpi/>
Apr 12 12:48:15 user nova-compute[71321]:     <apic/>
Apr 12 12:48:15 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:48:15 user nova-compute[71321]:   </features>
Apr 12 12:48:15 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:48:15 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:48:15 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:48:15 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:48:15 user nova-compute[71321]:   </clock>
Apr 12 12:48:15 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:48:15 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:48:15 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:48:15 user nova-compute[71321]:   </cpu>
Apr 12 12:48:15 user nova-compute[71321]:   <devices>
Apr 12 12:48:15 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:48:15 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:48:15 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/c11aafa6-a6fa-44f2-8357-23d838a0b65a/disk"/>
Apr 12 12:48:15 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:48:15 user nova-compute[71321]:     </disk>
Apr 12 12:48:15 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:48:15 user nova-compute[71321]:       <mac address="fa:16:3e:36:3f:d5"/>
Apr 12 12:48:15 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:48:15 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:48:15 user nova-compute[71321]:       <target dev="tapd5393827-13"/>
Apr 12 12:48:15 user nova-compute[71321]:     </interface>
Apr 12 12:48:15 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:48:15 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/c11aafa6-a6fa-44f2-8357-23d838a0b65a/console.log" append="off"/>
Apr 12 12:48:15 user nova-compute[71321]:     </serial>
Apr 12 12:48:15 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:48:15 user nova-compute[71321]:     <video>
Apr 12 12:48:15 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:48:15 user nova-compute[71321]:     </video>
Apr 12 12:48:15 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:48:15 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:48:15 user nova-compute[71321]:     </rng>
Apr 12 12:48:15 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:48:15 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:48:15 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:48:15 user nova-compute[71321]:     </memballoon>
Apr 12 12:48:15 user nova-compute[71321]:   </devices>
Apr 12 12:48:15 user nova-compute[71321]: </domain>
Apr 12 12:48:15 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:48:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1049944683',display_name='tempest-AttachVolumeNegativeTest-server-1049944683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1049944683',id=35,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKvgz8aLXkL1UKXgloE5a0NO7Dnov3h6aO83UrmYprW5fb0WDb7wXSnzJjb5RIqLorBqNq22tT9Q0H5PncM/xbLBZ+QGt4OD9dIDTA8doC20Ehow9LLFhPvQBMpGLeJjw==',key_name='tempest-keypair-465886863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e61975273ccb41229e0138b96eb7f5e9',ramdisk_id='',reservation_id='r-3p34eqr6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-941338837',owner_user_name='tempest-AttachVolumeNegativeTest-941338837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:48:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3d9f4516bee4f8d9af7a40ed1298f03',uuid=c11aafa6-a6fa-44f2-8357-23d838a0b65a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5393827-131c-4d5f-8135-1cfab67f5779", "address": "fa:16:3e:36:3f:d5", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5393827-13", "ovs_interfaceid": "d5393827-131c-4d5f-8135-1cfab67f5779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Converting VIF {"id": "d5393827-131c-4d5f-8135-1cfab67f5779", "address": "fa:16:3e:36:3f:d5", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5393827-13", "ovs_interfaceid": "d5393827-131c-4d5f-8135-1cfab67f5779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:3f:d5,bridge_name='br-int',has_traffic_filtering=True,id=d5393827-131c-4d5f-8135-1cfab67f5779,network=Network(e211a286-ade0-4930-a327-4c6a41785094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5393827-13') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG os_vif [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:3f:d5,bridge_name='br-int',has_traffic_filtering=True,id=d5393827-131c-4d5f-8135-1cfab67f5779,network=Network(e211a286-ade0-4930-a327-4c6a41785094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5393827-13') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-46299ded-26b9-4487-b81d-5111b8da5870 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "e702924c-a079-4744-a112-985304a861ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-46299ded-26b9-4487-b81d-5111b8da5870 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "e702924c-a079-4744-a112-985304a861ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-46299ded-26b9-4487-b81d-5111b8da5870 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "e702924c-a079-4744-a112-985304a861ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-46299ded-26b9-4487-b81d-5111b8da5870 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "e702924c-a079-4744-a112-985304a861ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-46299ded-26b9-4487-b81d-5111b8da5870 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "e702924c-a079-4744-a112-985304a861ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5393827-13, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd5393827-13, col_values=(('external_ids', {'iface-id': 'd5393827-131c-4d5f-8135-1cfab67f5779', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:3f:d5', 'vm-uuid': 'c11aafa6-a6fa-44f2-8357-23d838a0b65a'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:15 user nova-compute[71321]: INFO nova.compute.manager [None req-46299ded-26b9-4487-b81d-5111b8da5870 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Terminating instance
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.compute.manager [None req-46299ded-26b9-4487-b81d-5111b8da5870 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:48:15 user nova-compute[71321]: INFO os_vif [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:3f:d5,bridge_name='br-int',has_traffic_filtering=True,id=d5393827-131c-4d5f-8135-1cfab67f5779,network=Network(e211a286-ade0-4930-a327-4c6a41785094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5393827-13')
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] No VIF found with MAC fa:16:3e:36:3f:d5, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.compute.manager [req-48474e09-fedb-44d0-9ac8-5498e1ed4461 req-93e76c63-e0b0-4da7-99b0-6a73eb0fc7a4 service nova] [instance: e702924c-a079-4744-a112-985304a861ea] Received event network-vif-unplugged-ec18f93d-7e1c-4140-bd72-4945caafc3b0 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-48474e09-fedb-44d0-9ac8-5498e1ed4461 req-93e76c63-e0b0-4da7-99b0-6a73eb0fc7a4 service nova] Acquiring lock "e702924c-a079-4744-a112-985304a861ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-48474e09-fedb-44d0-9ac8-5498e1ed4461 req-93e76c63-e0b0-4da7-99b0-6a73eb0fc7a4 service nova] Lock "e702924c-a079-4744-a112-985304a861ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-48474e09-fedb-44d0-9ac8-5498e1ed4461 req-93e76c63-e0b0-4da7-99b0-6a73eb0fc7a4 service nova] Lock "e702924c-a079-4744-a112-985304a861ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.compute.manager [req-48474e09-fedb-44d0-9ac8-5498e1ed4461 req-93e76c63-e0b0-4da7-99b0-6a73eb0fc7a4 service nova] [instance: e702924c-a079-4744-a112-985304a861ea] No waiting events found dispatching network-vif-unplugged-ec18f93d-7e1c-4140-bd72-4945caafc3b0 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:48:15 user nova-compute[71321]: DEBUG nova.compute.manager [req-48474e09-fedb-44d0-9ac8-5498e1ed4461 req-93e76c63-e0b0-4da7-99b0-6a73eb0fc7a4 service nova] [instance: e702924c-a079-4744-a112-985304a861ea] Received event network-vif-unplugged-ec18f93d-7e1c-4140-bd72-4945caafc3b0 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:48:16 user nova-compute[71321]: DEBUG nova.network.neutron [req-92533b49-d874-401d-930f-7147192f443f req-11648d87-fc21-46f9-bc39-54f6e65c8433 service nova] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Updated VIF entry in instance network info cache for port d5393827-131c-4d5f-8135-1cfab67f5779. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:48:16 user nova-compute[71321]: DEBUG nova.network.neutron [req-92533b49-d874-401d-930f-7147192f443f req-11648d87-fc21-46f9-bc39-54f6e65c8433 service nova] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Updating instance_info_cache with network_info: [{"id": "d5393827-131c-4d5f-8135-1cfab67f5779", "address": "fa:16:3e:36:3f:d5", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5393827-13", "ovs_interfaceid": "d5393827-131c-4d5f-8135-1cfab67f5779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:48:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-92533b49-d874-401d-930f-7147192f443f req-11648d87-fc21-46f9-bc39-54f6e65c8433 service nova] Releasing lock "refresh_cache-c11aafa6-a6fa-44f2-8357-23d838a0b65a" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:48:16 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: e702924c-a079-4744-a112-985304a861ea] Instance destroyed successfully.
Apr 12 12:48:16 user nova-compute[71321]: DEBUG nova.objects.instance [None req-46299ded-26b9-4487-b81d-5111b8da5870 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lazy-loading 'resources' on Instance uuid e702924c-a079-4744-a112-985304a861ea {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:48:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-46299ded-26b9-4487-b81d-5111b8da5870 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:46:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-293731119',display_name='tempest-VolumesActionsTest-instance-293731119',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-293731119',id=33,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:46:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bfd0006105e24edb9516d52c5af63054',ramdisk_id='',reservation_id='r-8436yj01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1646592366',owner_user_name='tempest-VolumesActionsTest-1646592366-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:46:32Z,user_data=None,user_id='2b3792e5a3b24583bbf50fb2b275b6d0',uuid=e702924c-a079-4744-a112-985304a861ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec18f93d-7e1c-4140-bd72-4945caafc3b0", "address": "fa:16:3e:96:e2:63", "network": {"id": "eaded3a8-c825-4731-95bc-3f39f32603da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1058349103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bfd0006105e24edb9516d52c5af63054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec18f93d-7e", "ovs_interfaceid": "ec18f93d-7e1c-4140-bd72-4945caafc3b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:48:16 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-46299ded-26b9-4487-b81d-5111b8da5870 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Converting VIF {"id": "ec18f93d-7e1c-4140-bd72-4945caafc3b0", "address": "fa:16:3e:96:e2:63", "network": {"id": "eaded3a8-c825-4731-95bc-3f39f32603da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1058349103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bfd0006105e24edb9516d52c5af63054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec18f93d-7e", "ovs_interfaceid": "ec18f93d-7e1c-4140-bd72-4945caafc3b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:48:16 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-46299ded-26b9-4487-b81d-5111b8da5870 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:e2:63,bridge_name='br-int',has_traffic_filtering=True,id=ec18f93d-7e1c-4140-bd72-4945caafc3b0,network=Network(eaded3a8-c825-4731-95bc-3f39f32603da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec18f93d-7e') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:48:16 user nova-compute[71321]: DEBUG os_vif [None req-46299ded-26b9-4487-b81d-5111b8da5870 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:e2:63,bridge_name='br-int',has_traffic_filtering=True,id=ec18f93d-7e1c-4140-bd72-4945caafc3b0,network=Network(eaded3a8-c825-4731-95bc-3f39f32603da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec18f93d-7e') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:48:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec18f93d-7e, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:48:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:48:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:16 user nova-compute[71321]: INFO os_vif [None req-46299ded-26b9-4487-b81d-5111b8da5870 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:e2:63,bridge_name='br-int',has_traffic_filtering=True,id=ec18f93d-7e1c-4140-bd72-4945caafc3b0,network=Network(eaded3a8-c825-4731-95bc-3f39f32603da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec18f93d-7e')
Apr 12 12:48:16 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-46299ded-26b9-4487-b81d-5111b8da5870 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Deleting instance files /opt/stack/data/nova/instances/e702924c-a079-4744-a112-985304a861ea_del
Apr 12 12:48:16 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-46299ded-26b9-4487-b81d-5111b8da5870 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Deletion of /opt/stack/data/nova/instances/e702924c-a079-4744-a112-985304a861ea_del complete
Apr 12 12:48:16 user nova-compute[71321]: INFO nova.compute.manager [None req-46299ded-26b9-4487-b81d-5111b8da5870 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Took 1.13 seconds to destroy the instance on the hypervisor.
Apr 12 12:48:16 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-46299ded-26b9-4487-b81d-5111b8da5870 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:48:16 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: e702924c-a079-4744-a112-985304a861ea] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:48:16 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: e702924c-a079-4744-a112-985304a861ea] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:48:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:17 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: e702924c-a079-4744-a112-985304a861ea] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:48:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:17 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: e702924c-a079-4744-a112-985304a861ea] Took 0.59 seconds to deallocate network for instance.
Apr 12 12:48:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:17 user nova-compute[71321]: DEBUG nova.compute.manager [req-c9184559-af2d-470d-a5d8-2d451e4795c9 req-f21691ee-ad50-41f7-8f25-fcdd51cfca1c service nova] [instance: e702924c-a079-4744-a112-985304a861ea] Received event network-vif-deleted-ec18f93d-7e1c-4140-bd72-4945caafc3b0 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:48:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-46299ded-26b9-4487-b81d-5111b8da5870 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:48:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-46299ded-26b9-4487-b81d-5111b8da5870 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:48:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:17 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-46299ded-26b9-4487-b81d-5111b8da5870 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:48:17 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-46299ded-26b9-4487-b81d-5111b8da5870 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:48:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-46299ded-26b9-4487-b81d-5111b8da5870 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:48:17 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-46299ded-26b9-4487-b81d-5111b8da5870 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Deleted allocations for instance e702924c-a079-4744-a112-985304a861ea
Apr 12 12:48:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-46299ded-26b9-4487-b81d-5111b8da5870 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "e702924c-a079-4744-a112-985304a861ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.225s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:48:17 user nova-compute[71321]: DEBUG nova.compute.manager [req-1abdc3a2-277d-4968-ba01-28620cb1f39c req-b8e7dcd7-dddd-4c47-91c5-6059a62d2288 service nova] [instance: e702924c-a079-4744-a112-985304a861ea] Received event network-vif-plugged-ec18f93d-7e1c-4140-bd72-4945caafc3b0 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:48:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-1abdc3a2-277d-4968-ba01-28620cb1f39c req-b8e7dcd7-dddd-4c47-91c5-6059a62d2288 service nova] Acquiring lock "e702924c-a079-4744-a112-985304a861ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:48:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-1abdc3a2-277d-4968-ba01-28620cb1f39c req-b8e7dcd7-dddd-4c47-91c5-6059a62d2288 service nova] Lock "e702924c-a079-4744-a112-985304a861ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:48:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-1abdc3a2-277d-4968-ba01-28620cb1f39c req-b8e7dcd7-dddd-4c47-91c5-6059a62d2288 service nova] Lock "e702924c-a079-4744-a112-985304a861ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:48:17 user nova-compute[71321]: DEBUG nova.compute.manager [req-1abdc3a2-277d-4968-ba01-28620cb1f39c req-b8e7dcd7-dddd-4c47-91c5-6059a62d2288 service nova] [instance: e702924c-a079-4744-a112-985304a861ea] No waiting events found dispatching network-vif-plugged-ec18f93d-7e1c-4140-bd72-4945caafc3b0 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:48:17 user nova-compute[71321]: WARNING nova.compute.manager [req-1abdc3a2-277d-4968-ba01-28620cb1f39c req-b8e7dcd7-dddd-4c47-91c5-6059a62d2288 service nova] [instance: e702924c-a079-4744-a112-985304a861ea] Received unexpected event network-vif-plugged-ec18f93d-7e1c-4140-bd72-4945caafc3b0 for instance with vm_state deleted and task_state None.
Apr 12 12:48:19 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303699.3420303, c11aafa6-a6fa-44f2-8357-23d838a0b65a => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:48:19 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] VM Resumed (Lifecycle Event)
Apr 12 12:48:19 user nova-compute[71321]: DEBUG nova.compute.manager [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:48:19 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:48:19 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Instance spawned successfully.
Apr 12 12:48:19 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:48:19 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:48:19 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:48:19 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:48:19 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:48:19 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:48:19 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:48:19 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:48:19 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:48:19 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:48:19 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303699.3454916, c11aafa6-a6fa-44f2-8357-23d838a0b65a => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:48:19 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] VM Started (Lifecycle Event)
Apr 12 12:48:19 user nova-compute[71321]: DEBUG nova.compute.manager [req-94661ab7-f9ac-40bf-a690-92c1bacbc7a5 req-04fc6e51-ae0c-4d45-a33c-96853d18d994 service nova] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Received event network-vif-plugged-d5393827-131c-4d5f-8135-1cfab67f5779 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:48:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-94661ab7-f9ac-40bf-a690-92c1bacbc7a5 req-04fc6e51-ae0c-4d45-a33c-96853d18d994 service nova] Acquiring lock "c11aafa6-a6fa-44f2-8357-23d838a0b65a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:48:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-94661ab7-f9ac-40bf-a690-92c1bacbc7a5 req-04fc6e51-ae0c-4d45-a33c-96853d18d994 service nova] Lock "c11aafa6-a6fa-44f2-8357-23d838a0b65a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:48:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-94661ab7-f9ac-40bf-a690-92c1bacbc7a5 req-04fc6e51-ae0c-4d45-a33c-96853d18d994 service nova] Lock "c11aafa6-a6fa-44f2-8357-23d838a0b65a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:48:19 user nova-compute[71321]: DEBUG nova.compute.manager [req-94661ab7-f9ac-40bf-a690-92c1bacbc7a5 req-04fc6e51-ae0c-4d45-a33c-96853d18d994 service nova] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] No waiting events found dispatching network-vif-plugged-d5393827-131c-4d5f-8135-1cfab67f5779 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:48:19 user nova-compute[71321]: WARNING nova.compute.manager [req-94661ab7-f9ac-40bf-a690-92c1bacbc7a5 req-04fc6e51-ae0c-4d45-a33c-96853d18d994 service nova] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Received unexpected event network-vif-plugged-d5393827-131c-4d5f-8135-1cfab67f5779 for instance with vm_state building and task_state spawning.
Apr 12 12:48:19 user nova-compute[71321]: DEBUG nova.compute.manager [req-94661ab7-f9ac-40bf-a690-92c1bacbc7a5 req-04fc6e51-ae0c-4d45-a33c-96853d18d994 service nova] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Received event network-vif-plugged-d5393827-131c-4d5f-8135-1cfab67f5779 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:48:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-94661ab7-f9ac-40bf-a690-92c1bacbc7a5 req-04fc6e51-ae0c-4d45-a33c-96853d18d994 service nova] Acquiring lock "c11aafa6-a6fa-44f2-8357-23d838a0b65a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:48:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-94661ab7-f9ac-40bf-a690-92c1bacbc7a5 req-04fc6e51-ae0c-4d45-a33c-96853d18d994 service nova] Lock "c11aafa6-a6fa-44f2-8357-23d838a0b65a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:48:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-94661ab7-f9ac-40bf-a690-92c1bacbc7a5 req-04fc6e51-ae0c-4d45-a33c-96853d18d994 service nova] Lock "c11aafa6-a6fa-44f2-8357-23d838a0b65a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:48:19 user nova-compute[71321]: DEBUG nova.compute.manager [req-94661ab7-f9ac-40bf-a690-92c1bacbc7a5 req-04fc6e51-ae0c-4d45-a33c-96853d18d994 service nova] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] No waiting events found dispatching network-vif-plugged-d5393827-131c-4d5f-8135-1cfab67f5779 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:48:19 user nova-compute[71321]: WARNING nova.compute.manager [req-94661ab7-f9ac-40bf-a690-92c1bacbc7a5 req-04fc6e51-ae0c-4d45-a33c-96853d18d994 service nova] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Received unexpected event network-vif-plugged-d5393827-131c-4d5f-8135-1cfab67f5779 for instance with vm_state building and task_state spawning.
Apr 12 12:48:19 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:48:19 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:48:19 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:48:19 user nova-compute[71321]: INFO nova.compute.manager [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Took 5.69 seconds to spawn the instance on the hypervisor.
Apr 12 12:48:19 user nova-compute[71321]: DEBUG nova.compute.manager [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:48:19 user nova-compute[71321]: INFO nova.compute.manager [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Took 6.74 seconds to build instance.
Apr 12 12:48:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "c11aafa6-a6fa-44f2-8357-23d838a0b65a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.834s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:48:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:26 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:48:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:48:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:48:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:48:26 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:48:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c11aafa6-a6fa-44f2-8357-23d838a0b65a/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c11aafa6-a6fa-44f2-8357-23d838a0b65a/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c11aafa6-a6fa-44f2-8357-23d838a0b65a/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c11aafa6-a6fa-44f2-8357-23d838a0b65a/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:48:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:48:28 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:48:28 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:48:28 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8303MB free_disk=26.42731475830078GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:48:28 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:48:28 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:48:28 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Applying migration context for instance 62452efb-3a12-4aff-9359-217d17fc052a as it has an incoming, in-progress migration 1690aedb-b803-4256-a452-934af08125fb. Migration status is finished {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 12 12:48:28 user nova-compute[71321]: INFO nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Updating resource usage from migration 1690aedb-b803-4256-a452-934af08125fb
Apr 12 12:48:28 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:48:28 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:48:28 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Migration 1690aedb-b803-4256-a452-934af08125fb is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 12 12:48:28 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 62452efb-3a12-4aff-9359-217d17fc052a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:48:28 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance db9f1454-9e3c-40d4-849b-c13537d6be97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:48:28 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance c11aafa6-a6fa-44f2-8357-23d838a0b65a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:48:28 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:48:28 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=1344MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:48:28 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:48:28 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:48:28 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:48:28 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.358s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:48:28 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-981619ed-5d01-413d-b356-e4f0611161c0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "62452efb-3a12-4aff-9359-217d17fc052a" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:48:28 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-981619ed-5d01-413d-b356-e4f0611161c0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "62452efb-3a12-4aff-9359-217d17fc052a" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:48:28 user nova-compute[71321]: DEBUG nova.compute.manager [None req-981619ed-5d01-413d-b356-e4f0611161c0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Going to confirm migration 2 {{(pid=71321) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4663}}
Apr 12 12:48:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-981619ed-5d01-413d-b356-e4f0611161c0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "refresh_cache-62452efb-3a12-4aff-9359-217d17fc052a" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:48:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-981619ed-5d01-413d-b356-e4f0611161c0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquired lock "refresh_cache-62452efb-3a12-4aff-9359-217d17fc052a" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:48:29 user nova-compute[71321]: DEBUG nova.network.neutron [None req-981619ed-5d01-413d-b356-e4f0611161c0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:48:29 user nova-compute[71321]: DEBUG nova.objects.instance [None req-981619ed-5d01-413d-b356-e4f0611161c0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lazy-loading 'info_cache' on Instance uuid 62452efb-3a12-4aff-9359-217d17fc052a {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:48:29 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:48:29 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:48:29 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:48:29 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:48:29 user nova-compute[71321]: DEBUG nova.network.neutron [None req-981619ed-5d01-413d-b356-e4f0611161c0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Updating instance_info_cache with network_info: [{"id": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "address": "fa:16:3e:c6:61:66", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea59aa7-b9", "ovs_interfaceid": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:48:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-981619ed-5d01-413d-b356-e4f0611161c0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Releasing lock "refresh_cache-62452efb-3a12-4aff-9359-217d17fc052a" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:48:29 user nova-compute[71321]: DEBUG nova.objects.instance [None req-981619ed-5d01-413d-b356-e4f0611161c0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lazy-loading 'migration_context' on Instance uuid 62452efb-3a12-4aff-9359-217d17fc052a {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:48:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-981619ed-5d01-413d-b356-e4f0611161c0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:48:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-981619ed-5d01-413d-b356-e4f0611161c0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:48:29 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-981619ed-5d01-413d-b356-e4f0611161c0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:48:29 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-981619ed-5d01-413d-b356-e4f0611161c0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:48:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-981619ed-5d01-413d-b356-e4f0611161c0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.279s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:48:30 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-981619ed-5d01-413d-b356-e4f0611161c0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Deleted allocation for migration 1690aedb-b803-4256-a452-934af08125fb
Apr 12 12:48:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-981619ed-5d01-413d-b356-e4f0611161c0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "62452efb-3a12-4aff-9359-217d17fc052a" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.367s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:48:31 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681303696.6283364, e702924c-a079-4744-a112-985304a861ea => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:48:31 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: e702924c-a079-4744-a112-985304a861ea] VM Stopped (Lifecycle Event)
Apr 12 12:48:31 user nova-compute[71321]: DEBUG nova.compute.manager [None req-03428779-a570-47bb-9882-36270e591965 None None] [instance: e702924c-a079-4744-a112-985304a861ea] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:48:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:48:32 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:48:32 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:48:33 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:48:33 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:48:35 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:48:35 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:48:35 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Rebuilding the list of instances to heal {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 12:48:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:35 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:48:35 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:48:35 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 12:48:35 user nova-compute[71321]: DEBUG nova.objects.instance [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lazy-loading 'info_cache' on Instance uuid a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:48:36 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Updating instance_info_cache with network_info: [{"id": "01ee163a-4590-4b09-bcb5-a53d238252d8", "address": "fa:16:3e:36:a3:07", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01ee163a-45", "ovs_interfaceid": "01ee163a-4590-4b09-bcb5-a53d238252d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:48:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:48:36 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 12:48:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:41 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:48:41 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:45 user nova-compute[71321]: DEBUG nova.compute.manager [req-f0843858-9d6c-48be-8e7d-17f773f7ac4a req-ca81bef0-6380-420b-88b8-c6fe827f9ee4 service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Received event network-changed-9c30bdfa-5f39-4454-af8b-f2ccd880807b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:48:45 user nova-compute[71321]: DEBUG nova.compute.manager [req-f0843858-9d6c-48be-8e7d-17f773f7ac4a req-ca81bef0-6380-420b-88b8-c6fe827f9ee4 service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Refreshing instance network info cache due to event network-changed-9c30bdfa-5f39-4454-af8b-f2ccd880807b. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:48:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f0843858-9d6c-48be-8e7d-17f773f7ac4a req-ca81bef0-6380-420b-88b8-c6fe827f9ee4 service nova] Acquiring lock "refresh_cache-db9f1454-9e3c-40d4-849b-c13537d6be97" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:48:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f0843858-9d6c-48be-8e7d-17f773f7ac4a req-ca81bef0-6380-420b-88b8-c6fe827f9ee4 service nova] Acquired lock "refresh_cache-db9f1454-9e3c-40d4-849b-c13537d6be97" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:48:45 user nova-compute[71321]: DEBUG nova.network.neutron [req-f0843858-9d6c-48be-8e7d-17f773f7ac4a req-ca81bef0-6380-420b-88b8-c6fe827f9ee4 service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Refreshing network info cache for port 9c30bdfa-5f39-4454-af8b-f2ccd880807b {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:48:46 user nova-compute[71321]: DEBUG nova.network.neutron [req-f0843858-9d6c-48be-8e7d-17f773f7ac4a req-ca81bef0-6380-420b-88b8-c6fe827f9ee4 service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Updated VIF entry in instance network info cache for port 9c30bdfa-5f39-4454-af8b-f2ccd880807b. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:48:46 user nova-compute[71321]: DEBUG nova.network.neutron [req-f0843858-9d6c-48be-8e7d-17f773f7ac4a req-ca81bef0-6380-420b-88b8-c6fe827f9ee4 service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Updating instance_info_cache with network_info: [{"id": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "address": "fa:16:3e:c8:2c:e7", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30bdfa-5f", "ovs_interfaceid": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:48:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f0843858-9d6c-48be-8e7d-17f773f7ac4a req-ca81bef0-6380-420b-88b8-c6fe827f9ee4 service nova] Releasing lock "refresh_cache-db9f1454-9e3c-40d4-849b-c13537d6be97" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:48:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "db9f1454-9e3c-40d4-849b-c13537d6be97" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:48:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:48:48 user nova-compute[71321]: DEBUG nova.objects.instance [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'flavor' on Instance uuid db9f1454-9e3c-40d4-849b-c13537d6be97 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:48:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:48:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "db9f1454-9e3c-40d4-849b-c13537d6be97" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:48:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:48:48 user nova-compute[71321]: INFO nova.compute.manager [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Attaching volume 02c22408-e0c3-41e4-817c-dc6057451b06 to /dev/vdb
Apr 12 12:48:48 user nova-compute[71321]: DEBUG os_brick.utils [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:48:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:48 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeecc611-ee68-4d4c-9043-520f202b6943]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:48:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:48 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4935d149-c6fb-451b-855c-5fc5b8f14091]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:48:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:48 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79d4cdb-c1a7-4f21-80ec-72e2dc4a8d55]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:48:48 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b8a281-d06c-4931-a460-6c7f9fc85874]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:48:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:48:48 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:48:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:48:48 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:48:48 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad44d9b1-7225-4f8d-9a5e-f288fe98b112]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:48:48 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:48:48 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:48:48 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:48:48 user nova-compute[71321]: DEBUG os_brick.utils [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:48:48 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Updating existing volume attachment record: 28dab7f5-23ad-4b36-9f52-f8a13746cfa0 {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:48:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:52 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:48:52 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vFhwTVmp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:48:52 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:48:52 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:48:52 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:48:52 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:48:52 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:48:52 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:48:52 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:48:52 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:52 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:52 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3899a1-3fc5-40eb-a9a1-964fdcce686d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:48:52 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:48:52 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:48:52 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:52 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:52 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd2b2fa-f3a9-49c0-8dee-ebc127a9b64a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:48:52 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06] added
Apr 12 12:48:52 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:48:52 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:52 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:52 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ed49e3-4626-4b49-b6d8-879e5ecaef0f]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:48:52 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:48:52 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:52 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:52 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e6af3a-82a8-4b23-88a8-801b732a2f7d]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:48:52 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:48:52 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vFhwTVmp {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:52 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vFhwTVmp" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:52 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[83884923-e23f-4d84-b3bb-a13f7d790ecb]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:48:52 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vFhwTVmp'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:48:52 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:52 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:52 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bc8c43-ad86-48e6-b3ff-a82deb8c2b7f]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:48:52 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:48:53 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:53 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:53 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef32986-4d04-48c9-a90b-b57fe134e8b6]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:48:53 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)
Apr 12 12:48:53 user nova-compute[71321]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 (non-flash)
Apr 12 12:48:53 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:48:53 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)
Apr 12 12:48:53 user nova-compute[71321]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 (non-flash)
Apr 12 12:48:53 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:48:53 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:53 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:53 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[741bc320-f488-4b2b-a8ab-f75c31cf4faf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:48:53 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06, portal: 172.16.0.220,3260]
Apr 12 12:48:53 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06, portal: 172.16.0.220,3260] successful.
Apr 12 12:48:53 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:48:53 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:53 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:53 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[98cef848-a5d4-4973-82f2-f3636e6241df]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:48:53 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:48:53 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:53 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:53 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[be88562d-497f-401e-a9a3-d4ccfc6a33e8]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:48:53 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)
Apr 12 12:48:53 user nova-compute[71321]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 (non-flash)
Apr 12 12:48:53 user nova-compute[71321]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 (non-flash)
Apr 12 12:48:53 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:48:53 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)
Apr 12 12:48:53 user nova-compute[71321]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 (non-flash)
Apr 12 12:48:53 user nova-compute[71321]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 (non-flash)
Apr 12 12:48:53 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:48:53 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:48:53 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:48:53 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:48:53 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:48:53 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:48:53 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:48:53 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd29e415-278d-4eae-896c-c598915a4b0c]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:48:53 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:48:53 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vFhwTVmp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:48:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:48:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '26430623732663136', 'path': '/dev/sdd'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:48:54 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430623732663136', 'path': '/dev/sdd'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:48:54 user nova-compute[71321]: DEBUG nova.objects.instance [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'flavor' on Instance uuid db9f1454-9e3c-40d4-849b-c13537d6be97 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:48:54 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 12:48:54 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:48:54 user nova-compute[71321]:   <source dev="/dev/sdd"/>
Apr 12 12:48:54 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:48:54 user nova-compute[71321]:   <serial>02c22408-e0c3-41e4-817c-dc6057451b06</serial>
Apr 12 12:48:54 user nova-compute[71321]: </disk>
Apr 12 12:48:54 user nova-compute[71321]:  {{(pid=71321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 12:48:54 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:48:54 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:48:54 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] No VIF found with MAC fa:16:3e:c8:2c:e7, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:48:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.332s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:48:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2085affa-aac6-4523-91c7-9b1727d36236 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "db9f1454-9e3c-40d4-849b-c13537d6be97" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:48:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2085affa-aac6-4523-91c7-9b1727d36236 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:48:55 user nova-compute[71321]: DEBUG nova.compute.manager [None req-2085affa-aac6-4523-91c7-9b1727d36236 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:48:55 user nova-compute[71321]: DEBUG nova.compute.manager [None req-2085affa-aac6-4523-91c7-9b1727d36236 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71321) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 12 12:48:55 user nova-compute[71321]: DEBUG nova.objects.instance [None req-2085affa-aac6-4523-91c7-9b1727d36236 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'flavor' on Instance uuid db9f1454-9e3c-40d4-849b-c13537d6be97 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:48:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:55 user nova-compute[71321]: DEBUG nova.compute.manager [req-97001906-89e1-48a7-a62b-c2d87613e171 req-d5d1b264-f717-4041-8495-8d72997a38c6 service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Received event network-vif-unplugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:48:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-97001906-89e1-48a7-a62b-c2d87613e171 req-d5d1b264-f717-4041-8495-8d72997a38c6 service nova] Acquiring lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:48:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-97001906-89e1-48a7-a62b-c2d87613e171 req-d5d1b264-f717-4041-8495-8d72997a38c6 service nova] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:48:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-97001906-89e1-48a7-a62b-c2d87613e171 req-d5d1b264-f717-4041-8495-8d72997a38c6 service nova] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:48:55 user nova-compute[71321]: DEBUG nova.compute.manager [req-97001906-89e1-48a7-a62b-c2d87613e171 req-d5d1b264-f717-4041-8495-8d72997a38c6 service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] No waiting events found dispatching network-vif-unplugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:48:55 user nova-compute[71321]: WARNING nova.compute.manager [req-97001906-89e1-48a7-a62b-c2d87613e171 req-d5d1b264-f717-4041-8495-8d72997a38c6 service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Received unexpected event network-vif-unplugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b for instance with vm_state active and task_state powering-off.
Apr 12 12:48:56 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Instance destroyed successfully.
Apr 12 12:48:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-2085affa-aac6-4523-91c7-9b1727d36236 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:48:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-2085affa-aac6-4523-91c7-9b1727d36236 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.858s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:48:56 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:48:57 user nova-compute[71321]: DEBUG nova.compute.manager [req-ab20b1a4-46ee-4895-9820-0da41cd81c09 req-3e72bffe-6019-488d-a81d-1e6ea46690fd service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Received event network-vif-plugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:48:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ab20b1a4-46ee-4895-9820-0da41cd81c09 req-3e72bffe-6019-488d-a81d-1e6ea46690fd service nova] Acquiring lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:48:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ab20b1a4-46ee-4895-9820-0da41cd81c09 req-3e72bffe-6019-488d-a81d-1e6ea46690fd service nova] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:48:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ab20b1a4-46ee-4895-9820-0da41cd81c09 req-3e72bffe-6019-488d-a81d-1e6ea46690fd service nova] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:48:57 user nova-compute[71321]: DEBUG nova.compute.manager [req-ab20b1a4-46ee-4895-9820-0da41cd81c09 req-3e72bffe-6019-488d-a81d-1e6ea46690fd service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] No waiting events found dispatching network-vif-plugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:48:57 user nova-compute[71321]: WARNING nova.compute.manager [req-ab20b1a4-46ee-4895-9820-0da41cd81c09 req-3e72bffe-6019-488d-a81d-1e6ea46690fd service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Received unexpected event network-vif-plugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b for instance with vm_state stopped and task_state None.
Apr 12 12:49:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:11 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681303736.098738, db9f1454-9e3c-40d4-849b-c13537d6be97 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:49:11 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] VM Stopped (Lifecycle Event)
Apr 12 12:49:11 user nova-compute[71321]: DEBUG nova.compute.manager [None req-920ceeab-ab57-4b84-8726-bc032a0d29db None None] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:49:11 user nova-compute[71321]: DEBUG nova.compute.manager [None req-920ceeab-ab57-4b84-8726-bc032a0d29db None None] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:49:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:49:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 12:49:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 12:49:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 12:49:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:27 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:49:27 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71321) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 12:49:28 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:49:28 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:49:28 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:49:28 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:49:28 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:49:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:49:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:49:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:49:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:49:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c11aafa6-a6fa-44f2-8357-23d838a0b65a/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:49:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c11aafa6-a6fa-44f2-8357-23d838a0b65a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:49:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c11aafa6-a6fa-44f2-8357-23d838a0b65a/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:49:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c11aafa6-a6fa-44f2-8357-23d838a0b65a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:49:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:49:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:49:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:49:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:49:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:49:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:49:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:49:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:49:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:49:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:49:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:49:30 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:49:30 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:49:30 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8442MB free_disk=25.448741912841797GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:49:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:49:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:49:30 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:49:30 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:49:30 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 62452efb-3a12-4aff-9359-217d17fc052a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:49:30 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance db9f1454-9e3c-40d4-849b-c13537d6be97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:49:30 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance c11aafa6-a6fa-44f2-8357-23d838a0b65a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:49:30 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:49:30 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=1216MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:49:30 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:49:30 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:49:30 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:49:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.335s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:49:31 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:49:31 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:49:31 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:49:31 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:49:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:33 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:49:34 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:49:34 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:49:35 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:49:35 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:49:35 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-62452efb-3a12-4aff-9359-217d17fc052a" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:49:35 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-62452efb-3a12-4aff-9359-217d17fc052a" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:49:35 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 12:49:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:36 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Updating instance_info_cache with network_info: [{"id": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "address": "fa:16:3e:c6:61:66", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea59aa7-b9", "ovs_interfaceid": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:49:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-62452efb-3a12-4aff-9359-217d17fc052a" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:49:36 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 12:49:36 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:49:36 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:49:36 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Cleaning up deleted instances {{(pid=71321) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 12:49:36 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] There are 0 instances to clean {{(pid=71321) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 12:49:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:41 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:49:41 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:41 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "508746c9-705a-4d77-a528-454a10299411" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:49:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "508746c9-705a-4d77-a528-454a10299411" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:49:53 user nova-compute[71321]: DEBUG nova.compute.manager [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:49:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:49:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:49:53 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:49:53 user nova-compute[71321]: INFO nova.compute.claims [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Claim successful on node user
Apr 12 12:49:53 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:49:53 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:49:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.304s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:49:53 user nova-compute[71321]: DEBUG nova.compute.manager [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:49:53 user nova-compute[71321]: DEBUG nova.compute.manager [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:49:53 user nova-compute[71321]: DEBUG nova.network.neutron [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:49:53 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:49:53 user nova-compute[71321]: DEBUG nova.compute.manager [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:49:53 user nova-compute[71321]: DEBUG nova.policy [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '924c3a968d734a1c9ddfc5a44d8f6352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f411f36f23e464fa4a395ad6b2b4472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:49:53 user nova-compute[71321]: DEBUG nova.compute.manager [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:49:53 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:49:53 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Creating image(s)
Apr 12 12:49:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "/opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:49:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "/opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:49:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "/opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.017s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:49:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "9cb950505b0632c66d01c462ac37fee3d8fbe1b9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:49:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "9cb950505b0632c66d01c462ac37fee3d8fbe1b9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:49:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cb950505b0632c66d01c462ac37fee3d8fbe1b9.part --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:49:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cb950505b0632c66d01c462ac37fee3d8fbe1b9.part --force-share --output=json" returned: 0 in 0.139s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:49:54 user nova-compute[71321]: DEBUG nova.virt.images [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 71858585-d70e-4cf1-b2dc-0e5921c23e98 was qcow2, converting to raw {{(pid=71321) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 12:49:54 user nova-compute[71321]: DEBUG nova.privsep.utils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 12:49:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9cb950505b0632c66d01c462ac37fee3d8fbe1b9.part /opt/stack/data/nova/instances/_base/9cb950505b0632c66d01c462ac37fee3d8fbe1b9.converted {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:49:54 user nova-compute[71321]: DEBUG nova.network.neutron [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Successfully created port: dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:49:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9cb950505b0632c66d01c462ac37fee3d8fbe1b9.part /opt/stack/data/nova/instances/_base/9cb950505b0632c66d01c462ac37fee3d8fbe1b9.converted" returned: 0 in 0.132s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:49:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cb950505b0632c66d01c462ac37fee3d8fbe1b9.converted --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:49:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cb950505b0632c66d01c462ac37fee3d8fbe1b9.converted --force-share --output=json" returned: 0 in 0.133s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:49:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "9cb950505b0632c66d01c462ac37fee3d8fbe1b9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.774s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:49:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cb950505b0632c66d01c462ac37fee3d8fbe1b9 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:49:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cb950505b0632c66d01c462ac37fee3d8fbe1b9 --force-share --output=json" returned: 0 in 0.133s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:49:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "9cb950505b0632c66d01c462ac37fee3d8fbe1b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:49:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "9cb950505b0632c66d01c462ac37fee3d8fbe1b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:49:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cb950505b0632c66d01c462ac37fee3d8fbe1b9 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cb950505b0632c66d01c462ac37fee3d8fbe1b9 --force-share --output=json" returned: 0 in 0.138s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9cb950505b0632c66d01c462ac37fee3d8fbe1b9,backing_fmt=raw /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9cb950505b0632c66d01c462ac37fee3d8fbe1b9,backing_fmt=raw /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk 1073741824" returned: 0 in 0.059s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "9cb950505b0632c66d01c462ac37fee3d8fbe1b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cb950505b0632c66d01c462ac37fee3d8fbe1b9 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cb950505b0632c66d01c462ac37fee3d8fbe1b9 --force-share --output=json" returned: 0 in 0.140s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Checking if we can resize image /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.network.neutron [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Successfully updated port: dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "refresh_cache-508746c9-705a-4d77-a528-454a10299411" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquired lock "refresh_cache-508746c9-705a-4d77-a528-454a10299411" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.network.neutron [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.network.neutron [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Cannot resize image /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.objects.instance [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lazy-loading 'migration_context' on Instance uuid 508746c9-705a-4d77-a528-454a10299411 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Ensure instance console log exists: /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.network.neutron [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Updating instance_info_cache with network_info: [{"id": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "address": "fa:16:3e:5d:63:5c", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab72490-cd", "ovs_interfaceid": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Releasing lock "refresh_cache-508746c9-705a-4d77-a528-454a10299411" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.compute.manager [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Instance network_info: |[{"id": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "address": "fa:16:3e:5d:63:5c", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab72490-cd", "ovs_interfaceid": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Start _get_guest_xml network_info=[{"id": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "address": "fa:16:3e:5d:63:5c", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab72490-cd", "ovs_interfaceid": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:49:51Z,direct_url=<?>,disk_format='qcow2',id=71858585-d70e-4cf1-b2dc-0e5921c23e98,min_disk=0,min_ram=0,name='tempest-scenario-img--1367985848',owner='2f411f36f23e464fa4a395ad6b2b4472',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:49:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '71858585-d70e-4cf1-b2dc-0e5921c23e98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:49:55 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:49:55 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:49:51Z,direct_url=<?>,disk_format='qcow2',id=71858585-d70e-4cf1-b2dc-0e5921c23e98,min_disk=0,min_ram=0,name='tempest-scenario-img--1367985848',owner='2f411f36f23e464fa4a395ad6b2b4472',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:49:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:49:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1462256376',display_name='tempest-TestMinimumBasicScenario-server-1462256376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1462256376',id=36,image_ref='71858585-d70e-4cf1-b2dc-0e5921c23e98',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzeWBX6IhC7gCQ6w0T3CIjF58xU+K7xE+03Z94BwQAzy1OeRNbL96UH1iSrsClMKm4rn8M5qup/LJ+NKAIWGUUK2r0ARV/KqOHOttU7oRuA6Ty3XfX6ezVU/ChdOvsk/g==',key_name='tempest-TestMinimumBasicScenario-1590711499',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f411f36f23e464fa4a395ad6b2b4472',ramdisk_id='',reservation_id='r-pmi48cyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='71858585-d70e-4cf1-b2dc-0e5921c23e98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-381334085',owner_user_name='tempest-TestMinimumBasicScenario-381334085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:49:54Z,user_data=None,user_id='924c3a968d734a1c9ddfc5a44d8f6352',uuid=508746c9-705a-4d77-a528-454a10299411,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "address": "fa:16:3e:5d:63:5c", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab72490-cd", "ovs_interfaceid": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Converting VIF {"id": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "address": "fa:16:3e:5d:63:5c", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab72490-cd", "ovs_interfaceid": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:63:5c,bridge_name='br-int',has_traffic_filtering=True,id=dab72490-cdfa-4ffa-be0b-feda75d66bcb,network=Network(76f8fc2b-41cf-4efd-9820-c4d4056deaca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab72490-cd') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.objects.instance [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lazy-loading 'pci_devices' on Instance uuid 508746c9-705a-4d77-a528-454a10299411 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:49:55 user nova-compute[71321]:   <uuid>508746c9-705a-4d77-a528-454a10299411</uuid>
Apr 12 12:49:55 user nova-compute[71321]:   <name>instance-00000024</name>
Apr 12 12:49:55 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:49:55 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:49:55 user nova-compute[71321]:   <metadata>
Apr 12 12:49:55 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:49:55 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:49:55 user nova-compute[71321]:       <nova:name>tempest-TestMinimumBasicScenario-server-1462256376</nova:name>
Apr 12 12:49:55 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:49:55</nova:creationTime>
Apr 12 12:49:55 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:49:55 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:49:55 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:49:55 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:49:55 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:49:55 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:49:55 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:49:55 user nova-compute[71321]:       <nova:owner>
Apr 12 12:49:55 user nova-compute[71321]:         <nova:user uuid="924c3a968d734a1c9ddfc5a44d8f6352">tempest-TestMinimumBasicScenario-381334085-project-member</nova:user>
Apr 12 12:49:55 user nova-compute[71321]:         <nova:project uuid="2f411f36f23e464fa4a395ad6b2b4472">tempest-TestMinimumBasicScenario-381334085</nova:project>
Apr 12 12:49:55 user nova-compute[71321]:       </nova:owner>
Apr 12 12:49:55 user nova-compute[71321]:       <nova:root type="image" uuid="71858585-d70e-4cf1-b2dc-0e5921c23e98"/>
Apr 12 12:49:55 user nova-compute[71321]:       <nova:ports>
Apr 12 12:49:55 user nova-compute[71321]:         <nova:port uuid="dab72490-cdfa-4ffa-be0b-feda75d66bcb">
Apr 12 12:49:55 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 12:49:55 user nova-compute[71321]:         </nova:port>
Apr 12 12:49:55 user nova-compute[71321]:       </nova:ports>
Apr 12 12:49:55 user nova-compute[71321]:     </nova:instance>
Apr 12 12:49:55 user nova-compute[71321]:   </metadata>
Apr 12 12:49:55 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:49:55 user nova-compute[71321]:     <system>
Apr 12 12:49:55 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:49:55 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:49:55 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:49:55 user nova-compute[71321]:       <entry name="serial">508746c9-705a-4d77-a528-454a10299411</entry>
Apr 12 12:49:55 user nova-compute[71321]:       <entry name="uuid">508746c9-705a-4d77-a528-454a10299411</entry>
Apr 12 12:49:55 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:49:55 user nova-compute[71321]:     </system>
Apr 12 12:49:55 user nova-compute[71321]:   </sysinfo>
Apr 12 12:49:55 user nova-compute[71321]:   <os>
Apr 12 12:49:55 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:49:55 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:49:55 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:49:55 user nova-compute[71321]:   </os>
Apr 12 12:49:55 user nova-compute[71321]:   <features>
Apr 12 12:49:55 user nova-compute[71321]:     <acpi/>
Apr 12 12:49:55 user nova-compute[71321]:     <apic/>
Apr 12 12:49:55 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:49:55 user nova-compute[71321]:   </features>
Apr 12 12:49:55 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:49:55 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:49:55 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:49:55 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:49:55 user nova-compute[71321]:   </clock>
Apr 12 12:49:55 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:49:55 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:49:55 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:49:55 user nova-compute[71321]:   </cpu>
Apr 12 12:49:55 user nova-compute[71321]:   <devices>
Apr 12 12:49:55 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:49:55 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:49:55 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk"/>
Apr 12 12:49:55 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:49:55 user nova-compute[71321]:     </disk>
Apr 12 12:49:55 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:49:55 user nova-compute[71321]:       <mac address="fa:16:3e:5d:63:5c"/>
Apr 12 12:49:55 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:49:55 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:49:55 user nova-compute[71321]:       <target dev="tapdab72490-cd"/>
Apr 12 12:49:55 user nova-compute[71321]:     </interface>
Apr 12 12:49:55 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:49:55 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/console.log" append="off"/>
Apr 12 12:49:55 user nova-compute[71321]:     </serial>
Apr 12 12:49:55 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:49:55 user nova-compute[71321]:     <video>
Apr 12 12:49:55 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:49:55 user nova-compute[71321]:     </video>
Apr 12 12:49:55 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:49:55 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:49:55 user nova-compute[71321]:     </rng>
Apr 12 12:49:55 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:49:55 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:49:55 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:49:55 user nova-compute[71321]:     </memballoon>
Apr 12 12:49:55 user nova-compute[71321]:   </devices>
Apr 12 12:49:55 user nova-compute[71321]: </domain>
Apr 12 12:49:55 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:49:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1462256376',display_name='tempest-TestMinimumBasicScenario-server-1462256376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1462256376',id=36,image_ref='71858585-d70e-4cf1-b2dc-0e5921c23e98',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzeWBX6IhC7gCQ6w0T3CIjF58xU+K7xE+03Z94BwQAzy1OeRNbL96UH1iSrsClMKm4rn8M5qup/LJ+NKAIWGUUK2r0ARV/KqOHOttU7oRuA6Ty3XfX6ezVU/ChdOvsk/g==',key_name='tempest-TestMinimumBasicScenario-1590711499',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f411f36f23e464fa4a395ad6b2b4472',ramdisk_id='',reservation_id='r-pmi48cyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='71858585-d70e-4cf1-b2dc-0e5921c23e98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-381334085',owner_user_name='tempest-TestMinimumBasicScenario-381334085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:49:54Z,user_data=None,user_id='924c3a968d734a1c9ddfc5a44d8f6352',uuid=508746c9-705a-4d77-a528-454a10299411,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "address": "fa:16:3e:5d:63:5c", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab72490-cd", "ovs_interfaceid": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Converting VIF {"id": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "address": "fa:16:3e:5d:63:5c", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab72490-cd", "ovs_interfaceid": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:63:5c,bridge_name='br-int',has_traffic_filtering=True,id=dab72490-cdfa-4ffa-be0b-feda75d66bcb,network=Network(76f8fc2b-41cf-4efd-9820-c4d4056deaca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab72490-cd') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG os_vif [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:63:5c,bridge_name='br-int',has_traffic_filtering=True,id=dab72490-cdfa-4ffa-be0b-feda75d66bcb,network=Network(76f8fc2b-41cf-4efd-9820-c4d4056deaca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab72490-cd') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdab72490-cd, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdab72490-cd, col_values=(('external_ids', {'iface-id': 'dab72490-cdfa-4ffa-be0b-feda75d66bcb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:63:5c', 'vm-uuid': '508746c9-705a-4d77-a528-454a10299411'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.compute.manager [req-eb62d836-7fd2-4455-af4f-24db5671bd17 req-1e5ba205-1862-4bb8-a00b-fd3e34aaae86 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Received event network-changed-dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.compute.manager [req-eb62d836-7fd2-4455-af4f-24db5671bd17 req-1e5ba205-1862-4bb8-a00b-fd3e34aaae86 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Refreshing instance network info cache due to event network-changed-dab72490-cdfa-4ffa-be0b-feda75d66bcb. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-eb62d836-7fd2-4455-af4f-24db5671bd17 req-1e5ba205-1862-4bb8-a00b-fd3e34aaae86 service nova] Acquiring lock "refresh_cache-508746c9-705a-4d77-a528-454a10299411" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-eb62d836-7fd2-4455-af4f-24db5671bd17 req-1e5ba205-1862-4bb8-a00b-fd3e34aaae86 service nova] Acquired lock "refresh_cache-508746c9-705a-4d77-a528-454a10299411" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.network.neutron [req-eb62d836-7fd2-4455-af4f-24db5671bd17 req-1e5ba205-1862-4bb8-a00b-fd3e34aaae86 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Refreshing network info cache for port dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:55 user nova-compute[71321]: INFO os_vif [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:63:5c,bridge_name='br-int',has_traffic_filtering=True,id=dab72490-cdfa-4ffa-be0b-feda75d66bcb,network=Network(76f8fc2b-41cf-4efd-9820-c4d4056deaca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab72490-cd')
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:49:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] No VIF found with MAC fa:16:3e:5d:63:5c, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:49:56 user nova-compute[71321]: DEBUG nova.network.neutron [req-eb62d836-7fd2-4455-af4f-24db5671bd17 req-1e5ba205-1862-4bb8-a00b-fd3e34aaae86 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Updated VIF entry in instance network info cache for port dab72490-cdfa-4ffa-be0b-feda75d66bcb. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:49:56 user nova-compute[71321]: DEBUG nova.network.neutron [req-eb62d836-7fd2-4455-af4f-24db5671bd17 req-1e5ba205-1862-4bb8-a00b-fd3e34aaae86 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Updating instance_info_cache with network_info: [{"id": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "address": "fa:16:3e:5d:63:5c", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab72490-cd", "ovs_interfaceid": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:49:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-eb62d836-7fd2-4455-af4f-24db5671bd17 req-1e5ba205-1862-4bb8-a00b-fd3e34aaae86 service nova] Releasing lock "refresh_cache-508746c9-705a-4d77-a528-454a10299411" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:49:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:57 user nova-compute[71321]: DEBUG nova.compute.manager [req-af6ed0d6-9a81-43c0-bbd6-531675a591dd req-5a2f5966-2b3f-4740-8306-49aca5428b2f service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Received event network-vif-plugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:49:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-af6ed0d6-9a81-43c0-bbd6-531675a591dd req-5a2f5966-2b3f-4740-8306-49aca5428b2f service nova] Acquiring lock "508746c9-705a-4d77-a528-454a10299411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:49:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-af6ed0d6-9a81-43c0-bbd6-531675a591dd req-5a2f5966-2b3f-4740-8306-49aca5428b2f service nova] Lock "508746c9-705a-4d77-a528-454a10299411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:49:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-af6ed0d6-9a81-43c0-bbd6-531675a591dd req-5a2f5966-2b3f-4740-8306-49aca5428b2f service nova] Lock "508746c9-705a-4d77-a528-454a10299411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:49:57 user nova-compute[71321]: DEBUG nova.compute.manager [req-af6ed0d6-9a81-43c0-bbd6-531675a591dd req-5a2f5966-2b3f-4740-8306-49aca5428b2f service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] No waiting events found dispatching network-vif-plugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:49:57 user nova-compute[71321]: WARNING nova.compute.manager [req-af6ed0d6-9a81-43c0-bbd6-531675a591dd req-5a2f5966-2b3f-4740-8306-49aca5428b2f service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Received unexpected event network-vif-plugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb for instance with vm_state building and task_state spawning.
Apr 12 12:49:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:49:59 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303799.4602215, 508746c9-705a-4d77-a528-454a10299411 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:49:59 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 508746c9-705a-4d77-a528-454a10299411] VM Resumed (Lifecycle Event)
Apr 12 12:49:59 user nova-compute[71321]: DEBUG nova.compute.manager [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:49:59 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:49:59 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 508746c9-705a-4d77-a528-454a10299411] Instance spawned successfully.
Apr 12 12:49:59 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:49:59 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 508746c9-705a-4d77-a528-454a10299411] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:49:59 user nova-compute[71321]: DEBUG nova.compute.manager [req-a5c73f44-bcca-4b46-b070-b86bb51a0e91 req-3cde691d-f916-453e-aa8d-44c23dc0295b service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Received event network-vif-plugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:49:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a5c73f44-bcca-4b46-b070-b86bb51a0e91 req-3cde691d-f916-453e-aa8d-44c23dc0295b service nova] Acquiring lock "508746c9-705a-4d77-a528-454a10299411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:49:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a5c73f44-bcca-4b46-b070-b86bb51a0e91 req-3cde691d-f916-453e-aa8d-44c23dc0295b service nova] Lock "508746c9-705a-4d77-a528-454a10299411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:49:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a5c73f44-bcca-4b46-b070-b86bb51a0e91 req-3cde691d-f916-453e-aa8d-44c23dc0295b service nova] Lock "508746c9-705a-4d77-a528-454a10299411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:49:59 user nova-compute[71321]: DEBUG nova.compute.manager [req-a5c73f44-bcca-4b46-b070-b86bb51a0e91 req-3cde691d-f916-453e-aa8d-44c23dc0295b service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] No waiting events found dispatching network-vif-plugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:49:59 user nova-compute[71321]: WARNING nova.compute.manager [req-a5c73f44-bcca-4b46-b070-b86bb51a0e91 req-3cde691d-f916-453e-aa8d-44c23dc0295b service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Received unexpected event network-vif-plugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb for instance with vm_state building and task_state spawning.
Apr 12 12:49:59 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 508746c9-705a-4d77-a528-454a10299411] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:49:59 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:49:59 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:49:59 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:49:59 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:49:59 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:49:59 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:49:59 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 508746c9-705a-4d77-a528-454a10299411] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:49:59 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303799.462075, 508746c9-705a-4d77-a528-454a10299411 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:49:59 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 508746c9-705a-4d77-a528-454a10299411] VM Started (Lifecycle Event)
Apr 12 12:49:59 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 508746c9-705a-4d77-a528-454a10299411] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:49:59 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 508746c9-705a-4d77-a528-454a10299411] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:49:59 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 508746c9-705a-4d77-a528-454a10299411] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:49:59 user nova-compute[71321]: INFO nova.compute.manager [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Took 5.65 seconds to spawn the instance on the hypervisor.
Apr 12 12:49:59 user nova-compute[71321]: DEBUG nova.compute.manager [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:49:59 user nova-compute[71321]: INFO nova.compute.manager [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Took 6.28 seconds to build instance.
Apr 12 12:49:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "508746c9-705a-4d77-a528-454a10299411" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.434s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:50:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:03 user nova-compute[71321]: DEBUG nova.compute.manager [req-1e76382f-919e-4681-bcf7-19e7cef0664a req-131311cf-34b2-4b85-a75c-c80519573859 service nova] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Received event network-changed-d5393827-131c-4d5f-8135-1cfab67f5779 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:50:03 user nova-compute[71321]: DEBUG nova.compute.manager [req-1e76382f-919e-4681-bcf7-19e7cef0664a req-131311cf-34b2-4b85-a75c-c80519573859 service nova] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Refreshing instance network info cache due to event network-changed-d5393827-131c-4d5f-8135-1cfab67f5779. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:50:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-1e76382f-919e-4681-bcf7-19e7cef0664a req-131311cf-34b2-4b85-a75c-c80519573859 service nova] Acquiring lock "refresh_cache-c11aafa6-a6fa-44f2-8357-23d838a0b65a" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:50:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-1e76382f-919e-4681-bcf7-19e7cef0664a req-131311cf-34b2-4b85-a75c-c80519573859 service nova] Acquired lock "refresh_cache-c11aafa6-a6fa-44f2-8357-23d838a0b65a" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:50:03 user nova-compute[71321]: DEBUG nova.network.neutron [req-1e76382f-919e-4681-bcf7-19e7cef0664a req-131311cf-34b2-4b85-a75c-c80519573859 service nova] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Refreshing network info cache for port d5393827-131c-4d5f-8135-1cfab67f5779 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:50:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-f2092732-fa46-4c7d-9a31-6687ba61aa76 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "c11aafa6-a6fa-44f2-8357-23d838a0b65a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:50:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-f2092732-fa46-4c7d-9a31-6687ba61aa76 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "c11aafa6-a6fa-44f2-8357-23d838a0b65a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:50:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-f2092732-fa46-4c7d-9a31-6687ba61aa76 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "c11aafa6-a6fa-44f2-8357-23d838a0b65a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:50:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-f2092732-fa46-4c7d-9a31-6687ba61aa76 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "c11aafa6-a6fa-44f2-8357-23d838a0b65a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:50:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-f2092732-fa46-4c7d-9a31-6687ba61aa76 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "c11aafa6-a6fa-44f2-8357-23d838a0b65a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:50:04 user nova-compute[71321]: INFO nova.compute.manager [None req-f2092732-fa46-4c7d-9a31-6687ba61aa76 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Terminating instance
Apr 12 12:50:04 user nova-compute[71321]: DEBUG nova.compute.manager [None req-f2092732-fa46-4c7d-9a31-6687ba61aa76 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:50:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:04 user nova-compute[71321]: DEBUG nova.network.neutron [req-1e76382f-919e-4681-bcf7-19e7cef0664a req-131311cf-34b2-4b85-a75c-c80519573859 service nova] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Updated VIF entry in instance network info cache for port d5393827-131c-4d5f-8135-1cfab67f5779. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:50:04 user nova-compute[71321]: DEBUG nova.network.neutron [req-1e76382f-919e-4681-bcf7-19e7cef0664a req-131311cf-34b2-4b85-a75c-c80519573859 service nova] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Updating instance_info_cache with network_info: [{"id": "d5393827-131c-4d5f-8135-1cfab67f5779", "address": "fa:16:3e:36:3f:d5", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5393827-13", "ovs_interfaceid": "d5393827-131c-4d5f-8135-1cfab67f5779", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:50:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-1e76382f-919e-4681-bcf7-19e7cef0664a req-131311cf-34b2-4b85-a75c-c80519573859 service nova] Releasing lock "refresh_cache-c11aafa6-a6fa-44f2-8357-23d838a0b65a" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:50:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:04 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Instance destroyed successfully.
Apr 12 12:50:04 user nova-compute[71321]: DEBUG nova.objects.instance [None req-f2092732-fa46-4c7d-9a31-6687ba61aa76 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lazy-loading 'resources' on Instance uuid c11aafa6-a6fa-44f2-8357-23d838a0b65a {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:50:04 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-f2092732-fa46-4c7d-9a31-6687ba61aa76 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:48:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1049944683',display_name='tempest-AttachVolumeNegativeTest-server-1049944683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1049944683',id=35,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKvgz8aLXkL1UKXgloE5a0NO7Dnov3h6aO83UrmYprW5fb0WDb7wXSnzJjb5RIqLorBqNq22tT9Q0H5PncM/xbLBZ+QGt4OD9dIDTA8doC20Ehow9LLFhPvQBMpGLeJjw==',key_name='tempest-keypair-465886863',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:48:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e61975273ccb41229e0138b96eb7f5e9',ramdisk_id='',reservation_id='r-3p34eqr6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-941338837',owner_user_name='tempest-AttachVolumeNegativeTest-941338837-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:48:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3d9f4516bee4f8d9af7a40ed1298f03',uuid=c11aafa6-a6fa-44f2-8357-23d838a0b65a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5393827-131c-4d5f-8135-1cfab67f5779", "address": "fa:16:3e:36:3f:d5", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5393827-13", "ovs_interfaceid": "d5393827-131c-4d5f-8135-1cfab67f5779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:50:04 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-f2092732-fa46-4c7d-9a31-6687ba61aa76 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Converting VIF {"id": "d5393827-131c-4d5f-8135-1cfab67f5779", "address": "fa:16:3e:36:3f:d5", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5393827-13", "ovs_interfaceid": "d5393827-131c-4d5f-8135-1cfab67f5779", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:50:04 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-f2092732-fa46-4c7d-9a31-6687ba61aa76 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:3f:d5,bridge_name='br-int',has_traffic_filtering=True,id=d5393827-131c-4d5f-8135-1cfab67f5779,network=Network(e211a286-ade0-4930-a327-4c6a41785094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5393827-13') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:50:04 user nova-compute[71321]: DEBUG os_vif [None req-f2092732-fa46-4c7d-9a31-6687ba61aa76 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:3f:d5,bridge_name='br-int',has_traffic_filtering=True,id=d5393827-131c-4d5f-8135-1cfab67f5779,network=Network(e211a286-ade0-4930-a327-4c6a41785094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5393827-13') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:50:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5393827-13, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:50:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:50:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:04 user nova-compute[71321]: INFO os_vif [None req-f2092732-fa46-4c7d-9a31-6687ba61aa76 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:3f:d5,bridge_name='br-int',has_traffic_filtering=True,id=d5393827-131c-4d5f-8135-1cfab67f5779,network=Network(e211a286-ade0-4930-a327-4c6a41785094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5393827-13')
Apr 12 12:50:04 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-f2092732-fa46-4c7d-9a31-6687ba61aa76 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Deleting instance files /opt/stack/data/nova/instances/c11aafa6-a6fa-44f2-8357-23d838a0b65a_del
Apr 12 12:50:04 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-f2092732-fa46-4c7d-9a31-6687ba61aa76 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Deletion of /opt/stack/data/nova/instances/c11aafa6-a6fa-44f2-8357-23d838a0b65a_del complete
Apr 12 12:50:04 user nova-compute[71321]: INFO nova.compute.manager [None req-f2092732-fa46-4c7d-9a31-6687ba61aa76 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Took 0.65 seconds to destroy the instance on the hypervisor.
Apr 12 12:50:04 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-f2092732-fa46-4c7d-9a31-6687ba61aa76 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:50:04 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:50:04 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:50:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:05 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:50:05 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Took 0.73 seconds to deallocate network for instance.
Apr 12 12:50:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-f2092732-fa46-4c7d-9a31-6687ba61aa76 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:50:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-f2092732-fa46-4c7d-9a31-6687ba61aa76 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:50:05 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-f2092732-fa46-4c7d-9a31-6687ba61aa76 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:50:05 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-f2092732-fa46-4c7d-9a31-6687ba61aa76 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:50:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-f2092732-fa46-4c7d-9a31-6687ba61aa76 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.267s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:50:06 user nova-compute[71321]: DEBUG nova.compute.manager [req-ffeef03a-254a-4f4b-bfcf-21b589f57159 req-a070b2db-3ed8-4a7a-99d4-136e18655edf service nova] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Received event network-vif-unplugged-d5393827-131c-4d5f-8135-1cfab67f5779 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:50:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ffeef03a-254a-4f4b-bfcf-21b589f57159 req-a070b2db-3ed8-4a7a-99d4-136e18655edf service nova] Acquiring lock "c11aafa6-a6fa-44f2-8357-23d838a0b65a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:50:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ffeef03a-254a-4f4b-bfcf-21b589f57159 req-a070b2db-3ed8-4a7a-99d4-136e18655edf service nova] Lock "c11aafa6-a6fa-44f2-8357-23d838a0b65a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:50:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ffeef03a-254a-4f4b-bfcf-21b589f57159 req-a070b2db-3ed8-4a7a-99d4-136e18655edf service nova] Lock "c11aafa6-a6fa-44f2-8357-23d838a0b65a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:50:06 user nova-compute[71321]: DEBUG nova.compute.manager [req-ffeef03a-254a-4f4b-bfcf-21b589f57159 req-a070b2db-3ed8-4a7a-99d4-136e18655edf service nova] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] No waiting events found dispatching network-vif-unplugged-d5393827-131c-4d5f-8135-1cfab67f5779 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:50:06 user nova-compute[71321]: WARNING nova.compute.manager [req-ffeef03a-254a-4f4b-bfcf-21b589f57159 req-a070b2db-3ed8-4a7a-99d4-136e18655edf service nova] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Received unexpected event network-vif-unplugged-d5393827-131c-4d5f-8135-1cfab67f5779 for instance with vm_state deleted and task_state None.
Apr 12 12:50:06 user nova-compute[71321]: DEBUG nova.compute.manager [req-ffeef03a-254a-4f4b-bfcf-21b589f57159 req-a070b2db-3ed8-4a7a-99d4-136e18655edf service nova] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Received event network-vif-plugged-d5393827-131c-4d5f-8135-1cfab67f5779 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:50:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ffeef03a-254a-4f4b-bfcf-21b589f57159 req-a070b2db-3ed8-4a7a-99d4-136e18655edf service nova] Acquiring lock "c11aafa6-a6fa-44f2-8357-23d838a0b65a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:50:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ffeef03a-254a-4f4b-bfcf-21b589f57159 req-a070b2db-3ed8-4a7a-99d4-136e18655edf service nova] Lock "c11aafa6-a6fa-44f2-8357-23d838a0b65a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:50:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ffeef03a-254a-4f4b-bfcf-21b589f57159 req-a070b2db-3ed8-4a7a-99d4-136e18655edf service nova] Lock "c11aafa6-a6fa-44f2-8357-23d838a0b65a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:50:06 user nova-compute[71321]: DEBUG nova.compute.manager [req-ffeef03a-254a-4f4b-bfcf-21b589f57159 req-a070b2db-3ed8-4a7a-99d4-136e18655edf service nova] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] No waiting events found dispatching network-vif-plugged-d5393827-131c-4d5f-8135-1cfab67f5779 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:50:06 user nova-compute[71321]: WARNING nova.compute.manager [req-ffeef03a-254a-4f4b-bfcf-21b589f57159 req-a070b2db-3ed8-4a7a-99d4-136e18655edf service nova] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Received unexpected event network-vif-plugged-d5393827-131c-4d5f-8135-1cfab67f5779 for instance with vm_state deleted and task_state None.
Apr 12 12:50:06 user nova-compute[71321]: DEBUG nova.compute.manager [req-ffeef03a-254a-4f4b-bfcf-21b589f57159 req-a070b2db-3ed8-4a7a-99d4-136e18655edf service nova] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Received event network-vif-deleted-d5393827-131c-4d5f-8135-1cfab67f5779 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:50:06 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-f2092732-fa46-4c7d-9a31-6687ba61aa76 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Deleted allocations for instance c11aafa6-a6fa-44f2-8357-23d838a0b65a
Apr 12 12:50:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-f2092732-fa46-4c7d-9a31-6687ba61aa76 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "c11aafa6-a6fa-44f2-8357-23d838a0b65a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.891s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:50:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:19 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681303804.819974, c11aafa6-a6fa-44f2-8357-23d838a0b65a => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:50:19 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] VM Stopped (Lifecycle Event)
Apr 12 12:50:19 user nova-compute[71321]: DEBUG nova.compute.manager [None req-d38f320e-0d3e-4585-9ebb-2feddc3058d1 None None] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:50:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:20 user nova-compute[71321]: INFO nova.compute.manager [None req-43b4ff65-c4b9-4dc9-9a86-c23086d817e0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Get console output
Apr 12 12:50:20 user nova-compute[71321]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Apr 12 12:50:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:24 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:29 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:50:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:50:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:50:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:50:29 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:50:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:50:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:30 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:50:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:30 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:50:31 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:50:31 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:50:31 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8387MB free_disk=26.33324432373047GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:50:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:50:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:50:31 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:50:31 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:50:31 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 62452efb-3a12-4aff-9359-217d17fc052a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:50:31 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance db9f1454-9e3c-40d4-849b-c13537d6be97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:50:31 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 508746c9-705a-4d77-a528-454a10299411 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:50:31 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:50:31 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=1216MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:50:31 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Refreshing inventories for resource provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 12:50:31 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Updating ProviderTree inventory for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 12:50:31 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Updating inventory in ProviderTree for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 12:50:31 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Refreshing aggregate associations for resource provider 7ca624fd-d5cc-42af-93e3-9d62256fa231, aggregates: None {{(pid=71321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 12:50:31 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Refreshing trait associations for resource provider 7ca624fd-d5cc-42af-93e3-9d62256fa231, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=71321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 12:50:31 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:50:31 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:50:31 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:50:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.477s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:50:32 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:50:32 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:50:32 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:50:32 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:50:33 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:50:33 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:50:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:36 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:50:36 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:50:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:50:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:50:36 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 12:50:37 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Updating instance_info_cache with network_info: [{"id": "968b45e2-1ead-4fdd-a879-52ebb15f5b6a", "address": "fa:16:3e:d7:03:df", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap968b45e2-1e", "ovs_interfaceid": "968b45e2-1ead-4fdd-a879-52ebb15f5b6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:50:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:50:37 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 12:50:37 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:50:37 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:50:39 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:42 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:50:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:50:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG nova.objects.instance [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'flavor' on Instance uuid db9f1454-9e3c-40d4-849b-c13537d6be97 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "refresh_cache-db9f1454-9e3c-40d4-849b-c13537d6be97" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquired lock "refresh_cache-db9f1454-9e3c-40d4-849b-c13537d6be97" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG nova.network.neutron [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG nova.objects.instance [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'info_cache' on Instance uuid db9f1454-9e3c-40d4-849b-c13537d6be97 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG nova.network.neutron [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Updating instance_info_cache with network_info: [{"id": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "address": "fa:16:3e:c8:2c:e7", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30bdfa-5f", "ovs_interfaceid": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Releasing lock "refresh_cache-db9f1454-9e3c-40d4-849b-c13537d6be97" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:50:46 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Instance destroyed successfully.
Apr 12 12:50:46 user nova-compute[71321]: DEBUG nova.objects.instance [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'resources' on Instance uuid db9f1454-9e3c-40d4-849b-c13537d6be97 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:46:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1788527008',display_name='tempest-AttachVolumeTestJSON-server-1788527008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1788527008',id=34,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuwf936taYEtQ87HL5K7RLSYNC7EYwzjJGVWMdDWY17MG7jKDK8n6UiYp0Wx2O8W7vbPN1WZy4g++M2EnVpaeEZHV1BaHycanzlOj8OAfSm/y0qUI9XhqdtXcmqo6mDGg==',key_name='tempest-keypair-1238241126',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:47:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a0e6aaaa9a634f349d371f7c6c15eca2',ramdisk_id='',reservation_id='r-mamvz059',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-905742219',owner_user_name='tempest-AttachVolumeTestJSON-905742219-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:48:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a9c54033c7547c2bae91e6c1dba0976',uuid=db9f1454-9e3c-40d4-849b-c13537d6be97,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "address": "fa:16:3e:c8:2c:e7", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30bdfa-5f", "ovs_interfaceid": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Converting VIF {"id": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "address": "fa:16:3e:c8:2c:e7", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30bdfa-5f", "ovs_interfaceid": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:2c:e7,bridge_name='br-int',has_traffic_filtering=True,id=9c30bdfa-5f39-4454-af8b-f2ccd880807b,network=Network(e1afe3b3-a919-4800-9f1c-c8e602defd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c30bdfa-5f') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG os_vif [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:2c:e7,bridge_name='br-int',has_traffic_filtering=True,id=9c30bdfa-5f39-4454-af8b-f2ccd880807b,network=Network(e1afe3b3-a919-4800-9f1c-c8e602defd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c30bdfa-5f') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c30bdfa-5f, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:50:46 user nova-compute[71321]: INFO os_vif [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:2c:e7,bridge_name='br-int',has_traffic_filtering=True,id=9c30bdfa-5f39-4454-af8b-f2ccd880807b,network=Network(e1afe3b3-a919-4800-9f1c-c8e602defd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c30bdfa-5f')
Apr 12 12:50:46 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vFhwTVmp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:50:46 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:50:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc0ea2e-fa0e-4d06-be66-9592d517b96c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:50:46 user nova-compute[71321]: No targets found.
Apr 12 12:50:46 user nova-compute[71321]: iSNS:
Apr 12 12:50:46 user nova-compute[71321]: No targets found.
Apr 12 12:50:46 user nova-compute[71321]: STATIC:
Apr 12 12:50:46 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010
Apr 12 12:50:46 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:50:46 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:50:46 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491
Apr 12 12:50:46 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:50:46 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:50:46 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06
Apr 12 12:50:46 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:50:46 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:50:46 user nova-compute[71321]: FIRMWARE:
Apr 12 12:50:46 user nova-compute[71321]: No targets found.
Apr 12 12:50:46 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:50:46 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:50:46 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c27a8c-7316-4543-b01f-f5572faca50c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e02538c-ea2f-466a-b203-a84ebfda5fb5]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)
Apr 12 12:50:46 user nova-compute[71321]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 (non-flash)
Apr 12 12:50:46 user nova-compute[71321]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 (non-flash)
Apr 12 12:50:46 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)
Apr 12 12:50:46 user nova-compute[71321]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 (non-flash)
Apr 12 12:50:46 user nova-compute[71321]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 (non-flash)
Apr 12 12:50:46 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef7c1efc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06'): ({'sdd'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Removing single pathed devices sdd {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[989af45c-1693-4292-be71-043e4cdfe563]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[da579860-8944-41da-910e-8f62178e5870]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Flushing IO for device /dev/sdd {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[22280efb-d1c9-49ff-8d28-874e2f19b89e]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.033s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4d2839-e73f-4441-8d0b-03076e2a85df]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] SCSI volumes sdd have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[316bac22-8be5-4341-b1a9-aa0a5435196f]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:50:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d2ab63-67be-4f1f-8ed7-c75d07ff4206]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06, portal: 172.16.0.220,3260]
Apr 12 12:50:47 user nova-compute[71321]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06, portal: 172.16.0.220,3260] successful.
Apr 12 12:50:47 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[538bb4ed-e6fb-475b-923f-0e4a3cd8068c]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] <== disconnect_volume: return (309ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Start _get_guest_xml network_info=[{"id": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "address": "fa:16:3e:c8:2c:e7", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30bdfa-5f", "ovs_interfaceid": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '28dab7f5-23ad-4b36-9f52-f8a13746cfa0', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vFhwTVmp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'db9f1454-9e3c-40d4-849b-c13537d6be97', 'attached_at': '', 'detached_at': '', 'volume_id': '02c22408-e0c3-41e4-817c-dc6057451b06', 'serial': '02c22408-e0c3-41e4-817c-dc6057451b06'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG nova.objects.instance [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'numa_topology' on Instance uuid db9f1454-9e3c-40d4-849b-c13537d6be97 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:50:47 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:50:47 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:50:47 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG nova.objects.instance [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'vcpu_model' on Instance uuid db9f1454-9e3c-40d4-849b-c13537d6be97 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vFhwTVmp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:50:47 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:50:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:50:47 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:50:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:50:47 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e169dcf9-e382-4910-b790-9df4f7ff1adc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:50:47 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c5ba42-b1fd-4cf2-8ca1-df6c23f85bf8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06] added
Apr 12 12:50:47 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.172s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8bc33b-72af-44ab-b369-149d66a81b90]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd79e2e8-ba72-46ca-b634-a4905addd654]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vFhwTVmp {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vFhwTVmp" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33cece8-fdd3-45eb-99a5-8577c9cd2142]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vFhwTVmp'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e615a054-3d1e-4eab-b7de-7df461213ef2]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1541c34d-fc79-4582-be7f-faca828c2c9b]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)
Apr 12 12:50:47 user nova-compute[71321]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 (non-flash)
Apr 12 12:50:47 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)
Apr 12 12:50:47 user nova-compute[71321]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 (non-flash)
Apr 12 12:50:47 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfd9848-74e8-4330-a74f-066191dd3cac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06, portal: 172.16.0.220,3260]
Apr 12 12:50:47 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06, portal: 172.16.0.220,3260] successful.
Apr 12 12:50:47 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d86271-2148-4453-a473-8d5d7e53cd35]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9e3cc9-52d5-4011-8689-793e909231c3]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)
Apr 12 12:50:47 user nova-compute[71321]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 (non-flash)
Apr 12 12:50:47 user nova-compute[71321]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 (non-flash)
Apr 12 12:50:47 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)
Apr 12 12:50:47 user nova-compute[71321]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 (non-flash)
Apr 12 12:50:47 user nova-compute[71321]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 (non-flash)
Apr 12 12:50:47 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.428s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1caff28e-479e-4e7b-bade-5125df7a250f]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:50:47 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vFhwTVmp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:50:48 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.462s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:50:48 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] <== connect_volume: return (1464ms) {'type': 'block', 'scsi_wwn': '26430623732663136', 'path': '/dev/sdd'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:50:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430623732663136', 'path': '/dev/sdd'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:50:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:46:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1788527008',display_name='tempest-AttachVolumeTestJSON-server-1788527008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1788527008',id=34,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuwf936taYEtQ87HL5K7RLSYNC7EYwzjJGVWMdDWY17MG7jKDK8n6UiYp0Wx2O8W7vbPN1WZy4g++M2EnVpaeEZHV1BaHycanzlOj8OAfSm/y0qUI9XhqdtXcmqo6mDGg==',key_name='tempest-keypair-1238241126',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:47:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a0e6aaaa9a634f349d371f7c6c15eca2',ramdisk_id='',reservation_id='r-mamvz059',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-905742219',owner_user_name='tempest-AttachVolumeTestJSON-905742219-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:48:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a9c54033c7547c2bae91e6c1dba0976',uuid=db9f1454-9e3c-40d4-849b-c13537d6be97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "address": "fa:16:3e:c8:2c:e7", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30bdfa-5f", "ovs_interfaceid": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:50:48 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Converting VIF {"id": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "address": "fa:16:3e:c8:2c:e7", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30bdfa-5f", "ovs_interfaceid": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:50:48 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:2c:e7,bridge_name='br-int',has_traffic_filtering=True,id=9c30bdfa-5f39-4454-af8b-f2ccd880807b,network=Network(e1afe3b3-a919-4800-9f1c-c8e602defd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c30bdfa-5f') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:50:48 user nova-compute[71321]: DEBUG nova.objects.instance [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'pci_devices' on Instance uuid db9f1454-9e3c-40d4-849b-c13537d6be97 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:50:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:50:48 user nova-compute[71321]:   <uuid>db9f1454-9e3c-40d4-849b-c13537d6be97</uuid>
Apr 12 12:50:48 user nova-compute[71321]:   <name>instance-00000022</name>
Apr 12 12:50:48 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:50:48 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:50:48 user nova-compute[71321]:   <metadata>
Apr 12 12:50:48 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:50:48 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:50:48 user nova-compute[71321]:       <nova:name>tempest-AttachVolumeTestJSON-server-1788527008</nova:name>
Apr 12 12:50:48 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:50:47</nova:creationTime>
Apr 12 12:50:48 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:50:48 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:50:48 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:50:48 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:50:48 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:50:48 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:50:48 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:50:48 user nova-compute[71321]:       <nova:owner>
Apr 12 12:50:48 user nova-compute[71321]:         <nova:user uuid="8a9c54033c7547c2bae91e6c1dba0976">tempest-AttachVolumeTestJSON-905742219-project-member</nova:user>
Apr 12 12:50:48 user nova-compute[71321]:         <nova:project uuid="a0e6aaaa9a634f349d371f7c6c15eca2">tempest-AttachVolumeTestJSON-905742219</nova:project>
Apr 12 12:50:48 user nova-compute[71321]:       </nova:owner>
Apr 12 12:50:48 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:50:48 user nova-compute[71321]:       <nova:ports>
Apr 12 12:50:48 user nova-compute[71321]:         <nova:port uuid="9c30bdfa-5f39-4454-af8b-f2ccd880807b">
Apr 12 12:50:48 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 12:50:48 user nova-compute[71321]:         </nova:port>
Apr 12 12:50:48 user nova-compute[71321]:       </nova:ports>
Apr 12 12:50:48 user nova-compute[71321]:     </nova:instance>
Apr 12 12:50:48 user nova-compute[71321]:   </metadata>
Apr 12 12:50:48 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:50:48 user nova-compute[71321]:     <system>
Apr 12 12:50:48 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:50:48 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:50:48 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:50:48 user nova-compute[71321]:       <entry name="serial">db9f1454-9e3c-40d4-849b-c13537d6be97</entry>
Apr 12 12:50:48 user nova-compute[71321]:       <entry name="uuid">db9f1454-9e3c-40d4-849b-c13537d6be97</entry>
Apr 12 12:50:48 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:50:48 user nova-compute[71321]:     </system>
Apr 12 12:50:48 user nova-compute[71321]:   </sysinfo>
Apr 12 12:50:48 user nova-compute[71321]:   <os>
Apr 12 12:50:48 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:50:48 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:50:48 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:50:48 user nova-compute[71321]:   </os>
Apr 12 12:50:48 user nova-compute[71321]:   <features>
Apr 12 12:50:48 user nova-compute[71321]:     <acpi/>
Apr 12 12:50:48 user nova-compute[71321]:     <apic/>
Apr 12 12:50:48 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:50:48 user nova-compute[71321]:   </features>
Apr 12 12:50:48 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:50:48 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:50:48 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:50:48 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:50:48 user nova-compute[71321]:   </clock>
Apr 12 12:50:48 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:50:48 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:50:48 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:50:48 user nova-compute[71321]:   </cpu>
Apr 12 12:50:48 user nova-compute[71321]:   <devices>
Apr 12 12:50:48 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:50:48 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:50:48 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk"/>
Apr 12 12:50:48 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:50:48 user nova-compute[71321]:     </disk>
Apr 12 12:50:48 user nova-compute[71321]:     <disk type="block" device="disk">
Apr 12 12:50:48 user nova-compute[71321]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:50:48 user nova-compute[71321]:       <source dev="/dev/sdd"/>
Apr 12 12:50:48 user nova-compute[71321]:       <target dev="vdb" bus="virtio"/>
Apr 12 12:50:48 user nova-compute[71321]:       <serial>02c22408-e0c3-41e4-817c-dc6057451b06</serial>
Apr 12 12:50:48 user nova-compute[71321]:     </disk>
Apr 12 12:50:48 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:50:48 user nova-compute[71321]:       <mac address="fa:16:3e:c8:2c:e7"/>
Apr 12 12:50:48 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:50:48 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:50:48 user nova-compute[71321]:       <target dev="tap9c30bdfa-5f"/>
Apr 12 12:50:48 user nova-compute[71321]:     </interface>
Apr 12 12:50:48 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:50:48 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/console.log" append="off"/>
Apr 12 12:50:48 user nova-compute[71321]:     </serial>
Apr 12 12:50:48 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:50:48 user nova-compute[71321]:     <video>
Apr 12 12:50:48 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:50:48 user nova-compute[71321]:     </video>
Apr 12 12:50:48 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:50:48 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:50:48 user nova-compute[71321]:     </rng>
Apr 12 12:50:48 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:50:48 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:50:48 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:50:48 user nova-compute[71321]:     </memballoon>
Apr 12 12:50:48 user nova-compute[71321]:   </devices>
Apr 12 12:50:48 user nova-compute[71321]: </domain>
Apr 12 12:50:48 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:50:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:48 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:50:48 user nova-compute[71321]: DEBUG nova.objects.instance [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'trusted_certs' on Instance uuid db9f1454-9e3c-40d4-849b-c13537d6be97 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:50:48 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.134s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:49 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:50:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:49 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:49 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Cannot resize image /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:50:49 user nova-compute[71321]: DEBUG nova.objects.instance [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'migration_context' on Instance uuid db9f1454-9e3c-40d4-849b-c13537d6be97 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:50:49 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:46:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1788527008',display_name='tempest-AttachVolumeTestJSON-server-1788527008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1788527008',id=34,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuwf936taYEtQ87HL5K7RLSYNC7EYwzjJGVWMdDWY17MG7jKDK8n6UiYp0Wx2O8W7vbPN1WZy4g++M2EnVpaeEZHV1BaHycanzlOj8OAfSm/y0qUI9XhqdtXcmqo6mDGg==',key_name='tempest-keypair-1238241126',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:47:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='a0e6aaaa9a634f349d371f7c6c15eca2',ramdisk_id='',reservation_id='r-mamvz059',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-905742219',owner_user_name='tempest-AttachVolumeTestJSON-905742219-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:48:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a9c54033c7547c2bae91e6c1dba0976',uuid=db9f1454-9e3c-40d4-849b-c13537d6be97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "address": "fa:16:3e:c8:2c:e7", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30bdfa-5f", "ovs_interfaceid": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:50:49 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Converting VIF {"id": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "address": "fa:16:3e:c8:2c:e7", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30bdfa-5f", "ovs_interfaceid": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:50:49 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:2c:e7,bridge_name='br-int',has_traffic_filtering=True,id=9c30bdfa-5f39-4454-af8b-f2ccd880807b,network=Network(e1afe3b3-a919-4800-9f1c-c8e602defd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c30bdfa-5f') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:50:49 user nova-compute[71321]: DEBUG os_vif [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:2c:e7,bridge_name='br-int',has_traffic_filtering=True,id=9c30bdfa-5f39-4454-af8b-f2ccd880807b,network=Network(e1afe3b3-a919-4800-9f1c-c8e602defd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c30bdfa-5f') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:50:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:50:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:50:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c30bdfa-5f, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:50:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9c30bdfa-5f, col_values=(('external_ids', {'iface-id': '9c30bdfa-5f39-4454-af8b-f2ccd880807b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:2c:e7', 'vm-uuid': 'db9f1454-9e3c-40d4-849b-c13537d6be97'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:50:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:50:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:49 user nova-compute[71321]: INFO os_vif [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:2c:e7,bridge_name='br-int',has_traffic_filtering=True,id=9c30bdfa-5f39-4454-af8b-f2ccd880807b,network=Network(e1afe3b3-a919-4800-9f1c-c8e602defd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c30bdfa-5f')
Apr 12 12:50:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:50 user nova-compute[71321]: DEBUG nova.compute.manager [req-cab8b341-af02-4f3b-9fcd-51bf0d356280 req-a3f9970d-e58b-435b-bbd1-5ef09131de95 service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Received event network-vif-plugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:50:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-cab8b341-af02-4f3b-9fcd-51bf0d356280 req-a3f9970d-e58b-435b-bbd1-5ef09131de95 service nova] Acquiring lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:50:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-cab8b341-af02-4f3b-9fcd-51bf0d356280 req-a3f9970d-e58b-435b-bbd1-5ef09131de95 service nova] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:50:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-cab8b341-af02-4f3b-9fcd-51bf0d356280 req-a3f9970d-e58b-435b-bbd1-5ef09131de95 service nova] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:50:50 user nova-compute[71321]: DEBUG nova.compute.manager [req-cab8b341-af02-4f3b-9fcd-51bf0d356280 req-a3f9970d-e58b-435b-bbd1-5ef09131de95 service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] No waiting events found dispatching network-vif-plugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:50:50 user nova-compute[71321]: WARNING nova.compute.manager [req-cab8b341-af02-4f3b-9fcd-51bf0d356280 req-a3f9970d-e58b-435b-bbd1-5ef09131de95 service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Received unexpected event network-vif-plugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b for instance with vm_state stopped and task_state powering-on.
Apr 12 12:50:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:52 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303852.6654747, db9f1454-9e3c-40d4-849b-c13537d6be97 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:50:52 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] VM Resumed (Lifecycle Event)
Apr 12 12:50:52 user nova-compute[71321]: DEBUG nova.compute.manager [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:50:52 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Instance rebooted successfully.
Apr 12 12:50:52 user nova-compute[71321]: DEBUG nova.compute.manager [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:50:52 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:50:52 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:50:52 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 12 12:50:52 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303852.6676905, db9f1454-9e3c-40d4-849b-c13537d6be97 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:50:52 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] VM Started (Lifecycle Event)
Apr 12 12:50:52 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:50:52 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:50:52 user nova-compute[71321]: DEBUG nova.compute.manager [req-cbd6dfd4-8651-4600-a597-0c68f8b2a55a req-416bf3b1-2e77-46cf-a39b-6d9a834aa5be service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Received event network-vif-plugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:50:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-cbd6dfd4-8651-4600-a597-0c68f8b2a55a req-416bf3b1-2e77-46cf-a39b-6d9a834aa5be service nova] Acquiring lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:50:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-cbd6dfd4-8651-4600-a597-0c68f8b2a55a req-416bf3b1-2e77-46cf-a39b-6d9a834aa5be service nova] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:50:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-cbd6dfd4-8651-4600-a597-0c68f8b2a55a req-416bf3b1-2e77-46cf-a39b-6d9a834aa5be service nova] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:50:52 user nova-compute[71321]: DEBUG nova.compute.manager [req-cbd6dfd4-8651-4600-a597-0c68f8b2a55a req-416bf3b1-2e77-46cf-a39b-6d9a834aa5be service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] No waiting events found dispatching network-vif-plugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:50:52 user nova-compute[71321]: WARNING nova.compute.manager [req-cbd6dfd4-8651-4600-a597-0c68f8b2a55a req-416bf3b1-2e77-46cf-a39b-6d9a834aa5be service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Received unexpected event network-vif-plugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b for instance with vm_state active and task_state None.
Apr 12 12:50:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:50:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:50:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:50:55 user nova-compute[71321]: INFO nova.compute.manager [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Detaching volume 641c3b5e-f9ca-48ab-8b0c-cb013f333010
Apr 12 12:50:55 user nova-compute[71321]: INFO nova.virt.block_device [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Attempting to driver detach volume 641c3b5e-f9ca-48ab-8b0c-cb013f333010 from mountpoint /dev/vdb
Apr 12 12:50:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Attempting to detach device vdb from instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 from the persistent domain config. {{(pid=71321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 12:50:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:50:55 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:50:55 user nova-compute[71321]:   <source dev="/dev/sdc"/>
Apr 12 12:50:55 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:50:55 user nova-compute[71321]:   <serial>641c3b5e-f9ca-48ab-8b0c-cb013f333010</serial>
Apr 12 12:50:55 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 12:50:55 user nova-compute[71321]: </disk>
Apr 12 12:50:55 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:50:55 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Successfully detached device vdb from instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 from the persistent domain config.
Apr 12 12:50:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 from the live domain config. {{(pid=71321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 12:50:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:50:55 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:50:55 user nova-compute[71321]:   <source dev="/dev/sdc"/>
Apr 12 12:50:55 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:50:55 user nova-compute[71321]:   <serial>641c3b5e-f9ca-48ab-8b0c-cb013f333010</serial>
Apr 12 12:50:55 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 12:50:55 user nova-compute[71321]: </disk>
Apr 12 12:50:55 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Received event <DeviceRemovedEvent: 1681303856.1824758, 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 {{(pid=71321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 12:50:56 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Successfully detached device vdb from instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 from the live domain config.
Apr 12 12:50:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xiBfQJFu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:50:56 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:50:56 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c84a0f-4db0-409f-bf62-59424621d1c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:50:56 user nova-compute[71321]: No targets found.
Apr 12 12:50:56 user nova-compute[71321]: iSNS:
Apr 12 12:50:56 user nova-compute[71321]: No targets found.
Apr 12 12:50:56 user nova-compute[71321]: STATIC:
Apr 12 12:50:56 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010
Apr 12 12:50:56 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:50:56 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:50:56 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491
Apr 12 12:50:56 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:50:56 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:50:56 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06
Apr 12 12:50:56 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:50:56 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:50:56 user nova-compute[71321]: FIRMWARE:
Apr 12 12:50:56 user nova-compute[71321]: No targets found.
Apr 12 12:50:56 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:50:56 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:50:56 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[38df4511-0901-43a4-8143-057c4ec259ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafaf27f-4281-4734-b0dc-8b9031dcaaa3]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)
Apr 12 12:50:56 user nova-compute[71321]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 (non-flash)
Apr 12 12:50:56 user nova-compute[71321]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 (non-flash)
Apr 12 12:50:56 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)
Apr 12 12:50:56 user nova-compute[71321]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 (non-flash)
Apr 12 12:50:56 user nova-compute[71321]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 (non-flash)
Apr 12 12:50:56 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef641f0160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010'): ({'sdc'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Removing single pathed devices sdc {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df368d9-4ee1-444c-a6a0-f01f65f5993c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1508e9f7-44f8-4433-be88-29992c0ea662]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Flushing IO for device /dev/sdc {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[57480ed3-87bb-4a7f-b825-30a9681080f3]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e8e002-fc19-4a49-a991-9f4e215f0a53]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] SCSI volumes sdc have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a534bfd-5517-4517-bffa-9e6744050f0d]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d3ef92-dd34-46ae-b17c-c8c228555d48]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010, portal: 172.16.0.220,3260]
Apr 12 12:50:56 user nova-compute[71321]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010, portal: 172.16.0.220,3260] successful.
Apr 12 12:50:56 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:641c3b5e-f9ca-48ab-8b0c-cb013f333010 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c89347-aee0-4ab5-8747-6d21ad1aa3a9]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] <== disconnect_volume: return (341ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:50:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:50:57 user nova-compute[71321]: DEBUG nova.objects.instance [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lazy-loading 'flavor' on Instance uuid 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:50:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.780s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:50:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:51:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:51:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:51:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:51:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:51:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:51:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:51:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:51:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 12:51:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 12:51:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 12:51:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:51:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:51:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "62452efb-3a12-4aff-9359-217d17fc052a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:51:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "62452efb-3a12-4aff-9359-217d17fc052a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:51:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "62452efb-3a12-4aff-9359-217d17fc052a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:51:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "62452efb-3a12-4aff-9359-217d17fc052a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:51:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "62452efb-3a12-4aff-9359-217d17fc052a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:51:20 user nova-compute[71321]: INFO nova.compute.manager [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Terminating instance
Apr 12 12:51:20 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:51:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:51:20 user nova-compute[71321]: DEBUG nova.compute.manager [req-ef4c6847-e7c6-4e84-a9a0-5039e82c8747 req-a1de3604-d9a0-4342-a144-f3a8456ecaef service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Received event network-vif-unplugged-6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:51:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ef4c6847-e7c6-4e84-a9a0-5039e82c8747 req-a1de3604-d9a0-4342-a144-f3a8456ecaef service nova] Acquiring lock "62452efb-3a12-4aff-9359-217d17fc052a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:51:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ef4c6847-e7c6-4e84-a9a0-5039e82c8747 req-a1de3604-d9a0-4342-a144-f3a8456ecaef service nova] Lock "62452efb-3a12-4aff-9359-217d17fc052a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:51:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ef4c6847-e7c6-4e84-a9a0-5039e82c8747 req-a1de3604-d9a0-4342-a144-f3a8456ecaef service nova] Lock "62452efb-3a12-4aff-9359-217d17fc052a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:51:20 user nova-compute[71321]: DEBUG nova.compute.manager [req-ef4c6847-e7c6-4e84-a9a0-5039e82c8747 req-a1de3604-d9a0-4342-a144-f3a8456ecaef service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] No waiting events found dispatching network-vif-unplugged-6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:51:20 user nova-compute[71321]: DEBUG nova.compute.manager [req-ef4c6847-e7c6-4e84-a9a0-5039e82c8747 req-a1de3604-d9a0-4342-a144-f3a8456ecaef service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Received event network-vif-unplugged-6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:51:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:51:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:51:21 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Instance destroyed successfully.
Apr 12 12:51:21 user nova-compute[71321]: DEBUG nova.objects.instance [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lazy-loading 'resources' on Instance uuid 62452efb-3a12-4aff-9359-217d17fc052a {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:44:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-540928137',display_name='tempest-ServerActionsTestJSON-server-540928137',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-540928137',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9e64miZ/iyVASS4OS8AZthMPT8KBHm0byN/8NFP7U1AgI9/hOw/R+BSPozX14usgKt+VEqTE1BPs7aRGcfyuCZ/K0LBkD7enTbPYgw3NHHlO3PWScCWY1ae7IFb2uJEw==',key_name='tempest-keypair-1245622558',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:46:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ba5375005114c8594e0ae86b2f19093',ramdisk_id='',reservation_id='r-87f60efn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1233797030',owner_user_name='tempest-ServerActionsTestJSON-1233797030-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:48:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29f7f46d32f4465ba3e8b504c645c22f',uuid=62452efb-3a12-4aff-9359-217d17fc052a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "address": "fa:16:3e:c6:61:66", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea59aa7-b9", "ovs_interfaceid": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converting VIF {"id": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "address": "fa:16:3e:c6:61:66", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea59aa7-b9", "ovs_interfaceid": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:61:66,bridge_name='br-int',has_traffic_filtering=True,id=6ea59aa7-b979-4fa0-b26b-cf96ad5addb2,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ea59aa7-b9') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG os_vif [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:61:66,bridge_name='br-int',has_traffic_filtering=True,id=6ea59aa7-b979-4fa0-b26b-cf96ad5addb2,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ea59aa7-b9') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ea59aa7-b9, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:51:21 user nova-compute[71321]: INFO os_vif [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:61:66,bridge_name='br-int',has_traffic_filtering=True,id=6ea59aa7-b979-4fa0-b26b-cf96ad5addb2,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ea59aa7-b9')
Apr 12 12:51:21 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utelFAnj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:51:21 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:51:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[669436c3-6961-4b22-be0f-7616598bf91e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:51:21 user nova-compute[71321]: No targets found.
Apr 12 12:51:21 user nova-compute[71321]: iSNS:
Apr 12 12:51:21 user nova-compute[71321]: No targets found.
Apr 12 12:51:21 user nova-compute[71321]: STATIC:
Apr 12 12:51:21 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491
Apr 12 12:51:21 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:51:21 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:51:21 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06
Apr 12 12:51:21 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:51:21 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:51:21 user nova-compute[71321]: FIRMWARE:
Apr 12 12:51:21 user nova-compute[71321]: No targets found.
Apr 12 12:51:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:51:21 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:51:21 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf04bd4-8938-49a1-8a98-611fc7a4a40c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[53aa73a3-4544-42ea-ab33-5240ca7f4d17]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)
Apr 12 12:51:21 user nova-compute[71321]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 (non-flash)
Apr 12 12:51:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 (non-flash)
Apr 12 12:51:21 user nova-compute[71321]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 (non-flash)
Apr 12 12:51:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef8a1d89d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491'): ({'sdb'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Removing single pathed devices sdb {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00226e9-f927-4746-b21d-90386b1f354c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd4c2bf-23d2-41df-b278-687ad17dbcc9]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Flushing IO for device /dev/sdb {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[431b3e22-5feb-4139-a420-0d65271296af]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cba368f-561c-43c0-9203-7cc06f264f95]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] SCSI volumes sdb have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOb5201127-e01757ba91f7c12b', '/dev/disk/by-id/scsi-26530313735376261', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b5201127') {{(pid=81736) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e36da85-ecf8-4a82-8a85-7d117465fd54]: (4, None) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9282529-291b-43f3-be9f-591d67596c76]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c85ca8a-ba2c-4a86-9ba2-6dc0f4786e4c]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491, portal: 172.16.0.220,3260]
Apr 12 12:51:21 user nova-compute[71321]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491, portal: 172.16.0.220,3260] successful.
Apr 12 12:51:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f8c0fb4-a50b-4195-ba6a-8e98f3360491 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60ce2a6-5b46-485b-88f8-1c48d0235cb9]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] <== disconnect_volume: return (330ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:51:21 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Deleting instance files /opt/stack/data/nova/instances/62452efb-3a12-4aff-9359-217d17fc052a_del
Apr 12 12:51:21 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Deletion of /opt/stack/data/nova/instances/62452efb-3a12-4aff-9359-217d17fc052a_del complete
Apr 12 12:51:21 user nova-compute[71321]: INFO nova.compute.manager [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Took 1.19 seconds to destroy the instance on the hypervisor.
Apr 12 12:51:21 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:51:21 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:51:22 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:51:22 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Took 0.77 seconds to deallocate network for instance.
Apr 12 12:51:22 user nova-compute[71321]: DEBUG nova.compute.manager [req-6aab51d9-9fcd-4c35-8d07-6cfeae9c4628 req-9963d285-1770-4e85-a5a6-f83a489f55b4 service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Received event network-vif-deleted-6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:51:22 user nova-compute[71321]: INFO nova.compute.manager [req-6aab51d9-9fcd-4c35-8d07-6cfeae9c4628 req-9963d285-1770-4e85-a5a6-f83a489f55b4 service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Neutron deleted interface 6ea59aa7-b979-4fa0-b26b-cf96ad5addb2; detaching it from the instance and deleting it from the info cache
Apr 12 12:51:22 user nova-compute[71321]: DEBUG nova.network.neutron [req-6aab51d9-9fcd-4c35-8d07-6cfeae9c4628 req-9963d285-1770-4e85-a5a6-f83a489f55b4 service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:51:22 user nova-compute[71321]: DEBUG nova.compute.manager [req-6aab51d9-9fcd-4c35-8d07-6cfeae9c4628 req-9963d285-1770-4e85-a5a6-f83a489f55b4 service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Detach interface failed, port_id=6ea59aa7-b979-4fa0-b26b-cf96ad5addb2, reason: Instance 62452efb-3a12-4aff-9359-217d17fc052a could not be found. {{(pid=71321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 12:51:22 user nova-compute[71321]: DEBUG nova.compute.manager [req-02d7bbc3-44e7-424f-8878-b418d67be22b req-89ec0a00-a066-4aa0-9d71-42af87cb8149 service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Received event network-vif-plugged-6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:51:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-02d7bbc3-44e7-424f-8878-b418d67be22b req-89ec0a00-a066-4aa0-9d71-42af87cb8149 service nova] Acquiring lock "62452efb-3a12-4aff-9359-217d17fc052a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:51:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-02d7bbc3-44e7-424f-8878-b418d67be22b req-89ec0a00-a066-4aa0-9d71-42af87cb8149 service nova] Lock "62452efb-3a12-4aff-9359-217d17fc052a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:51:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-02d7bbc3-44e7-424f-8878-b418d67be22b req-89ec0a00-a066-4aa0-9d71-42af87cb8149 service nova] Lock "62452efb-3a12-4aff-9359-217d17fc052a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:51:22 user nova-compute[71321]: DEBUG nova.compute.manager [req-02d7bbc3-44e7-424f-8878-b418d67be22b req-89ec0a00-a066-4aa0-9d71-42af87cb8149 service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] No waiting events found dispatching network-vif-plugged-6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:51:22 user nova-compute[71321]: WARNING nova.compute.manager [req-02d7bbc3-44e7-424f-8878-b418d67be22b req-89ec0a00-a066-4aa0-9d71-42af87cb8149 service nova] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Received unexpected event network-vif-plugged-6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 for instance with vm_state active and task_state deleting.
Apr 12 12:51:23 user nova-compute[71321]: INFO nova.compute.manager [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Took 0.78 seconds to detach 1 volumes for instance.
Apr 12 12:51:23 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Deleting volume: 3f8c0fb4-a50b-4195-ba6a-8e98f3360491 {{(pid=71321) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 12:51:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:51:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:51:23 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:51:23 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:51:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.226s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:51:23 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Deleted allocations for instance 62452efb-3a12-4aff-9359-217d17fc052a
Apr 12 12:51:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "62452efb-3a12-4aff-9359-217d17fc052a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.489s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:51:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:51:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:51:29 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:51:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:51:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:51:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:51:29 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:51:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:51:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:51:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:51:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:51:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:51:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:51:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:51:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:51:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:51:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:51:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:51:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:51:30 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:51:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:51:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:51:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:51:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:51:31 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:51:31 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:51:31 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8361MB free_disk=26.33116912841797GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:51:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:51:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:51:31 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:51:31 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:51:31 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance db9f1454-9e3c-40d4-849b-c13537d6be97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:51:31 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 508746c9-705a-4d77-a528-454a10299411 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:51:31 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:51:31 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:51:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:51:31 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:51:31 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:51:31 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:51:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.307s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:51:33 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:51:33 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:51:33 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:51:33 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:51:35 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:51:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:51:36 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681303881.404536, 62452efb-3a12-4aff-9359-217d17fc052a => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:51:36 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] VM Stopped (Lifecycle Event)
Apr 12 12:51:36 user nova-compute[71321]: DEBUG nova.compute.manager [None req-12e762b0-5bef-4ab4-8e16-1987be8fc491 None None] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:51:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:51:38 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:51:38 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:51:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-db9f1454-9e3c-40d4-849b-c13537d6be97" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:51:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-db9f1454-9e3c-40d4-849b-c13537d6be97" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:51:38 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 12:51:39 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Updating instance_info_cache with network_info: [{"id": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "address": "fa:16:3e:c8:2c:e7", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30bdfa-5f", "ovs_interfaceid": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:51:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-db9f1454-9e3c-40d4-849b-c13537d6be97" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:51:39 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 12:51:39 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:51:39 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:51:41 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:51:42 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:51:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "508746c9-705a-4d77-a528-454a10299411" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:51:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "508746c9-705a-4d77-a528-454a10299411" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:51:45 user nova-compute[71321]: DEBUG nova.objects.instance [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lazy-loading 'flavor' on Instance uuid 508746c9-705a-4d77-a528-454a10299411 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:51:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "508746c9-705a-4d77-a528-454a10299411" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:51:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "508746c9-705a-4d77-a528-454a10299411" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:51:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "508746c9-705a-4d77-a528-454a10299411" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:51:45 user nova-compute[71321]: INFO nova.compute.manager [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Attaching volume 3675f4a6-a994-41d9-9477-08b2f072dae0 to /dev/vdb
Apr 12 12:51:45 user nova-compute[71321]: DEBUG os_brick.utils [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:51:45 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:51:45 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:51:45 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c90dab6-b0ba-4cb9-8f29-9ce989712748]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:51:45 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bb8119-308b-48ca-8c8c-b3f85cdd407a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-13eff7a6-ca4a-416f-a715-3426e4ca7d26 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-13eff7a6-ca4a-416f-a715-3426e4ca7d26 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-13eff7a6-ca4a-416f-a715-3426e4ca7d26 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-13eff7a6-ca4a-416f-a715-3426e4ca7d26 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-13eff7a6-ca4a-416f-a715-3426e4ca7d26 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a08531-7e03-47fe-91ac-7b0306ba8b25]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:51:46 user nova-compute[71321]: INFO nova.compute.manager [None req-13eff7a6-ca4a-416f-a715-3426e4ca7d26 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Terminating instance
Apr 12 12:51:46 user nova-compute[71321]: DEBUG nova.compute.manager [None req-13eff7a6-ca4a-416f-a715-3426e4ca7d26 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10c1b65-45ea-48af-be90-f6f51d45a076]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:51:46 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:51:46 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40c52dc-7e7f-4839-bc6b-cc93d5072868]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG os_brick.utils [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Updating existing volume attachment record: 0d0b5147-6134-412a-8d37-f304184d147c {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG nova.compute.manager [req-81d25a02-4f1e-454e-ac03-b7c2294785b6 req-52d297ae-4480-40ec-a5b8-19f9ece8b890 service nova] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Received event network-vif-unplugged-968b45e2-1ead-4fdd-a879-52ebb15f5b6a {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-81d25a02-4f1e-454e-ac03-b7c2294785b6 req-52d297ae-4480-40ec-a5b8-19f9ece8b890 service nova] Acquiring lock "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-81d25a02-4f1e-454e-ac03-b7c2294785b6 req-52d297ae-4480-40ec-a5b8-19f9ece8b890 service nova] Lock "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-81d25a02-4f1e-454e-ac03-b7c2294785b6 req-52d297ae-4480-40ec-a5b8-19f9ece8b890 service nova] Lock "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG nova.compute.manager [req-81d25a02-4f1e-454e-ac03-b7c2294785b6 req-52d297ae-4480-40ec-a5b8-19f9ece8b890 service nova] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] No waiting events found dispatching network-vif-unplugged-968b45e2-1ead-4fdd-a879-52ebb15f5b6a {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG nova.compute.manager [req-81d25a02-4f1e-454e-ac03-b7c2294785b6 req-52d297ae-4480-40ec-a5b8-19f9ece8b890 service nova] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Received event network-vif-unplugged-968b45e2-1ead-4fdd-a879-52ebb15f5b6a for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:51:46 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Instance destroyed successfully.
Apr 12 12:51:46 user nova-compute[71321]: DEBUG nova.objects.instance [None req-13eff7a6-ca4a-416f-a715-3426e4ca7d26 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lazy-loading 'resources' on Instance uuid 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-13eff7a6-ca4a-416f-a715-3426e4ca7d26 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1943413206',display_name='tempest-AttachVolumeNegativeTest-server-1943413206',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1943413206',id=32,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdv55R/PFH7G3bAV+mLRNThOwZSl0ftMmxmYj5aU4BWLXfSGPog2OCXU22X8M1HmirOFjQTWnVswKvjPWgBWSuIO/2PPSCD+tkDfXlkxKDDKfnzAYyOJsq3Ofrf95xrQg==',key_name='tempest-keypair-1664165816',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:46:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e61975273ccb41229e0138b96eb7f5e9',ramdisk_id='',reservation_id='r-x80dxl2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-941338837',owner_user_name='tempest-AttachVolumeNegativeTest-941338837-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:46:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3d9f4516bee4f8d9af7a40ed1298f03',uuid=9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "968b45e2-1ead-4fdd-a879-52ebb15f5b6a", "address": "fa:16:3e:d7:03:df", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap968b45e2-1e", "ovs_interfaceid": "968b45e2-1ead-4fdd-a879-52ebb15f5b6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-13eff7a6-ca4a-416f-a715-3426e4ca7d26 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Converting VIF {"id": "968b45e2-1ead-4fdd-a879-52ebb15f5b6a", "address": "fa:16:3e:d7:03:df", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap968b45e2-1e", "ovs_interfaceid": "968b45e2-1ead-4fdd-a879-52ebb15f5b6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-13eff7a6-ca4a-416f-a715-3426e4ca7d26 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:03:df,bridge_name='br-int',has_traffic_filtering=True,id=968b45e2-1ead-4fdd-a879-52ebb15f5b6a,network=Network(e211a286-ade0-4930-a327-4c6a41785094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap968b45e2-1e') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG os_vif [None req-13eff7a6-ca4a-416f-a715-3426e4ca7d26 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:03:df,bridge_name='br-int',has_traffic_filtering=True,id=968b45e2-1ead-4fdd-a879-52ebb15f5b6a,network=Network(e211a286-ade0-4930-a327-4c6a41785094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap968b45e2-1e') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap968b45e2-1e, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:51:46 user nova-compute[71321]: INFO os_vif [None req-13eff7a6-ca4a-416f-a715-3426e4ca7d26 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:03:df,bridge_name='br-int',has_traffic_filtering=True,id=968b45e2-1ead-4fdd-a879-52ebb15f5b6a,network=Network(e211a286-ade0-4930-a327-4c6a41785094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap968b45e2-1e')
Apr 12 12:51:46 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-13eff7a6-ca4a-416f-a715-3426e4ca7d26 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Deleting instance files /opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9_del
Apr 12 12:51:46 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-13eff7a6-ca4a-416f-a715-3426e4ca7d26 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Deletion of /opt/stack/data/nova/instances/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9_del complete
Apr 12 12:51:46 user nova-compute[71321]: INFO nova.compute.manager [None req-13eff7a6-ca4a-416f-a715-3426e4ca7d26 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 12 12:51:46 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-13eff7a6-ca4a-416f-a715-3426e4ca7d26 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:51:46 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:51:48 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:51:48 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Took 1.20 seconds to deallocate network for instance.
Apr 12 12:51:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-13eff7a6-ca4a-416f-a715-3426e4ca7d26 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:51:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-13eff7a6-ca4a-416f-a715-3426e4ca7d26 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:51:48 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-13eff7a6-ca4a-416f-a715-3426e4ca7d26 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:51:48 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-13eff7a6-ca4a-416f-a715-3426e4ca7d26 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:51:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-13eff7a6-ca4a-416f-a715-3426e4ca7d26 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.250s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:51:48 user nova-compute[71321]: DEBUG nova.compute.manager [req-5ae9fc76-74b1-4555-a761-c2ee799e8378 req-621a58cf-ff90-43c8-9f78-f6934c230839 service nova] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Received event network-vif-plugged-968b45e2-1ead-4fdd-a879-52ebb15f5b6a {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:51:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-5ae9fc76-74b1-4555-a761-c2ee799e8378 req-621a58cf-ff90-43c8-9f78-f6934c230839 service nova] Acquiring lock "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:51:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-5ae9fc76-74b1-4555-a761-c2ee799e8378 req-621a58cf-ff90-43c8-9f78-f6934c230839 service nova] Lock "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:51:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-5ae9fc76-74b1-4555-a761-c2ee799e8378 req-621a58cf-ff90-43c8-9f78-f6934c230839 service nova] Lock "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:51:48 user nova-compute[71321]: DEBUG nova.compute.manager [req-5ae9fc76-74b1-4555-a761-c2ee799e8378 req-621a58cf-ff90-43c8-9f78-f6934c230839 service nova] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] No waiting events found dispatching network-vif-plugged-968b45e2-1ead-4fdd-a879-52ebb15f5b6a {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:51:48 user nova-compute[71321]: WARNING nova.compute.manager [req-5ae9fc76-74b1-4555-a761-c2ee799e8378 req-621a58cf-ff90-43c8-9f78-f6934c230839 service nova] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Received unexpected event network-vif-plugged-968b45e2-1ead-4fdd-a879-52ebb15f5b6a for instance with vm_state deleted and task_state None.
Apr 12 12:51:48 user nova-compute[71321]: DEBUG nova.compute.manager [req-5ae9fc76-74b1-4555-a761-c2ee799e8378 req-621a58cf-ff90-43c8-9f78-f6934c230839 service nova] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Received event network-vif-deleted-968b45e2-1ead-4fdd-a879-52ebb15f5b6a {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:51:48 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-13eff7a6-ca4a-416f-a715-3426e4ca7d26 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Deleted allocations for instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9
Apr 12 12:51:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-13eff7a6-ca4a-416f-a715-3426e4ca7d26 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.532s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HiUueIZh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:51:50 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:51:50 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:51:50 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:51:50 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:51:50 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:51:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7516fe61-659d-4557-a2fd-467e23b93065]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:51:50 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a9ee4c-36af-4ef6-ad0c-adce1d6a9ce9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0] added
Apr 12 12:51:50 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa27ceda-15a7-4c6b-b487-229e2543144a]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f3cdda-ee8c-431c-859f-1b92cd732ca9]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HiUueIZh {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HiUueIZh" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9168c23b-6c89-4fea-a43f-5ecb8de0c294]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HiUueIZh'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e050505d-5ca8-415c-b7c0-2c23cbd95620]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36c37ca-b68a-4d67-a2e6-347c598b2a60]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 (non-flash)
Apr 12 12:51:50 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 (non-flash)
Apr 12 12:51:50 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d39b805-5d02-48a1-ab84-375f8aebdfaa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0, portal: 172.16.0.220,3260]
Apr 12 12:51:50 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0, portal: 172.16.0.220,3260] successful.
Apr 12 12:51:50 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[037d7ed8-75f5-4a2f-b4d7-b645aedd22e3]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d83c09e-d4c8-4578-a020-db8b53fef847]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 (non-flash)
Apr 12 12:51:50 user nova-compute[71321]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 (non-flash)
Apr 12 12:51:50 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 (non-flash)
Apr 12 12:51:50 user nova-compute[71321]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 (non-flash)
Apr 12 12:51:50 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a92c757-b3fb-405a-986e-95957d0677f1]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:51:50 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HiUueIZh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:51:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:51:51 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23730616331626637', 'path': '/dev/sdb'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:51:51 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730616331626637', 'path': '/dev/sdb'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:51:51 user nova-compute[71321]: DEBUG nova.objects.instance [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lazy-loading 'flavor' on Instance uuid 508746c9-705a-4d77-a528-454a10299411 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:51:51 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 12:51:51 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:51:51 user nova-compute[71321]:   <source dev="/dev/sdb"/>
Apr 12 12:51:51 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:51:51 user nova-compute[71321]:   <serial>3675f4a6-a994-41d9-9477-08b2f072dae0</serial>
Apr 12 12:51:51 user nova-compute[71321]: </disk>
Apr 12 12:51:51 user nova-compute[71321]:  {{(pid=71321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 12:51:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:51:52 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:51:52 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:51:52 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] No VIF found with MAC fa:16:3e:5d:63:5c, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:51:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "508746c9-705a-4d77-a528-454a10299411" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.287s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:51:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:51:56 user nova-compute[71321]: DEBUG nova.compute.manager [req-a75cc059-c27b-48ac-b60e-1f312c1fb42b req-82a0a133-4309-4831-b88b-391fdaf8c9b3 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Received event network-changed-dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:51:56 user nova-compute[71321]: DEBUG nova.compute.manager [req-a75cc059-c27b-48ac-b60e-1f312c1fb42b req-82a0a133-4309-4831-b88b-391fdaf8c9b3 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Refreshing instance network info cache due to event network-changed-dab72490-cdfa-4ffa-be0b-feda75d66bcb. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:51:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a75cc059-c27b-48ac-b60e-1f312c1fb42b req-82a0a133-4309-4831-b88b-391fdaf8c9b3 service nova] Acquiring lock "refresh_cache-508746c9-705a-4d77-a528-454a10299411" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:51:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a75cc059-c27b-48ac-b60e-1f312c1fb42b req-82a0a133-4309-4831-b88b-391fdaf8c9b3 service nova] Acquired lock "refresh_cache-508746c9-705a-4d77-a528-454a10299411" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:51:56 user nova-compute[71321]: DEBUG nova.network.neutron [req-a75cc059-c27b-48ac-b60e-1f312c1fb42b req-82a0a133-4309-4831-b88b-391fdaf8c9b3 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Refreshing network info cache for port dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:51:56 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:51:57 user nova-compute[71321]: DEBUG nova.network.neutron [req-a75cc059-c27b-48ac-b60e-1f312c1fb42b req-82a0a133-4309-4831-b88b-391fdaf8c9b3 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Updated VIF entry in instance network info cache for port dab72490-cdfa-4ffa-be0b-feda75d66bcb. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:51:57 user nova-compute[71321]: DEBUG nova.network.neutron [req-a75cc059-c27b-48ac-b60e-1f312c1fb42b req-82a0a133-4309-4831-b88b-391fdaf8c9b3 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Updating instance_info_cache with network_info: [{"id": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "address": "fa:16:3e:5d:63:5c", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab72490-cd", "ovs_interfaceid": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:51:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a75cc059-c27b-48ac-b60e-1f312c1fb42b req-82a0a133-4309-4831-b88b-391fdaf8c9b3 service nova] Releasing lock "refresh_cache-508746c9-705a-4d77-a528-454a10299411" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:51:58 user nova-compute[71321]: DEBUG nova.compute.manager [req-11117e7b-5da3-491d-bb4f-84e997bee999 req-50729f0e-651e-4c4c-bea3-cabc988983fc service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Received event network-changed-dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:51:58 user nova-compute[71321]: DEBUG nova.compute.manager [req-11117e7b-5da3-491d-bb4f-84e997bee999 req-50729f0e-651e-4c4c-bea3-cabc988983fc service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Refreshing instance network info cache due to event network-changed-dab72490-cdfa-4ffa-be0b-feda75d66bcb. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:51:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-11117e7b-5da3-491d-bb4f-84e997bee999 req-50729f0e-651e-4c4c-bea3-cabc988983fc service nova] Acquiring lock "refresh_cache-508746c9-705a-4d77-a528-454a10299411" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:51:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-11117e7b-5da3-491d-bb4f-84e997bee999 req-50729f0e-651e-4c4c-bea3-cabc988983fc service nova] Acquired lock "refresh_cache-508746c9-705a-4d77-a528-454a10299411" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:51:58 user nova-compute[71321]: DEBUG nova.network.neutron [req-11117e7b-5da3-491d-bb4f-84e997bee999 req-50729f0e-651e-4c4c-bea3-cabc988983fc service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Refreshing network info cache for port dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:51:59 user nova-compute[71321]: DEBUG nova.network.neutron [req-11117e7b-5da3-491d-bb4f-84e997bee999 req-50729f0e-651e-4c4c-bea3-cabc988983fc service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Updated VIF entry in instance network info cache for port dab72490-cdfa-4ffa-be0b-feda75d66bcb. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:51:59 user nova-compute[71321]: DEBUG nova.network.neutron [req-11117e7b-5da3-491d-bb4f-84e997bee999 req-50729f0e-651e-4c4c-bea3-cabc988983fc service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Updating instance_info_cache with network_info: [{"id": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "address": "fa:16:3e:5d:63:5c", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab72490-cd", "ovs_interfaceid": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:51:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-11117e7b-5da3-491d-bb4f-84e997bee999 req-50729f0e-651e-4c4c-bea3-cabc988983fc service nova] Releasing lock "refresh_cache-508746c9-705a-4d77-a528-454a10299411" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:52:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "508746c9-705a-4d77-a528-454a10299411" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:52:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "508746c9-705a-4d77-a528-454a10299411" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:52:01 user nova-compute[71321]: INFO nova.compute.manager [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Rebooting instance
Apr 12 12:52:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "refresh_cache-508746c9-705a-4d77-a528-454a10299411" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:52:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquired lock "refresh_cache-508746c9-705a-4d77-a528-454a10299411" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:52:01 user nova-compute[71321]: DEBUG nova.network.neutron [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:52:01 user nova-compute[71321]: DEBUG nova.network.neutron [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Updating instance_info_cache with network_info: [{"id": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "address": "fa:16:3e:5d:63:5c", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab72490-cd", "ovs_interfaceid": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:52:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Releasing lock "refresh_cache-508746c9-705a-4d77-a528-454a10299411" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:52:01 user nova-compute[71321]: DEBUG nova.compute.manager [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:52:01 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681303906.822261, 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:52:01 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] VM Stopped (Lifecycle Event)
Apr 12 12:52:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:01 user nova-compute[71321]: DEBUG nova.compute.manager [None req-3c90be9b-eb32-4db8-a0be-976ed2001f98 None None] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:52:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG nova.compute.manager [req-545610c4-0376-409b-9eca-af57ebe14b24 req-11f52f73-16b8-4b3e-8674-78ece57bf4f7 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Received event network-vif-unplugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-545610c4-0376-409b-9eca-af57ebe14b24 req-11f52f73-16b8-4b3e-8674-78ece57bf4f7 service nova] Acquiring lock "508746c9-705a-4d77-a528-454a10299411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-545610c4-0376-409b-9eca-af57ebe14b24 req-11f52f73-16b8-4b3e-8674-78ece57bf4f7 service nova] Lock "508746c9-705a-4d77-a528-454a10299411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-545610c4-0376-409b-9eca-af57ebe14b24 req-11f52f73-16b8-4b3e-8674-78ece57bf4f7 service nova] Lock "508746c9-705a-4d77-a528-454a10299411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG nova.compute.manager [req-545610c4-0376-409b-9eca-af57ebe14b24 req-11f52f73-16b8-4b3e-8674-78ece57bf4f7 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] No waiting events found dispatching network-vif-unplugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:52:02 user nova-compute[71321]: WARNING nova.compute.manager [req-545610c4-0376-409b-9eca-af57ebe14b24 req-11f52f73-16b8-4b3e-8674-78ece57bf4f7 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Received unexpected event network-vif-unplugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb for instance with vm_state active and task_state reboot_started_hard.
Apr 12 12:52:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:02 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 508746c9-705a-4d77-a528-454a10299411] Instance destroyed successfully.
Apr 12 12:52:02 user nova-compute[71321]: DEBUG nova.objects.instance [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lazy-loading 'resources' on Instance uuid 508746c9-705a-4d77-a528-454a10299411 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:49:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1462256376',display_name='tempest-TestMinimumBasicScenario-server-1462256376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1462256376',id=36,image_ref='71858585-d70e-4cf1-b2dc-0e5921c23e98',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzeWBX6IhC7gCQ6w0T3CIjF58xU+K7xE+03Z94BwQAzy1OeRNbL96UH1iSrsClMKm4rn8M5qup/LJ+NKAIWGUUK2r0ARV/KqOHOttU7oRuA6Ty3XfX6ezVU/ChdOvsk/g==',key_name='tempest-TestMinimumBasicScenario-1590711499',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:49:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f411f36f23e464fa4a395ad6b2b4472',ramdisk_id='',reservation_id='r-pmi48cyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='71858585-d70e-4cf1-b2dc-0e5921c23e98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-381334085',owner_user_name='tempest-TestMinimumBasicScenario-381334085-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:52:02Z,user_data=None,user_id='924c3a968d734a1c9ddfc5a44d8f6352',uuid=508746c9-705a-4d77-a528-454a10299411,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "address": "fa:16:3e:5d:63:5c", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab72490-cd", "ovs_interfaceid": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Converting VIF {"id": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "address": "fa:16:3e:5d:63:5c", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab72490-cd", "ovs_interfaceid": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:63:5c,bridge_name='br-int',has_traffic_filtering=True,id=dab72490-cdfa-4ffa-be0b-feda75d66bcb,network=Network(76f8fc2b-41cf-4efd-9820-c4d4056deaca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab72490-cd') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG os_vif [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:63:5c,bridge_name='br-int',has_traffic_filtering=True,id=dab72490-cdfa-4ffa-be0b-feda75d66bcb,network=Network(76f8fc2b-41cf-4efd-9820-c4d4056deaca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab72490-cd') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdab72490-cd, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:52:02 user nova-compute[71321]: INFO os_vif [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:63:5c,bridge_name='br-int',has_traffic_filtering=True,id=dab72490-cdfa-4ffa-be0b-feda75d66bcb,network=Network(76f8fc2b-41cf-4efd-9820-c4d4056deaca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab72490-cd')
Apr 12 12:52:02 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HiUueIZh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:52:02 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:52:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26053c8-ad04-47c5-82a6-2d33b4c7f9d1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:52:02 user nova-compute[71321]: No targets found.
Apr 12 12:52:02 user nova-compute[71321]: iSNS:
Apr 12 12:52:02 user nova-compute[71321]: No targets found.
Apr 12 12:52:02 user nova-compute[71321]: STATIC:
Apr 12 12:52:02 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0
Apr 12 12:52:02 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:52:02 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:52:02 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06
Apr 12 12:52:02 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:52:02 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:52:02 user nova-compute[71321]: FIRMWARE:
Apr 12 12:52:02 user nova-compute[71321]: No targets found.
Apr 12 12:52:02 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:52:02 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:52:02 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f39b5c-636a-490a-ac62-58c46558c3f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[60eed564-60b4-4401-b73b-aabe48aeebe1]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 (non-flash)
Apr 12 12:52:02 user nova-compute[71321]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 (non-flash)
Apr 12 12:52:02 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 (non-flash)
Apr 12 12:52:02 user nova-compute[71321]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 (non-flash)
Apr 12 12:52:02 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef87f18ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0'): ({'sdb'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Removing single pathed devices sdb {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2824dbf7-fc3a-4f15-86e7-85e6ef6fd883]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3908fdaa-5248-4d23-a36a-2a7ece989077]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Flushing IO for device /dev/sdb {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c1bbab-bb0d-45bc-9bb2-4a69a7a2e243]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[04150f02-3bec-4375-ab6f-c72f044ca490]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] SCSI volumes sdb have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f017df1-8ddf-498c-9ddd-c81f70b40867]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b140cf-a08e-49f1-95b5-640b3542dc4f]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0, portal: 172.16.0.220,3260]
Apr 12 12:52:02 user nova-compute[71321]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0, portal: 172.16.0.220,3260] successful.
Apr 12 12:52:02 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe792d9b-5b6a-4ee9-8070-76a7765f864a]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] <== disconnect_volume: return (366ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Start _get_guest_xml network_info=[{"id": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "address": "fa:16:3e:5d:63:5c", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab72490-cd", "ovs_interfaceid": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=71858585-d70e-4cf1-b2dc-0e5921c23e98,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '71858585-d70e-4cf1-b2dc-0e5921c23e98'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0d0b5147-6134-412a-8d37-f304184d147c', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HiUueIZh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '508746c9-705a-4d77-a528-454a10299411', 'attached_at': '', 'detached_at': '', 'volume_id': '3675f4a6-a994-41d9-9477-08b2f072dae0', 'serial': '3675f4a6-a994-41d9-9477-08b2f072dae0'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:52:02 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:52:02 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:52:02 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=71858585-d70e-4cf1-b2dc-0e5921c23e98,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:52:02 user nova-compute[71321]: DEBUG nova.objects.instance [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lazy-loading 'vcpu_model' on Instance uuid 508746c9-705a-4d77-a528-454a10299411 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HiUueIZh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:52:03 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:52:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:52:03 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:52:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:52:03 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:52:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22f79e7-1f23-4150-82b5-6d6d073ae2c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:52:03 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[805d214e-c952-4dcb-b518-9a9d5e0e9ca7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0] added
Apr 12 12:52:03 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed45009-17f9-4afa-ae83-30bae890fa91]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[266b68e8-0edf-46fd-bbfc-e7a22d430165]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HiUueIZh {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HiUueIZh" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cff1d7-0b22-463a-ba58-388552e074fe]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HiUueIZh'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec72c9f-9347-4700-bcf2-df83b9069834]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80b2f16-955d-4705-af7b-e3e5db13046b]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 (non-flash)
Apr 12 12:52:03 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 (non-flash)
Apr 12 12:52:03 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[85de32a2-12ac-4be9-ad48-4c2cc404897f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0, portal: 172.16.0.220,3260]
Apr 12 12:52:03 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0, portal: 172.16.0.220,3260] successful.
Apr 12 12:52:03 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e1c212-66ec-439b-b98e-82d625be7e6c]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e19866-1d98-446d-869f-b9dcb4f896c9]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 (non-flash)
Apr 12 12:52:03 user nova-compute[71321]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 (non-flash)
Apr 12 12:52:03 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 (non-flash)
Apr 12 12:52:03 user nova-compute[71321]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 (non-flash)
Apr 12 12:52:03 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e388b7-d8fb-42c6-b990-60dfbce45e44]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:52:03 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HiUueIZh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG nova.compute.manager [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Received event network-vif-plugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] Acquiring lock "508746c9-705a-4d77-a528-454a10299411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] Lock "508746c9-705a-4d77-a528-454a10299411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] Lock "508746c9-705a-4d77-a528-454a10299411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG nova.compute.manager [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] No waiting events found dispatching network-vif-plugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:52:04 user nova-compute[71321]: WARNING nova.compute.manager [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Received unexpected event network-vif-plugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb for instance with vm_state active and task_state reboot_started_hard.
Apr 12 12:52:04 user nova-compute[71321]: DEBUG nova.compute.manager [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Received event network-vif-plugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] Acquiring lock "508746c9-705a-4d77-a528-454a10299411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] Lock "508746c9-705a-4d77-a528-454a10299411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] Lock "508746c9-705a-4d77-a528-454a10299411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG nova.compute.manager [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] No waiting events found dispatching network-vif-plugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:52:04 user nova-compute[71321]: WARNING nova.compute.manager [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Received unexpected event network-vif-plugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb for instance with vm_state active and task_state reboot_started_hard.
Apr 12 12:52:04 user nova-compute[71321]: DEBUG nova.compute.manager [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Received event network-vif-plugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] Acquiring lock "508746c9-705a-4d77-a528-454a10299411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] Lock "508746c9-705a-4d77-a528-454a10299411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] Lock "508746c9-705a-4d77-a528-454a10299411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG nova.compute.manager [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] No waiting events found dispatching network-vif-plugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:52:04 user nova-compute[71321]: WARNING nova.compute.manager [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Received unexpected event network-vif-plugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb for instance with vm_state active and task_state reboot_started_hard.
Apr 12 12:52:04 user nova-compute[71321]: DEBUG nova.compute.manager [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Received event network-vif-unplugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] Acquiring lock "508746c9-705a-4d77-a528-454a10299411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] Lock "508746c9-705a-4d77-a528-454a10299411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] Lock "508746c9-705a-4d77-a528-454a10299411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG nova.compute.manager [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] No waiting events found dispatching network-vif-unplugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:52:04 user nova-compute[71321]: WARNING nova.compute.manager [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Received unexpected event network-vif-unplugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb for instance with vm_state active and task_state reboot_started_hard.
Apr 12 12:52:04 user nova-compute[71321]: DEBUG nova.compute.manager [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Received event network-vif-plugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] Acquiring lock "508746c9-705a-4d77-a528-454a10299411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] Lock "508746c9-705a-4d77-a528-454a10299411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] Lock "508746c9-705a-4d77-a528-454a10299411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG nova.compute.manager [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] No waiting events found dispatching network-vif-plugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:52:04 user nova-compute[71321]: WARNING nova.compute.manager [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Received unexpected event network-vif-plugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb for instance with vm_state active and task_state reboot_started_hard.
Apr 12 12:52:04 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23730616331626637', 'path': '/dev/sdb'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730616331626637', 'path': '/dev/sdb'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:49:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1462256376',display_name='tempest-TestMinimumBasicScenario-server-1462256376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1462256376',id=36,image_ref='71858585-d70e-4cf1-b2dc-0e5921c23e98',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzeWBX6IhC7gCQ6w0T3CIjF58xU+K7xE+03Z94BwQAzy1OeRNbL96UH1iSrsClMKm4rn8M5qup/LJ+NKAIWGUUK2r0ARV/KqOHOttU7oRuA6Ty3XfX6ezVU/ChdOvsk/g==',key_name='tempest-TestMinimumBasicScenario-1590711499',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:49:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f411f36f23e464fa4a395ad6b2b4472',ramdisk_id='',reservation_id='r-pmi48cyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='71858585-d70e-4cf1-b2dc-0e5921c23e98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-381334085',owner_user_name='tempest-TestMinimumBasicScenario-381334085-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:52:02Z,user_data=None,user_id='924c3a968d734a1c9ddfc5a44d8f6352',uuid=508746c9-705a-4d77-a528-454a10299411,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "address": "fa:16:3e:5d:63:5c", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab72490-cd", "ovs_interfaceid": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Converting VIF {"id": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "address": "fa:16:3e:5d:63:5c", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab72490-cd", "ovs_interfaceid": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:63:5c,bridge_name='br-int',has_traffic_filtering=True,id=dab72490-cdfa-4ffa-be0b-feda75d66bcb,network=Network(76f8fc2b-41cf-4efd-9820-c4d4056deaca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab72490-cd') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG nova.objects.instance [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lazy-loading 'pci_devices' on Instance uuid 508746c9-705a-4d77-a528-454a10299411 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:52:04 user nova-compute[71321]:   <uuid>508746c9-705a-4d77-a528-454a10299411</uuid>
Apr 12 12:52:04 user nova-compute[71321]:   <name>instance-00000024</name>
Apr 12 12:52:04 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:52:04 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:52:04 user nova-compute[71321]:   <metadata>
Apr 12 12:52:04 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:52:04 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:52:04 user nova-compute[71321]:       <nova:name>tempest-TestMinimumBasicScenario-server-1462256376</nova:name>
Apr 12 12:52:04 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:52:02</nova:creationTime>
Apr 12 12:52:04 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:52:04 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:52:04 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:52:04 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:52:04 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:52:04 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:52:04 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:52:04 user nova-compute[71321]:       <nova:owner>
Apr 12 12:52:04 user nova-compute[71321]:         <nova:user uuid="924c3a968d734a1c9ddfc5a44d8f6352">tempest-TestMinimumBasicScenario-381334085-project-member</nova:user>
Apr 12 12:52:04 user nova-compute[71321]:         <nova:project uuid="2f411f36f23e464fa4a395ad6b2b4472">tempest-TestMinimumBasicScenario-381334085</nova:project>
Apr 12 12:52:04 user nova-compute[71321]:       </nova:owner>
Apr 12 12:52:04 user nova-compute[71321]:       <nova:root type="image" uuid="71858585-d70e-4cf1-b2dc-0e5921c23e98"/>
Apr 12 12:52:04 user nova-compute[71321]:       <nova:ports>
Apr 12 12:52:04 user nova-compute[71321]:         <nova:port uuid="dab72490-cdfa-4ffa-be0b-feda75d66bcb">
Apr 12 12:52:04 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 12:52:04 user nova-compute[71321]:         </nova:port>
Apr 12 12:52:04 user nova-compute[71321]:       </nova:ports>
Apr 12 12:52:04 user nova-compute[71321]:     </nova:instance>
Apr 12 12:52:04 user nova-compute[71321]:   </metadata>
Apr 12 12:52:04 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:52:04 user nova-compute[71321]:     <system>
Apr 12 12:52:04 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:52:04 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:52:04 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:52:04 user nova-compute[71321]:       <entry name="serial">508746c9-705a-4d77-a528-454a10299411</entry>
Apr 12 12:52:04 user nova-compute[71321]:       <entry name="uuid">508746c9-705a-4d77-a528-454a10299411</entry>
Apr 12 12:52:04 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:52:04 user nova-compute[71321]:     </system>
Apr 12 12:52:04 user nova-compute[71321]:   </sysinfo>
Apr 12 12:52:04 user nova-compute[71321]:   <os>
Apr 12 12:52:04 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:52:04 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:52:04 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:52:04 user nova-compute[71321]:   </os>
Apr 12 12:52:04 user nova-compute[71321]:   <features>
Apr 12 12:52:04 user nova-compute[71321]:     <acpi/>
Apr 12 12:52:04 user nova-compute[71321]:     <apic/>
Apr 12 12:52:04 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:52:04 user nova-compute[71321]:   </features>
Apr 12 12:52:04 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:52:04 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:52:04 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:52:04 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:52:04 user nova-compute[71321]:   </clock>
Apr 12 12:52:04 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:52:04 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:52:04 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:52:04 user nova-compute[71321]:   </cpu>
Apr 12 12:52:04 user nova-compute[71321]:   <devices>
Apr 12 12:52:04 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:52:04 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:52:04 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk"/>
Apr 12 12:52:04 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:52:04 user nova-compute[71321]:     </disk>
Apr 12 12:52:04 user nova-compute[71321]:     <disk type="block" device="disk">
Apr 12 12:52:04 user nova-compute[71321]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:52:04 user nova-compute[71321]:       <source dev="/dev/sdb"/>
Apr 12 12:52:04 user nova-compute[71321]:       <target dev="vdb" bus="virtio"/>
Apr 12 12:52:04 user nova-compute[71321]:       <serial>3675f4a6-a994-41d9-9477-08b2f072dae0</serial>
Apr 12 12:52:04 user nova-compute[71321]:     </disk>
Apr 12 12:52:04 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:52:04 user nova-compute[71321]:       <mac address="fa:16:3e:5d:63:5c"/>
Apr 12 12:52:04 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:52:04 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:52:04 user nova-compute[71321]:       <target dev="tapdab72490-cd"/>
Apr 12 12:52:04 user nova-compute[71321]:     </interface>
Apr 12 12:52:04 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:52:04 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/console.log" append="off"/>
Apr 12 12:52:04 user nova-compute[71321]:     </serial>
Apr 12 12:52:04 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:52:04 user nova-compute[71321]:     <video>
Apr 12 12:52:04 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:52:04 user nova-compute[71321]:     </video>
Apr 12 12:52:04 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:52:04 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:52:04 user nova-compute[71321]:     </rng>
Apr 12 12:52:04 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:52:04 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:52:04 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:52:04 user nova-compute[71321]:     </memballoon>
Apr 12 12:52:04 user nova-compute[71321]:   </devices>
Apr 12 12:52:04 user nova-compute[71321]: </domain>
Apr 12 12:52:04 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG nova.objects.instance [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lazy-loading 'trusted_certs' on Instance uuid 508746c9-705a-4d77-a528-454a10299411 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cb950505b0632c66d01c462ac37fee3d8fbe1b9 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cb950505b0632c66d01c462ac37fee3d8fbe1b9 --force-share --output=json" returned: 0 in 0.140s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Checking if we can resize image /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Cannot resize image /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG nova.objects.instance [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lazy-loading 'migration_context' on Instance uuid 508746c9-705a-4d77-a528-454a10299411 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:49:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1462256376',display_name='tempest-TestMinimumBasicScenario-server-1462256376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1462256376',id=36,image_ref='71858585-d70e-4cf1-b2dc-0e5921c23e98',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzeWBX6IhC7gCQ6w0T3CIjF58xU+K7xE+03Z94BwQAzy1OeRNbL96UH1iSrsClMKm4rn8M5qup/LJ+NKAIWGUUK2r0ARV/KqOHOttU7oRuA6Ty3XfX6ezVU/ChdOvsk/g==',key_name='tempest-TestMinimumBasicScenario-1590711499',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:49:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='2f411f36f23e464fa4a395ad6b2b4472',ramdisk_id='',reservation_id='r-pmi48cyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='71858585-d70e-4cf1-b2dc-0e5921c23e98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-381334085',owner_user_name='tempest-TestMinimumBasicScenario-381334085-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:52:02Z,user_data=None,user_id='924c3a968d734a1c9ddfc5a44d8f6352',uuid=508746c9-705a-4d77-a528-454a10299411,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "address": "fa:16:3e:5d:63:5c", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab72490-cd", "ovs_interfaceid": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Converting VIF {"id": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "address": "fa:16:3e:5d:63:5c", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab72490-cd", "ovs_interfaceid": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:63:5c,bridge_name='br-int',has_traffic_filtering=True,id=dab72490-cdfa-4ffa-be0b-feda75d66bcb,network=Network(76f8fc2b-41cf-4efd-9820-c4d4056deaca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab72490-cd') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG os_vif [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:63:5c,bridge_name='br-int',has_traffic_filtering=True,id=dab72490-cdfa-4ffa-be0b-feda75d66bcb,network=Network(76f8fc2b-41cf-4efd-9820-c4d4056deaca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab72490-cd') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdab72490-cd, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdab72490-cd, col_values=(('external_ids', {'iface-id': 'dab72490-cdfa-4ffa-be0b-feda75d66bcb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:63:5c', 'vm-uuid': '508746c9-705a-4d77-a528-454a10299411'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:52:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:05 user nova-compute[71321]: INFO os_vif [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:63:5c,bridge_name='br-int',has_traffic_filtering=True,id=dab72490-cdfa-4ffa-be0b-feda75d66bcb,network=Network(76f8fc2b-41cf-4efd-9820-c4d4056deaca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab72490-cd')
Apr 12 12:52:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:06 user nova-compute[71321]: DEBUG nova.compute.manager [req-edff903e-cd9c-4d64-936c-1fcad998c71c req-ece1acc8-0722-4e2f-a007-e70ac8b9ade9 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Received event network-vif-plugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:52:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-edff903e-cd9c-4d64-936c-1fcad998c71c req-ece1acc8-0722-4e2f-a007-e70ac8b9ade9 service nova] Acquiring lock "508746c9-705a-4d77-a528-454a10299411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:52:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-edff903e-cd9c-4d64-936c-1fcad998c71c req-ece1acc8-0722-4e2f-a007-e70ac8b9ade9 service nova] Lock "508746c9-705a-4d77-a528-454a10299411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:52:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-edff903e-cd9c-4d64-936c-1fcad998c71c req-ece1acc8-0722-4e2f-a007-e70ac8b9ade9 service nova] Lock "508746c9-705a-4d77-a528-454a10299411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:52:06 user nova-compute[71321]: DEBUG nova.compute.manager [req-edff903e-cd9c-4d64-936c-1fcad998c71c req-ece1acc8-0722-4e2f-a007-e70ac8b9ade9 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] No waiting events found dispatching network-vif-plugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:52:06 user nova-compute[71321]: WARNING nova.compute.manager [req-edff903e-cd9c-4d64-936c-1fcad998c71c req-ece1acc8-0722-4e2f-a007-e70ac8b9ade9 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Received unexpected event network-vif-plugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb for instance with vm_state active and task_state reboot_started_hard.
Apr 12 12:52:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:08 user nova-compute[71321]: DEBUG nova.compute.manager [req-07d6cd83-effb-4fb1-8481-f8771ecddbba req-2b9b73f1-cbb0-46a6-a8ae-ceb391ece3b9 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Received event network-vif-plugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:52:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-07d6cd83-effb-4fb1-8481-f8771ecddbba req-2b9b73f1-cbb0-46a6-a8ae-ceb391ece3b9 service nova] Acquiring lock "508746c9-705a-4d77-a528-454a10299411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:52:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-07d6cd83-effb-4fb1-8481-f8771ecddbba req-2b9b73f1-cbb0-46a6-a8ae-ceb391ece3b9 service nova] Lock "508746c9-705a-4d77-a528-454a10299411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:52:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-07d6cd83-effb-4fb1-8481-f8771ecddbba req-2b9b73f1-cbb0-46a6-a8ae-ceb391ece3b9 service nova] Lock "508746c9-705a-4d77-a528-454a10299411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:52:08 user nova-compute[71321]: DEBUG nova.compute.manager [req-07d6cd83-effb-4fb1-8481-f8771ecddbba req-2b9b73f1-cbb0-46a6-a8ae-ceb391ece3b9 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] No waiting events found dispatching network-vif-plugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:52:08 user nova-compute[71321]: WARNING nova.compute.manager [req-07d6cd83-effb-4fb1-8481-f8771ecddbba req-2b9b73f1-cbb0-46a6-a8ae-ceb391ece3b9 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Received unexpected event network-vif-plugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb for instance with vm_state active and task_state reboot_started_hard.
Apr 12 12:52:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Removed pending event for 508746c9-705a-4d77-a528-454a10299411 due to event {{(pid=71321) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 12:52:08 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303928.7022388, 508746c9-705a-4d77-a528-454a10299411 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:52:08 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 508746c9-705a-4d77-a528-454a10299411] VM Resumed (Lifecycle Event)
Apr 12 12:52:08 user nova-compute[71321]: DEBUG nova.compute.manager [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:52:08 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 508746c9-705a-4d77-a528-454a10299411] Instance rebooted successfully.
Apr 12 12:52:08 user nova-compute[71321]: DEBUG nova.compute.manager [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:52:08 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 508746c9-705a-4d77-a528-454a10299411] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:52:08 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 508746c9-705a-4d77-a528-454a10299411] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:52:08 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 508746c9-705a-4d77-a528-454a10299411] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 12 12:52:08 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303928.7031662, 508746c9-705a-4d77-a528-454a10299411 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:52:08 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 508746c9-705a-4d77-a528-454a10299411] VM Started (Lifecycle Event)
Apr 12 12:52:08 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 508746c9-705a-4d77-a528-454a10299411] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:52:08 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 508746c9-705a-4d77-a528-454a10299411] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:52:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "508746c9-705a-4d77-a528-454a10299411" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.628s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:52:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7d3491c9-cfb1-4b7a-89e6-a34b8e414a0e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:52:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7d3491c9-cfb1-4b7a-89e6-a34b8e414a0e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:52:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7d3491c9-cfb1-4b7a-89e6-a34b8e414a0e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:52:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7d3491c9-cfb1-4b7a-89e6-a34b8e414a0e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:52:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7d3491c9-cfb1-4b7a-89e6-a34b8e414a0e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:52:11 user nova-compute[71321]: INFO nova.compute.manager [None req-7d3491c9-cfb1-4b7a-89e6-a34b8e414a0e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Terminating instance
Apr 12 12:52:11 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7d3491c9-cfb1-4b7a-89e6-a34b8e414a0e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:52:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:11 user nova-compute[71321]: DEBUG nova.compute.manager [req-90442222-d8fa-4747-9c10-7a18045457fd req-04ca3548-6a0d-4b99-901e-952c58d982ef service nova] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Received event network-vif-unplugged-01ee163a-4590-4b09-bcb5-a53d238252d8 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:52:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-90442222-d8fa-4747-9c10-7a18045457fd req-04ca3548-6a0d-4b99-901e-952c58d982ef service nova] Acquiring lock "a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:52:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-90442222-d8fa-4747-9c10-7a18045457fd req-04ca3548-6a0d-4b99-901e-952c58d982ef service nova] Lock "a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:52:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-90442222-d8fa-4747-9c10-7a18045457fd req-04ca3548-6a0d-4b99-901e-952c58d982ef service nova] Lock "a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:52:11 user nova-compute[71321]: DEBUG nova.compute.manager [req-90442222-d8fa-4747-9c10-7a18045457fd req-04ca3548-6a0d-4b99-901e-952c58d982ef service nova] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] No waiting events found dispatching network-vif-unplugged-01ee163a-4590-4b09-bcb5-a53d238252d8 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:52:11 user nova-compute[71321]: DEBUG nova.compute.manager [req-90442222-d8fa-4747-9c10-7a18045457fd req-04ca3548-6a0d-4b99-901e-952c58d982ef service nova] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Received event network-vif-unplugged-01ee163a-4590-4b09-bcb5-a53d238252d8 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:52:12 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Instance destroyed successfully.
Apr 12 12:52:12 user nova-compute[71321]: DEBUG nova.objects.instance [None req-7d3491c9-cfb1-4b7a-89e6-a34b8e414a0e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lazy-loading 'resources' on Instance uuid a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:52:12 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-7d3491c9-cfb1-4b7a-89e6-a34b8e414a0e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:42:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1256098765',display_name='tempest-ServerActionsTestJSON-server-1256098765',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1256098765',id=29,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9e64miZ/iyVASS4OS8AZthMPT8KBHm0byN/8NFP7U1AgI9/hOw/R+BSPozX14usgKt+VEqTE1BPs7aRGcfyuCZ/K0LBkD7enTbPYgw3NHHlO3PWScCWY1ae7IFb2uJEw==',key_name='tempest-keypair-1245622558',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:42:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ba5375005114c8594e0ae86b2f19093',ramdisk_id='',reservation_id='r-8j5c45m9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1233797030',owner_user_name='tempest-ServerActionsTestJSON-1233797030-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:42:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29f7f46d32f4465ba3e8b504c645c22f',uuid=a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01ee163a-4590-4b09-bcb5-a53d238252d8", "address": "fa:16:3e:36:a3:07", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01ee163a-45", "ovs_interfaceid": "01ee163a-4590-4b09-bcb5-a53d238252d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:52:12 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-7d3491c9-cfb1-4b7a-89e6-a34b8e414a0e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converting VIF {"id": "01ee163a-4590-4b09-bcb5-a53d238252d8", "address": "fa:16:3e:36:a3:07", "network": {"id": "6bd5aca2-dc12-4f05-af95-523f7a183a5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1652638760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ba5375005114c8594e0ae86b2f19093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01ee163a-45", "ovs_interfaceid": "01ee163a-4590-4b09-bcb5-a53d238252d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:52:12 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-7d3491c9-cfb1-4b7a-89e6-a34b8e414a0e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:a3:07,bridge_name='br-int',has_traffic_filtering=True,id=01ee163a-4590-4b09-bcb5-a53d238252d8,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01ee163a-45') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:52:12 user nova-compute[71321]: DEBUG os_vif [None req-7d3491c9-cfb1-4b7a-89e6-a34b8e414a0e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:a3:07,bridge_name='br-int',has_traffic_filtering=True,id=01ee163a-4590-4b09-bcb5-a53d238252d8,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01ee163a-45') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:52:12 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:12 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01ee163a-45, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:52:12 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:12 user nova-compute[71321]: INFO os_vif [None req-7d3491c9-cfb1-4b7a-89e6-a34b8e414a0e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:a3:07,bridge_name='br-int',has_traffic_filtering=True,id=01ee163a-4590-4b09-bcb5-a53d238252d8,network=Network(6bd5aca2-dc12-4f05-af95-523f7a183a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01ee163a-45')
Apr 12 12:52:12 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-7d3491c9-cfb1-4b7a-89e6-a34b8e414a0e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Deleting instance files /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7_del
Apr 12 12:52:12 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-7d3491c9-cfb1-4b7a-89e6-a34b8e414a0e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Deletion of /opt/stack/data/nova/instances/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7_del complete
Apr 12 12:52:12 user nova-compute[71321]: INFO nova.compute.manager [None req-7d3491c9-cfb1-4b7a-89e6-a34b8e414a0e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 12 12:52:12 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-7d3491c9-cfb1-4b7a-89e6-a34b8e414a0e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:52:12 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:52:12 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:52:12 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:52:12 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Took 0.48 seconds to deallocate network for instance.
Apr 12 12:52:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7d3491c9-cfb1-4b7a-89e6-a34b8e414a0e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:52:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7d3491c9-cfb1-4b7a-89e6-a34b8e414a0e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:52:12 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-7d3491c9-cfb1-4b7a-89e6-a34b8e414a0e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:52:12 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-7d3491c9-cfb1-4b7a-89e6-a34b8e414a0e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:52:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7d3491c9-cfb1-4b7a-89e6-a34b8e414a0e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:52:12 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-7d3491c9-cfb1-4b7a-89e6-a34b8e414a0e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Deleted allocations for instance a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7
Apr 12 12:52:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7d3491c9-cfb1-4b7a-89e6-a34b8e414a0e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.776s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:52:13 user nova-compute[71321]: DEBUG nova.compute.manager [req-e7ac8816-9615-415e-96b6-4e2afc7a56bf req-8c78d853-bcd3-4cbb-a970-9e3084d10050 service nova] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Received event network-vif-plugged-01ee163a-4590-4b09-bcb5-a53d238252d8 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:52:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e7ac8816-9615-415e-96b6-4e2afc7a56bf req-8c78d853-bcd3-4cbb-a970-9e3084d10050 service nova] Acquiring lock "a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:52:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e7ac8816-9615-415e-96b6-4e2afc7a56bf req-8c78d853-bcd3-4cbb-a970-9e3084d10050 service nova] Lock "a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:52:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e7ac8816-9615-415e-96b6-4e2afc7a56bf req-8c78d853-bcd3-4cbb-a970-9e3084d10050 service nova] Lock "a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:52:13 user nova-compute[71321]: DEBUG nova.compute.manager [req-e7ac8816-9615-415e-96b6-4e2afc7a56bf req-8c78d853-bcd3-4cbb-a970-9e3084d10050 service nova] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] No waiting events found dispatching network-vif-plugged-01ee163a-4590-4b09-bcb5-a53d238252d8 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:52:13 user nova-compute[71321]: WARNING nova.compute.manager [req-e7ac8816-9615-415e-96b6-4e2afc7a56bf req-8c78d853-bcd3-4cbb-a970-9e3084d10050 service nova] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Received unexpected event network-vif-plugged-01ee163a-4590-4b09-bcb5-a53d238252d8 for instance with vm_state deleted and task_state None.
Apr 12 12:52:13 user nova-compute[71321]: DEBUG nova.compute.manager [req-e7ac8816-9615-415e-96b6-4e2afc7a56bf req-8c78d853-bcd3-4cbb-a970-9e3084d10050 service nova] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Received event network-vif-deleted-01ee163a-4590-4b09-bcb5-a53d238252d8 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:52:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:52:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 12:52:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 12:52:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 12:52:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:27 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681303932.0204887, a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:52:27 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] VM Stopped (Lifecycle Event)
Apr 12 12:52:27 user nova-compute[71321]: DEBUG nova.compute.manager [None req-af2602a4-ca6e-44a5-868d-81bb12bb6462 None None] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:52:27 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:29 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:52:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:52:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:52:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:52:29 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:52:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:52:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:30 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:52:30 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:52:30 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:52:30 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8491MB free_disk=26.367904663085938GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:52:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:52:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:52:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:30 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance db9f1454-9e3c-40d4-849b-c13537d6be97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:52:30 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 508746c9-705a-4d77-a528-454a10299411 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:52:30 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:52:30 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:52:30 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:52:30 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:52:30 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:52:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:52:32 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:32 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:52:32 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:52:33 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:52:33 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "db9f1454-9e3c-40d4-849b-c13537d6be97" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:52:37 user nova-compute[71321]: INFO nova.compute.manager [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Detaching volume 02c22408-e0c3-41e4-817c-dc6057451b06
Apr 12 12:52:37 user nova-compute[71321]: INFO nova.virt.block_device [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Attempting to driver detach volume 02c22408-e0c3-41e4-817c-dc6057451b06 from mountpoint /dev/vdb
Apr 12 12:52:37 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Attempting to detach device vdb from instance db9f1454-9e3c-40d4-849b-c13537d6be97 from the persistent domain config. {{(pid=71321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:52:37 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:52:37 user nova-compute[71321]:   <source dev="/dev/sdd"/>
Apr 12 12:52:37 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:52:37 user nova-compute[71321]:   <serial>02c22408-e0c3-41e4-817c-dc6057451b06</serial>
Apr 12 12:52:37 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 12:52:37 user nova-compute[71321]: </disk>
Apr 12 12:52:37 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:52:37 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Successfully detached device vdb from instance db9f1454-9e3c-40d4-849b-c13537d6be97 from the persistent domain config.
Apr 12 12:52:37 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance db9f1454-9e3c-40d4-849b-c13537d6be97 from the live domain config. {{(pid=71321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:52:37 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:52:37 user nova-compute[71321]:   <source dev="/dev/sdd"/>
Apr 12 12:52:37 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:52:37 user nova-compute[71321]:   <serial>02c22408-e0c3-41e4-817c-dc6057451b06</serial>
Apr 12 12:52:37 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 12:52:37 user nova-compute[71321]: </disk>
Apr 12 12:52:37 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Received event <DeviceRemovedEvent: 1681303957.7370768, db9f1454-9e3c-40d4-849b-c13537d6be97 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance db9f1454-9e3c-40d4-849b-c13537d6be97 {{(pid=71321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 12:52:37 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Successfully detached device vdb from instance db9f1454-9e3c-40d4-849b-c13537d6be97 from the live domain config.
Apr 12 12:52:37 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vFhwTVmp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:52:37 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:52:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdf701f-16da-4476-80d1-21ed3ae1f227]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:52:37 user nova-compute[71321]: No targets found.
Apr 12 12:52:37 user nova-compute[71321]: iSNS:
Apr 12 12:52:37 user nova-compute[71321]: No targets found.
Apr 12 12:52:37 user nova-compute[71321]: STATIC:
Apr 12 12:52:37 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0
Apr 12 12:52:37 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:52:37 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:52:37 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06
Apr 12 12:52:37 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:52:37 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:52:37 user nova-compute[71321]: FIRMWARE:
Apr 12 12:52:37 user nova-compute[71321]: No targets found.
Apr 12 12:52:37 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:52:37 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:52:37 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9506af-0b87-45d2-ac04-e627986007d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2447bda3-18e8-4a32-a8f2-54aeabd25af9]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 (non-flash)
Apr 12 12:52:37 user nova-compute[71321]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 (non-flash)
Apr 12 12:52:37 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 (non-flash)
Apr 12 12:52:37 user nova-compute[71321]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 (non-flash)
Apr 12 12:52:37 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef7c1ede10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06'): ({'sdd'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Removing single pathed devices sdd {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd33c8d-03d8-4fa6-af6e-dc863ff062c4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[331fcec3-0c95-4891-af23-39d0b607759b]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Flushing IO for device /dev/sdd {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb8f07d-1731-4877-94d4-d4b93cffedc3]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4066d54-961d-4a6d-9eeb-a9e302e38e00]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] SCSI volumes sdd have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[562b305c-f511-4bf8-b97b-ecaa39d33e63]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:52:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:38 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[72de0c1a-1e90-4fbc-aa92-ac00b9425a95]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:52:38 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06, portal: 172.16.0.220,3260]
Apr 12 12:52:38 user nova-compute[71321]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06, portal: 172.16.0.220,3260] successful.
Apr 12 12:52:38 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:52:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c22408-e0c3-41e4-817c-dc6057451b06 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:38 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f786e334-827c-4469-b6e7-f07bfb97b4a6]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:52:38 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:52:38 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:52:38 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] <== disconnect_volume: return (314ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:52:38 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:52:38 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:52:38 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:52:38 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Didn't find any instances for network info cache update. {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 12:52:38 user nova-compute[71321]: DEBUG nova.objects.instance [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'flavor' on Instance uuid db9f1454-9e3c-40d4-849b-c13537d6be97 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:52:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.700s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:52:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fee1d10c-f5e4-47a9-9e68-07a919c18536 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "db9f1454-9e3c-40d4-849b-c13537d6be97" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:52:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fee1d10c-f5e4-47a9-9e68-07a919c18536 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:52:39 user nova-compute[71321]: DEBUG nova.compute.manager [None req-fee1d10c-f5e4-47a9-9e68-07a919c18536 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:52:39 user nova-compute[71321]: DEBUG nova.compute.manager [None req-fee1d10c-f5e4-47a9-9e68-07a919c18536 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71321) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 12 12:52:39 user nova-compute[71321]: DEBUG nova.objects.instance [None req-fee1d10c-f5e4-47a9-9e68-07a919c18536 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'flavor' on Instance uuid db9f1454-9e3c-40d4-849b-c13537d6be97 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:52:39 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:39 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:39 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "2647400c-e0e8-4fcb-9fa6-b4ab35197ded" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:52:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "2647400c-e0e8-4fcb-9fa6-b4ab35197ded" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:52:39 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:52:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:52:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:52:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-d5b23779-bb16-4afa-bebe-2f0af3cc31fb req-8272844a-30cc-4bca-b0c0-b45f71e3c11c service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Received event network-vif-unplugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:52:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d5b23779-bb16-4afa-bebe-2f0af3cc31fb req-8272844a-30cc-4bca-b0c0-b45f71e3c11c service nova] Acquiring lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:52:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d5b23779-bb16-4afa-bebe-2f0af3cc31fb req-8272844a-30cc-4bca-b0c0-b45f71e3c11c service nova] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:52:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d5b23779-bb16-4afa-bebe-2f0af3cc31fb req-8272844a-30cc-4bca-b0c0-b45f71e3c11c service nova] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:52:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-d5b23779-bb16-4afa-bebe-2f0af3cc31fb req-8272844a-30cc-4bca-b0c0-b45f71e3c11c service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] No waiting events found dispatching network-vif-unplugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:52:39 user nova-compute[71321]: WARNING nova.compute.manager [req-d5b23779-bb16-4afa-bebe-2f0af3cc31fb req-8272844a-30cc-4bca-b0c0-b45f71e3c11c service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Received unexpected event network-vif-unplugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b for instance with vm_state active and task_state powering-off.
Apr 12 12:52:39 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:52:39 user nova-compute[71321]: INFO nova.compute.claims [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Claim successful on node user
Apr 12 12:52:40 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:52:40 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:52:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.254s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:52:40 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:52:40 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:52:40 user nova-compute[71321]: DEBUG nova.network.neutron [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:52:40 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:52:40 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:52:40 user nova-compute[71321]: DEBUG nova.policy [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a3d9f4516bee4f8d9af7a40ed1298f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61975273ccb41229e0138b96eb7f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:52:40 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Instance destroyed successfully.
Apr 12 12:52:40 user nova-compute[71321]: DEBUG nova.compute.manager [None req-fee1d10c-f5e4-47a9-9e68-07a919c18536 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:52:40 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:52:40 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:52:40 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Creating image(s)
Apr 12 12:52:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "/opt/stack/data/nova/instances/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:52:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "/opt/stack/data/nova/instances/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:52:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "/opt/stack/data/nova/instances/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.020s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:52:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fee1d10c-f5e4-47a9-9e68-07a919c18536 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.881s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:52:40 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:52:40 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:52:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.144s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:52:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:52:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.132s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/disk 1073741824" returned: 0 in 0.047s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.186s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:52:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.135s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:40 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:52:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:52:40 user nova-compute[71321]: DEBUG nova.network.neutron [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Successfully created port: 905fcda2-3c86-4694-a6a5-8a3ba5caddc2 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:52:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:52:41 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Cannot resize image /opt/stack/data/nova/instances/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:52:41 user nova-compute[71321]: DEBUG nova.objects.instance [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lazy-loading 'migration_context' on Instance uuid 2647400c-e0e8-4fcb-9fa6-b4ab35197ded {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:52:41 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:52:41 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Ensure instance console log exists: /opt/stack/data/nova/instances/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:52:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:52:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:52:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:52:41 user nova-compute[71321]: DEBUG nova.network.neutron [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Successfully updated port: 905fcda2-3c86-4694-a6a5-8a3ba5caddc2 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:52:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "refresh_cache-2647400c-e0e8-4fcb-9fa6-b4ab35197ded" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:52:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquired lock "refresh_cache-2647400c-e0e8-4fcb-9fa6-b4ab35197ded" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:52:41 user nova-compute[71321]: DEBUG nova.network.neutron [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:52:41 user nova-compute[71321]: DEBUG nova.compute.manager [req-f61510dd-4672-4b58-b520-cfb95888ceb0 req-f3823805-bbd2-42b2-97ec-67e70addf2b0 service nova] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Received event network-changed-905fcda2-3c86-4694-a6a5-8a3ba5caddc2 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:52:41 user nova-compute[71321]: DEBUG nova.compute.manager [req-f61510dd-4672-4b58-b520-cfb95888ceb0 req-f3823805-bbd2-42b2-97ec-67e70addf2b0 service nova] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Refreshing instance network info cache due to event network-changed-905fcda2-3c86-4694-a6a5-8a3ba5caddc2. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:52:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f61510dd-4672-4b58-b520-cfb95888ceb0 req-f3823805-bbd2-42b2-97ec-67e70addf2b0 service nova] Acquiring lock "refresh_cache-2647400c-e0e8-4fcb-9fa6-b4ab35197ded" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:52:41 user nova-compute[71321]: DEBUG nova.network.neutron [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:52:41 user nova-compute[71321]: DEBUG nova.compute.manager [req-c87cb3fa-3ad5-4729-acc0-a4a6644a7192 req-ae5f00ca-6e9d-4e58-94b1-d8ab5a448e54 service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Received event network-vif-plugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:52:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c87cb3fa-3ad5-4729-acc0-a4a6644a7192 req-ae5f00ca-6e9d-4e58-94b1-d8ab5a448e54 service nova] Acquiring lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:52:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c87cb3fa-3ad5-4729-acc0-a4a6644a7192 req-ae5f00ca-6e9d-4e58-94b1-d8ab5a448e54 service nova] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:52:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c87cb3fa-3ad5-4729-acc0-a4a6644a7192 req-ae5f00ca-6e9d-4e58-94b1-d8ab5a448e54 service nova] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:52:41 user nova-compute[71321]: DEBUG nova.compute.manager [req-c87cb3fa-3ad5-4729-acc0-a4a6644a7192 req-ae5f00ca-6e9d-4e58-94b1-d8ab5a448e54 service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] No waiting events found dispatching network-vif-plugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:52:41 user nova-compute[71321]: WARNING nova.compute.manager [req-c87cb3fa-3ad5-4729-acc0-a4a6644a7192 req-ae5f00ca-6e9d-4e58-94b1-d8ab5a448e54 service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Received unexpected event network-vif-plugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b for instance with vm_state stopped and task_state None.
Apr 12 12:52:41 user nova-compute[71321]: DEBUG nova.network.neutron [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Updating instance_info_cache with network_info: [{"id": "905fcda2-3c86-4694-a6a5-8a3ba5caddc2", "address": "fa:16:3e:3a:17:b8", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap905fcda2-3c", "ovs_interfaceid": "905fcda2-3c86-4694-a6a5-8a3ba5caddc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:52:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Releasing lock "refresh_cache-2647400c-e0e8-4fcb-9fa6-b4ab35197ded" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:52:41 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Instance network_info: |[{"id": "905fcda2-3c86-4694-a6a5-8a3ba5caddc2", "address": "fa:16:3e:3a:17:b8", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap905fcda2-3c", "ovs_interfaceid": "905fcda2-3c86-4694-a6a5-8a3ba5caddc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:52:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f61510dd-4672-4b58-b520-cfb95888ceb0 req-f3823805-bbd2-42b2-97ec-67e70addf2b0 service nova] Acquired lock "refresh_cache-2647400c-e0e8-4fcb-9fa6-b4ab35197ded" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:52:41 user nova-compute[71321]: DEBUG nova.network.neutron [req-f61510dd-4672-4b58-b520-cfb95888ceb0 req-f3823805-bbd2-42b2-97ec-67e70addf2b0 service nova] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Refreshing network info cache for port 905fcda2-3c86-4694-a6a5-8a3ba5caddc2 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Start _get_guest_xml network_info=[{"id": "905fcda2-3c86-4694-a6a5-8a3ba5caddc2", "address": "fa:16:3e:3a:17:b8", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap905fcda2-3c", "ovs_interfaceid": "905fcda2-3c86-4694-a6a5-8a3ba5caddc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:52:42 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:52:42 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:52:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:52:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-340676982',display_name='tempest-AttachVolumeNegativeTest-server-340676982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-340676982',id=37,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMLQV4OYLyMmtyTwZQdfM7eQv90t/w0Zy18uxOBWsTm7SBpfqSmHMZQX/a46Mf0UUJAryT8HawQd0Kl3bVzgXGFh3W1gBTGM674XVwhaaRT7BEtN9RyRIJIyGrXcCufZzg==',key_name='tempest-keypair-1839792919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e61975273ccb41229e0138b96eb7f5e9',ramdisk_id='',reservation_id='r-6ssbt4bk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-941338837',owner_user_name='tempest-AttachVolumeNegativeTest-941338837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:52:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3d9f4516bee4f8d9af7a40ed1298f03',uuid=2647400c-e0e8-4fcb-9fa6-b4ab35197ded,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "905fcda2-3c86-4694-a6a5-8a3ba5caddc2", "address": "fa:16:3e:3a:17:b8", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap905fcda2-3c", "ovs_interfaceid": "905fcda2-3c86-4694-a6a5-8a3ba5caddc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Converting VIF {"id": "905fcda2-3c86-4694-a6a5-8a3ba5caddc2", "address": "fa:16:3e:3a:17:b8", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap905fcda2-3c", "ovs_interfaceid": "905fcda2-3c86-4694-a6a5-8a3ba5caddc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:17:b8,bridge_name='br-int',has_traffic_filtering=True,id=905fcda2-3c86-4694-a6a5-8a3ba5caddc2,network=Network(e211a286-ade0-4930-a327-4c6a41785094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap905fcda2-3c') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG nova.objects.instance [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lazy-loading 'pci_devices' on Instance uuid 2647400c-e0e8-4fcb-9fa6-b4ab35197ded {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:52:42 user nova-compute[71321]:   <uuid>2647400c-e0e8-4fcb-9fa6-b4ab35197ded</uuid>
Apr 12 12:52:42 user nova-compute[71321]:   <name>instance-00000025</name>
Apr 12 12:52:42 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:52:42 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:52:42 user nova-compute[71321]:   <metadata>
Apr 12 12:52:42 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:52:42 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:52:42 user nova-compute[71321]:       <nova:name>tempest-AttachVolumeNegativeTest-server-340676982</nova:name>
Apr 12 12:52:42 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:52:42</nova:creationTime>
Apr 12 12:52:42 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:52:42 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:52:42 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:52:42 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:52:42 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:52:42 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:52:42 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:52:42 user nova-compute[71321]:       <nova:owner>
Apr 12 12:52:42 user nova-compute[71321]:         <nova:user uuid="a3d9f4516bee4f8d9af7a40ed1298f03">tempest-AttachVolumeNegativeTest-941338837-project-member</nova:user>
Apr 12 12:52:42 user nova-compute[71321]:         <nova:project uuid="e61975273ccb41229e0138b96eb7f5e9">tempest-AttachVolumeNegativeTest-941338837</nova:project>
Apr 12 12:52:42 user nova-compute[71321]:       </nova:owner>
Apr 12 12:52:42 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:52:42 user nova-compute[71321]:       <nova:ports>
Apr 12 12:52:42 user nova-compute[71321]:         <nova:port uuid="905fcda2-3c86-4694-a6a5-8a3ba5caddc2">
Apr 12 12:52:42 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 12:52:42 user nova-compute[71321]:         </nova:port>
Apr 12 12:52:42 user nova-compute[71321]:       </nova:ports>
Apr 12 12:52:42 user nova-compute[71321]:     </nova:instance>
Apr 12 12:52:42 user nova-compute[71321]:   </metadata>
Apr 12 12:52:42 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:52:42 user nova-compute[71321]:     <system>
Apr 12 12:52:42 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:52:42 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:52:42 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:52:42 user nova-compute[71321]:       <entry name="serial">2647400c-e0e8-4fcb-9fa6-b4ab35197ded</entry>
Apr 12 12:52:42 user nova-compute[71321]:       <entry name="uuid">2647400c-e0e8-4fcb-9fa6-b4ab35197ded</entry>
Apr 12 12:52:42 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:52:42 user nova-compute[71321]:     </system>
Apr 12 12:52:42 user nova-compute[71321]:   </sysinfo>
Apr 12 12:52:42 user nova-compute[71321]:   <os>
Apr 12 12:52:42 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:52:42 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:52:42 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:52:42 user nova-compute[71321]:   </os>
Apr 12 12:52:42 user nova-compute[71321]:   <features>
Apr 12 12:52:42 user nova-compute[71321]:     <acpi/>
Apr 12 12:52:42 user nova-compute[71321]:     <apic/>
Apr 12 12:52:42 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:52:42 user nova-compute[71321]:   </features>
Apr 12 12:52:42 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:52:42 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:52:42 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:52:42 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:52:42 user nova-compute[71321]:   </clock>
Apr 12 12:52:42 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:52:42 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:52:42 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:52:42 user nova-compute[71321]:   </cpu>
Apr 12 12:52:42 user nova-compute[71321]:   <devices>
Apr 12 12:52:42 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:52:42 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:52:42 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/disk"/>
Apr 12 12:52:42 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:52:42 user nova-compute[71321]:     </disk>
Apr 12 12:52:42 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:52:42 user nova-compute[71321]:       <mac address="fa:16:3e:3a:17:b8"/>
Apr 12 12:52:42 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:52:42 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:52:42 user nova-compute[71321]:       <target dev="tap905fcda2-3c"/>
Apr 12 12:52:42 user nova-compute[71321]:     </interface>
Apr 12 12:52:42 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:52:42 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/console.log" append="off"/>
Apr 12 12:52:42 user nova-compute[71321]:     </serial>
Apr 12 12:52:42 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:52:42 user nova-compute[71321]:     <video>
Apr 12 12:52:42 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:52:42 user nova-compute[71321]:     </video>
Apr 12 12:52:42 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:52:42 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:52:42 user nova-compute[71321]:     </rng>
Apr 12 12:52:42 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:52:42 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:52:42 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:52:42 user nova-compute[71321]:     </memballoon>
Apr 12 12:52:42 user nova-compute[71321]:   </devices>
Apr 12 12:52:42 user nova-compute[71321]: </domain>
Apr 12 12:52:42 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:52:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-340676982',display_name='tempest-AttachVolumeNegativeTest-server-340676982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-340676982',id=37,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMLQV4OYLyMmtyTwZQdfM7eQv90t/w0Zy18uxOBWsTm7SBpfqSmHMZQX/a46Mf0UUJAryT8HawQd0Kl3bVzgXGFh3W1gBTGM674XVwhaaRT7BEtN9RyRIJIyGrXcCufZzg==',key_name='tempest-keypair-1839792919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e61975273ccb41229e0138b96eb7f5e9',ramdisk_id='',reservation_id='r-6ssbt4bk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-941338837',owner_user_name='tempest-AttachVolumeNegativeTest-941338837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:52:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3d9f4516bee4f8d9af7a40ed1298f03',uuid=2647400c-e0e8-4fcb-9fa6-b4ab35197ded,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "905fcda2-3c86-4694-a6a5-8a3ba5caddc2", "address": "fa:16:3e:3a:17:b8", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap905fcda2-3c", "ovs_interfaceid": "905fcda2-3c86-4694-a6a5-8a3ba5caddc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Converting VIF {"id": "905fcda2-3c86-4694-a6a5-8a3ba5caddc2", "address": "fa:16:3e:3a:17:b8", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap905fcda2-3c", "ovs_interfaceid": "905fcda2-3c86-4694-a6a5-8a3ba5caddc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:17:b8,bridge_name='br-int',has_traffic_filtering=True,id=905fcda2-3c86-4694-a6a5-8a3ba5caddc2,network=Network(e211a286-ade0-4930-a327-4c6a41785094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap905fcda2-3c') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG os_vif [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:17:b8,bridge_name='br-int',has_traffic_filtering=True,id=905fcda2-3c86-4694-a6a5-8a3ba5caddc2,network=Network(e211a286-ade0-4930-a327-4c6a41785094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap905fcda2-3c') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap905fcda2-3c, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap905fcda2-3c, col_values=(('external_ids', {'iface-id': '905fcda2-3c86-4694-a6a5-8a3ba5caddc2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:17:b8', 'vm-uuid': '2647400c-e0e8-4fcb-9fa6-b4ab35197ded'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:42 user nova-compute[71321]: INFO os_vif [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:17:b8,bridge_name='br-int',has_traffic_filtering=True,id=905fcda2-3c86-4694-a6a5-8a3ba5caddc2,network=Network(e211a286-ade0-4930-a327-4c6a41785094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap905fcda2-3c')
Apr 12 12:52:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] No VIF found with MAC fa:16:3e:3a:17:b8, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG nova.network.neutron [req-f61510dd-4672-4b58-b520-cfb95888ceb0 req-f3823805-bbd2-42b2-97ec-67e70addf2b0 service nova] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Updated VIF entry in instance network info cache for port 905fcda2-3c86-4694-a6a5-8a3ba5caddc2. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG nova.network.neutron [req-f61510dd-4672-4b58-b520-cfb95888ceb0 req-f3823805-bbd2-42b2-97ec-67e70addf2b0 service nova] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Updating instance_info_cache with network_info: [{"id": "905fcda2-3c86-4694-a6a5-8a3ba5caddc2", "address": "fa:16:3e:3a:17:b8", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap905fcda2-3c", "ovs_interfaceid": "905fcda2-3c86-4694-a6a5-8a3ba5caddc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:52:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-f61510dd-4672-4b58-b520-cfb95888ceb0 req-f3823805-bbd2-42b2-97ec-67e70addf2b0 service nova] Releasing lock "refresh_cache-2647400c-e0e8-4fcb-9fa6-b4ab35197ded" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:52:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:43 user nova-compute[71321]: DEBUG nova.compute.manager [req-665fdbef-adf7-4308-9071-cc009c88c21d req-5f495298-54a2-406c-a647-50ce7be9a69b service nova] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Received event network-vif-plugged-905fcda2-3c86-4694-a6a5-8a3ba5caddc2 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:52:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-665fdbef-adf7-4308-9071-cc009c88c21d req-5f495298-54a2-406c-a647-50ce7be9a69b service nova] Acquiring lock "2647400c-e0e8-4fcb-9fa6-b4ab35197ded-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:52:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-665fdbef-adf7-4308-9071-cc009c88c21d req-5f495298-54a2-406c-a647-50ce7be9a69b service nova] Lock "2647400c-e0e8-4fcb-9fa6-b4ab35197ded-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:52:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-665fdbef-adf7-4308-9071-cc009c88c21d req-5f495298-54a2-406c-a647-50ce7be9a69b service nova] Lock "2647400c-e0e8-4fcb-9fa6-b4ab35197ded-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:52:43 user nova-compute[71321]: DEBUG nova.compute.manager [req-665fdbef-adf7-4308-9071-cc009c88c21d req-5f495298-54a2-406c-a647-50ce7be9a69b service nova] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] No waiting events found dispatching network-vif-plugged-905fcda2-3c86-4694-a6a5-8a3ba5caddc2 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:52:43 user nova-compute[71321]: WARNING nova.compute.manager [req-665fdbef-adf7-4308-9071-cc009c88c21d req-5f495298-54a2-406c-a647-50ce7be9a69b service nova] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Received unexpected event network-vif-plugged-905fcda2-3c86-4694-a6a5-8a3ba5caddc2 for instance with vm_state building and task_state spawning.
Apr 12 12:52:43 user nova-compute[71321]: DEBUG nova.compute.manager [req-665fdbef-adf7-4308-9071-cc009c88c21d req-5f495298-54a2-406c-a647-50ce7be9a69b service nova] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Received event network-vif-plugged-905fcda2-3c86-4694-a6a5-8a3ba5caddc2 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:52:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-665fdbef-adf7-4308-9071-cc009c88c21d req-5f495298-54a2-406c-a647-50ce7be9a69b service nova] Acquiring lock "2647400c-e0e8-4fcb-9fa6-b4ab35197ded-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:52:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-665fdbef-adf7-4308-9071-cc009c88c21d req-5f495298-54a2-406c-a647-50ce7be9a69b service nova] Lock "2647400c-e0e8-4fcb-9fa6-b4ab35197ded-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:52:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-665fdbef-adf7-4308-9071-cc009c88c21d req-5f495298-54a2-406c-a647-50ce7be9a69b service nova] Lock "2647400c-e0e8-4fcb-9fa6-b4ab35197ded-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:52:43 user nova-compute[71321]: DEBUG nova.compute.manager [req-665fdbef-adf7-4308-9071-cc009c88c21d req-5f495298-54a2-406c-a647-50ce7be9a69b service nova] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] No waiting events found dispatching network-vif-plugged-905fcda2-3c86-4694-a6a5-8a3ba5caddc2 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:52:43 user nova-compute[71321]: WARNING nova.compute.manager [req-665fdbef-adf7-4308-9071-cc009c88c21d req-5f495298-54a2-406c-a647-50ce7be9a69b service nova] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Received unexpected event network-vif-plugged-905fcda2-3c86-4694-a6a5-8a3ba5caddc2 for instance with vm_state building and task_state spawning.
Apr 12 12:52:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:45 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303965.5864184, 2647400c-e0e8-4fcb-9fa6-b4ab35197ded => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:52:45 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] VM Resumed (Lifecycle Event)
Apr 12 12:52:45 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:52:45 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:52:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:45 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Instance spawned successfully.
Apr 12 12:52:45 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:52:45 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:52:45 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:52:45 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:52:45 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:52:45 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:52:45 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:52:45 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:52:45 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:52:45 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:52:45 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681303965.5883563, 2647400c-e0e8-4fcb-9fa6-b4ab35197ded => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:52:45 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] VM Started (Lifecycle Event)
Apr 12 12:52:45 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:52:45 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:52:45 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:52:45 user nova-compute[71321]: INFO nova.compute.manager [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Took 5.36 seconds to spawn the instance on the hypervisor.
Apr 12 12:52:45 user nova-compute[71321]: DEBUG nova.compute.manager [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:52:45 user nova-compute[71321]: INFO nova.compute.manager [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Took 5.93 seconds to build instance.
Apr 12 12:52:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "2647400c-e0e8-4fcb-9fa6-b4ab35197ded" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.025s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:52:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:55 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681303960.3238037, db9f1454-9e3c-40d4-849b-c13537d6be97 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:52:55 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] VM Stopped (Lifecycle Event)
Apr 12 12:52:55 user nova-compute[71321]: DEBUG nova.compute.manager [None req-183edef7-2bd6-462f-af2e-cf4d713bd937 None None] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:52:55 user nova-compute[71321]: DEBUG nova.compute.manager [None req-183edef7-2bd6-462f-af2e-cf4d713bd937 None None] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:52:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:52:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:12 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:53:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:53:18 user nova-compute[71321]: DEBUG nova.compute.manager [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:53:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:53:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:53:18 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:53:18 user nova-compute[71321]: INFO nova.compute.claims [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Claim successful on node user
Apr 12 12:53:18 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:53:18 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:53:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.252s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:53:18 user nova-compute[71321]: DEBUG nova.compute.manager [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:53:18 user nova-compute[71321]: DEBUG nova.compute.manager [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:53:18 user nova-compute[71321]: DEBUG nova.network.neutron [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:53:19 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:53:19 user nova-compute[71321]: DEBUG nova.policy [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:53:19 user nova-compute[71321]: DEBUG nova.compute.manager [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:53:19 user nova-compute[71321]: DEBUG nova.compute.manager [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:53:19 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:53:19 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Creating image(s)
Apr 12 12:53:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "/opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:53:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "/opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:53:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "/opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:53:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:53:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.134s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:53:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:53:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:53:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:53:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.138s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:53:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:53:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk 1073741824" returned: 0 in 0.048s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:53:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:53:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:53:19 user nova-compute[71321]: DEBUG nova.network.neutron [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Successfully created port: 9f228391-1910-4bd3-b317-f1afa3e98a0f {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:53:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.141s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:53:19 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:53:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:53:19 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:53:19 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Cannot resize image /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:53:19 user nova-compute[71321]: DEBUG nova.objects.instance [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lazy-loading 'migration_context' on Instance uuid e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:53:19 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:53:19 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Ensure instance console log exists: /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:53:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:53:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:53:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG nova.network.neutron [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Successfully updated port: 9f228391-1910-4bd3-b317-f1afa3e98a0f {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "refresh_cache-e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquired lock "refresh_cache-e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG nova.network.neutron [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG nova.compute.manager [req-c53a4777-d5f7-43c2-b675-f260d4230701 req-9c16f6aa-c588-46e8-9326-41145e407f5d service nova] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Received event network-changed-9f228391-1910-4bd3-b317-f1afa3e98a0f {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG nova.compute.manager [req-c53a4777-d5f7-43c2-b675-f260d4230701 req-9c16f6aa-c588-46e8-9326-41145e407f5d service nova] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Refreshing instance network info cache due to event network-changed-9f228391-1910-4bd3-b317-f1afa3e98a0f. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c53a4777-d5f7-43c2-b675-f260d4230701 req-9c16f6aa-c588-46e8-9326-41145e407f5d service nova] Acquiring lock "refresh_cache-e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG nova.network.neutron [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG nova.network.neutron [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Updating instance_info_cache with network_info: [{"id": "9f228391-1910-4bd3-b317-f1afa3e98a0f", "address": "fa:16:3e:bf:a8:a8", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f228391-19", "ovs_interfaceid": "9f228391-1910-4bd3-b317-f1afa3e98a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Releasing lock "refresh_cache-e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG nova.compute.manager [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Instance network_info: |[{"id": "9f228391-1910-4bd3-b317-f1afa3e98a0f", "address": "fa:16:3e:bf:a8:a8", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f228391-19", "ovs_interfaceid": "9f228391-1910-4bd3-b317-f1afa3e98a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c53a4777-d5f7-43c2-b675-f260d4230701 req-9c16f6aa-c588-46e8-9326-41145e407f5d service nova] Acquired lock "refresh_cache-e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG nova.network.neutron [req-c53a4777-d5f7-43c2-b675-f260d4230701 req-9c16f6aa-c588-46e8-9326-41145e407f5d service nova] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Refreshing network info cache for port 9f228391-1910-4bd3-b317-f1afa3e98a0f {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Start _get_guest_xml network_info=[{"id": "9f228391-1910-4bd3-b317-f1afa3e98a0f", "address": "fa:16:3e:bf:a8:a8", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f228391-19", "ovs_interfaceid": "9f228391-1910-4bd3-b317-f1afa3e98a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:53:20 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:53:20 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:53:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1011361966',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1011361966',id=38,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f20ad21427a04683b9b102d2ff0290a5',ramdisk_id='',reservation_id='r-mqqg1rqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-636247513',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:53:19Z,user_data=None,user_id='435e0d6fd2b3437f837e82730b4d955f',uuid=e0752f9c-73b1-4cb8-82a9-ca6ce9141a26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f228391-1910-4bd3-b317-f1afa3e98a0f", "address": "fa:16:3e:bf:a8:a8", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f228391-19", "ovs_interfaceid": "9f228391-1910-4bd3-b317-f1afa3e98a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Converting VIF {"id": "9f228391-1910-4bd3-b317-f1afa3e98a0f", "address": "fa:16:3e:bf:a8:a8", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f228391-19", "ovs_interfaceid": "9f228391-1910-4bd3-b317-f1afa3e98a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a8:a8,bridge_name='br-int',has_traffic_filtering=True,id=9f228391-1910-4bd3-b317-f1afa3e98a0f,network=Network(bb52f82e-56ca-41f7-b171-a3cacb549ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f228391-19') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG nova.objects.instance [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lazy-loading 'pci_devices' on Instance uuid e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:53:20 user nova-compute[71321]:   <uuid>e0752f9c-73b1-4cb8-82a9-ca6ce9141a26</uuid>
Apr 12 12:53:20 user nova-compute[71321]:   <name>instance-00000026</name>
Apr 12 12:53:20 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:53:20 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:53:20 user nova-compute[71321]:   <metadata>
Apr 12 12:53:20 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:53:20 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:53:20 user nova-compute[71321]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1011361966</nova:name>
Apr 12 12:53:20 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:53:20</nova:creationTime>
Apr 12 12:53:20 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:53:20 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:53:20 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:53:20 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:53:20 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:53:20 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:53:20 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:53:20 user nova-compute[71321]:       <nova:owner>
Apr 12 12:53:20 user nova-compute[71321]:         <nova:user uuid="435e0d6fd2b3437f837e82730b4d955f">tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member</nova:user>
Apr 12 12:53:20 user nova-compute[71321]:         <nova:project uuid="f20ad21427a04683b9b102d2ff0290a5">tempest-ServerBootFromVolumeStableRescueTest-636247513</nova:project>
Apr 12 12:53:20 user nova-compute[71321]:       </nova:owner>
Apr 12 12:53:20 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:53:20 user nova-compute[71321]:       <nova:ports>
Apr 12 12:53:20 user nova-compute[71321]:         <nova:port uuid="9f228391-1910-4bd3-b317-f1afa3e98a0f">
Apr 12 12:53:20 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 12:53:20 user nova-compute[71321]:         </nova:port>
Apr 12 12:53:20 user nova-compute[71321]:       </nova:ports>
Apr 12 12:53:20 user nova-compute[71321]:     </nova:instance>
Apr 12 12:53:20 user nova-compute[71321]:   </metadata>
Apr 12 12:53:20 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:53:20 user nova-compute[71321]:     <system>
Apr 12 12:53:20 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:53:20 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:53:20 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:53:20 user nova-compute[71321]:       <entry name="serial">e0752f9c-73b1-4cb8-82a9-ca6ce9141a26</entry>
Apr 12 12:53:20 user nova-compute[71321]:       <entry name="uuid">e0752f9c-73b1-4cb8-82a9-ca6ce9141a26</entry>
Apr 12 12:53:20 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:53:20 user nova-compute[71321]:     </system>
Apr 12 12:53:20 user nova-compute[71321]:   </sysinfo>
Apr 12 12:53:20 user nova-compute[71321]:   <os>
Apr 12 12:53:20 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:53:20 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:53:20 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:53:20 user nova-compute[71321]:   </os>
Apr 12 12:53:20 user nova-compute[71321]:   <features>
Apr 12 12:53:20 user nova-compute[71321]:     <acpi/>
Apr 12 12:53:20 user nova-compute[71321]:     <apic/>
Apr 12 12:53:20 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:53:20 user nova-compute[71321]:   </features>
Apr 12 12:53:20 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:53:20 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:53:20 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:53:20 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:53:20 user nova-compute[71321]:   </clock>
Apr 12 12:53:20 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:53:20 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:53:20 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:53:20 user nova-compute[71321]:   </cpu>
Apr 12 12:53:20 user nova-compute[71321]:   <devices>
Apr 12 12:53:20 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:53:20 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:53:20 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk"/>
Apr 12 12:53:20 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:53:20 user nova-compute[71321]:     </disk>
Apr 12 12:53:20 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:53:20 user nova-compute[71321]:       <mac address="fa:16:3e:bf:a8:a8"/>
Apr 12 12:53:20 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:53:20 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:53:20 user nova-compute[71321]:       <target dev="tap9f228391-19"/>
Apr 12 12:53:20 user nova-compute[71321]:     </interface>
Apr 12 12:53:20 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:53:20 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/console.log" append="off"/>
Apr 12 12:53:20 user nova-compute[71321]:     </serial>
Apr 12 12:53:20 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:53:20 user nova-compute[71321]:     <video>
Apr 12 12:53:20 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:53:20 user nova-compute[71321]:     </video>
Apr 12 12:53:20 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:53:20 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:53:20 user nova-compute[71321]:     </rng>
Apr 12 12:53:20 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:53:20 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:53:20 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:53:20 user nova-compute[71321]:     </memballoon>
Apr 12 12:53:20 user nova-compute[71321]:   </devices>
Apr 12 12:53:20 user nova-compute[71321]: </domain>
Apr 12 12:53:20 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1011361966',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1011361966',id=38,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f20ad21427a04683b9b102d2ff0290a5',ramdisk_id='',reservation_id='r-mqqg1rqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-636247513',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:53:19Z,user_data=None,user_id='435e0d6fd2b3437f837e82730b4d955f',uuid=e0752f9c-73b1-4cb8-82a9-ca6ce9141a26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f228391-1910-4bd3-b317-f1afa3e98a0f", "address": "fa:16:3e:bf:a8:a8", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f228391-19", "ovs_interfaceid": "9f228391-1910-4bd3-b317-f1afa3e98a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Converting VIF {"id": "9f228391-1910-4bd3-b317-f1afa3e98a0f", "address": "fa:16:3e:bf:a8:a8", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f228391-19", "ovs_interfaceid": "9f228391-1910-4bd3-b317-f1afa3e98a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a8:a8,bridge_name='br-int',has_traffic_filtering=True,id=9f228391-1910-4bd3-b317-f1afa3e98a0f,network=Network(bb52f82e-56ca-41f7-b171-a3cacb549ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f228391-19') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG os_vif [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a8:a8,bridge_name='br-int',has_traffic_filtering=True,id=9f228391-1910-4bd3-b317-f1afa3e98a0f,network=Network(bb52f82e-56ca-41f7-b171-a3cacb549ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f228391-19') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f228391-19, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9f228391-19, col_values=(('external_ids', {'iface-id': '9f228391-1910-4bd3-b317-f1afa3e98a0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:a8:a8', 'vm-uuid': 'e0752f9c-73b1-4cb8-82a9-ca6ce9141a26'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:20 user nova-compute[71321]: INFO os_vif [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a8:a8,bridge_name='br-int',has_traffic_filtering=True,id=9f228391-1910-4bd3-b317-f1afa3e98a0f,network=Network(bb52f82e-56ca-41f7-b171-a3cacb549ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f228391-19')
Apr 12 12:53:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:53:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] No VIF found with MAC fa:16:3e:bf:a8:a8, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:53:21 user nova-compute[71321]: DEBUG nova.network.neutron [req-c53a4777-d5f7-43c2-b675-f260d4230701 req-9c16f6aa-c588-46e8-9326-41145e407f5d service nova] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Updated VIF entry in instance network info cache for port 9f228391-1910-4bd3-b317-f1afa3e98a0f. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:53:21 user nova-compute[71321]: DEBUG nova.network.neutron [req-c53a4777-d5f7-43c2-b675-f260d4230701 req-9c16f6aa-c588-46e8-9326-41145e407f5d service nova] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Updating instance_info_cache with network_info: [{"id": "9f228391-1910-4bd3-b317-f1afa3e98a0f", "address": "fa:16:3e:bf:a8:a8", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f228391-19", "ovs_interfaceid": "9f228391-1910-4bd3-b317-f1afa3e98a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:53:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c53a4777-d5f7-43c2-b675-f260d4230701 req-9c16f6aa-c588-46e8-9326-41145e407f5d service nova] Releasing lock "refresh_cache-e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:53:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:22 user nova-compute[71321]: DEBUG nova.compute.manager [req-e182cf26-f6d2-442c-be9b-55a66060c9f7 req-660eb742-81b3-4b1a-bd0b-a520136c1f53 service nova] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Received event network-vif-plugged-9f228391-1910-4bd3-b317-f1afa3e98a0f {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:53:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e182cf26-f6d2-442c-be9b-55a66060c9f7 req-660eb742-81b3-4b1a-bd0b-a520136c1f53 service nova] Acquiring lock "e0752f9c-73b1-4cb8-82a9-ca6ce9141a26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:53:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e182cf26-f6d2-442c-be9b-55a66060c9f7 req-660eb742-81b3-4b1a-bd0b-a520136c1f53 service nova] Lock "e0752f9c-73b1-4cb8-82a9-ca6ce9141a26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:53:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e182cf26-f6d2-442c-be9b-55a66060c9f7 req-660eb742-81b3-4b1a-bd0b-a520136c1f53 service nova] Lock "e0752f9c-73b1-4cb8-82a9-ca6ce9141a26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:53:22 user nova-compute[71321]: DEBUG nova.compute.manager [req-e182cf26-f6d2-442c-be9b-55a66060c9f7 req-660eb742-81b3-4b1a-bd0b-a520136c1f53 service nova] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] No waiting events found dispatching network-vif-plugged-9f228391-1910-4bd3-b317-f1afa3e98a0f {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:53:22 user nova-compute[71321]: WARNING nova.compute.manager [req-e182cf26-f6d2-442c-be9b-55a66060c9f7 req-660eb742-81b3-4b1a-bd0b-a520136c1f53 service nova] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Received unexpected event network-vif-plugged-9f228391-1910-4bd3-b317-f1afa3e98a0f for instance with vm_state building and task_state spawning.
Apr 12 12:53:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:24 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681304004.3643599, e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:53:24 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] VM Resumed (Lifecycle Event)
Apr 12 12:53:24 user nova-compute[71321]: DEBUG nova.compute.manager [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:53:24 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:53:24 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Instance spawned successfully.
Apr 12 12:53:24 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:53:24 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:53:24 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:53:24 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:53:24 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:53:24 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:53:24 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:53:24 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:53:24 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:53:24 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:53:24 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681304004.3667626, e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:53:24 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] VM Started (Lifecycle Event)
Apr 12 12:53:24 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:53:24 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:53:24 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:53:24 user nova-compute[71321]: INFO nova.compute.manager [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Took 5.29 seconds to spawn the instance on the hypervisor.
Apr 12 12:53:24 user nova-compute[71321]: DEBUG nova.compute.manager [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:53:24 user nova-compute[71321]: INFO nova.compute.manager [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Took 5.93 seconds to build instance.
Apr 12 12:53:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.037s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:53:24 user nova-compute[71321]: DEBUG nova.compute.manager [req-71101226-4697-49c2-8dc4-d833b8ef6ca9 req-d5012f23-f077-4922-8a93-b72cc9f8916a service nova] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Received event network-vif-plugged-9f228391-1910-4bd3-b317-f1afa3e98a0f {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:53:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-71101226-4697-49c2-8dc4-d833b8ef6ca9 req-d5012f23-f077-4922-8a93-b72cc9f8916a service nova] Acquiring lock "e0752f9c-73b1-4cb8-82a9-ca6ce9141a26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:53:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-71101226-4697-49c2-8dc4-d833b8ef6ca9 req-d5012f23-f077-4922-8a93-b72cc9f8916a service nova] Lock "e0752f9c-73b1-4cb8-82a9-ca6ce9141a26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:53:24 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-71101226-4697-49c2-8dc4-d833b8ef6ca9 req-d5012f23-f077-4922-8a93-b72cc9f8916a service nova] Lock "e0752f9c-73b1-4cb8-82a9-ca6ce9141a26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:53:24 user nova-compute[71321]: DEBUG nova.compute.manager [req-71101226-4697-49c2-8dc4-d833b8ef6ca9 req-d5012f23-f077-4922-8a93-b72cc9f8916a service nova] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] No waiting events found dispatching network-vif-plugged-9f228391-1910-4bd3-b317-f1afa3e98a0f {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:53:24 user nova-compute[71321]: WARNING nova.compute.manager [req-71101226-4697-49c2-8dc4-d833b8ef6ca9 req-d5012f23-f077-4922-8a93-b72cc9f8916a service nova] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Received unexpected event network-vif-plugged-9f228391-1910-4bd3-b317-f1afa3e98a0f for instance with vm_state active and task_state None.
Apr 12 12:53:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:29 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:53:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:53:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:53:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:53:29 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:53:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:53:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:53:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:53:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:53:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:53:29 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:53:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:53:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:53:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:53:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:53:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:53:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:53:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:53:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:53:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:53:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:53:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:53:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:31 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:53:31 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:53:31 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8419MB free_disk=26.336318969726562GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:53:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:53:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:53:31 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance db9f1454-9e3c-40d4-849b-c13537d6be97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:53:31 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 508746c9-705a-4d77-a528-454a10299411 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:53:31 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:53:31 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:53:31 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:53:31 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:53:31 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:53:31 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:53:31 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:53:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.280s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:53:34 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:53:34 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:53:34 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:53:34 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:53:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:38 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:53:40 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:53:40 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:53:40 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Rebuilding the list of instances to heal {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 12:53:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-db9f1454-9e3c-40d4-849b-c13537d6be97" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:53:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-db9f1454-9e3c-40d4-849b-c13537d6be97" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:53:40 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 12:53:40 user nova-compute[71321]: DEBUG nova.objects.instance [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lazy-loading 'info_cache' on Instance uuid db9f1454-9e3c-40d4-849b-c13537d6be97 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:53:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:41 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:41 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Updating instance_info_cache with network_info: [{"id": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "address": "fa:16:3e:c8:2c:e7", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30bdfa-5f", "ovs_interfaceid": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:53:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-db9f1454-9e3c-40d4-849b-c13537d6be97" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:53:41 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 12:53:41 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:53:41 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:53:43 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:53:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:52 user nova-compute[71321]: DEBUG nova.compute.manager [req-4f773bba-a61c-454a-851f-eb75c47a0648 req-bd975e5c-c1ac-47ad-9337-17822b763d51 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Received event network-changed-dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:53:52 user nova-compute[71321]: DEBUG nova.compute.manager [req-4f773bba-a61c-454a-851f-eb75c47a0648 req-bd975e5c-c1ac-47ad-9337-17822b763d51 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Refreshing instance network info cache due to event network-changed-dab72490-cdfa-4ffa-be0b-feda75d66bcb. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:53:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4f773bba-a61c-454a-851f-eb75c47a0648 req-bd975e5c-c1ac-47ad-9337-17822b763d51 service nova] Acquiring lock "refresh_cache-508746c9-705a-4d77-a528-454a10299411" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:53:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4f773bba-a61c-454a-851f-eb75c47a0648 req-bd975e5c-c1ac-47ad-9337-17822b763d51 service nova] Acquired lock "refresh_cache-508746c9-705a-4d77-a528-454a10299411" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:53:52 user nova-compute[71321]: DEBUG nova.network.neutron [req-4f773bba-a61c-454a-851f-eb75c47a0648 req-bd975e5c-c1ac-47ad-9337-17822b763d51 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Refreshing network info cache for port dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:53:52 user nova-compute[71321]: DEBUG nova.network.neutron [req-4f773bba-a61c-454a-851f-eb75c47a0648 req-bd975e5c-c1ac-47ad-9337-17822b763d51 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Updated VIF entry in instance network info cache for port dab72490-cdfa-4ffa-be0b-feda75d66bcb. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:53:52 user nova-compute[71321]: DEBUG nova.network.neutron [req-4f773bba-a61c-454a-851f-eb75c47a0648 req-bd975e5c-c1ac-47ad-9337-17822b763d51 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Updating instance_info_cache with network_info: [{"id": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "address": "fa:16:3e:5d:63:5c", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab72490-cd", "ovs_interfaceid": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:53:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4f773bba-a61c-454a-851f-eb75c47a0648 req-bd975e5c-c1ac-47ad-9337-17822b763d51 service nova] Releasing lock "refresh_cache-508746c9-705a-4d77-a528-454a10299411" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:53:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "508746c9-705a-4d77-a528-454a10299411" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:53:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "508746c9-705a-4d77-a528-454a10299411" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:53:53 user nova-compute[71321]: INFO nova.compute.manager [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Detaching volume 3675f4a6-a994-41d9-9477-08b2f072dae0
Apr 12 12:53:53 user nova-compute[71321]: INFO nova.virt.block_device [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Attempting to driver detach volume 3675f4a6-a994-41d9-9477-08b2f072dae0 from mountpoint /dev/vdb
Apr 12 12:53:53 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Attempting to detach device vdb from instance 508746c9-705a-4d77-a528-454a10299411 from the persistent domain config. {{(pid=71321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 12:53:53 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:53:53 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:53:53 user nova-compute[71321]:   <source dev="/dev/sdb"/>
Apr 12 12:53:53 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:53:53 user nova-compute[71321]:   <serial>3675f4a6-a994-41d9-9477-08b2f072dae0</serial>
Apr 12 12:53:53 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 12:53:53 user nova-compute[71321]: </disk>
Apr 12 12:53:53 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:53:53 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Successfully detached device vdb from instance 508746c9-705a-4d77-a528-454a10299411 from the persistent domain config.
Apr 12 12:53:53 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 508746c9-705a-4d77-a528-454a10299411 from the live domain config. {{(pid=71321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 12:53:53 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:53:53 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:53:53 user nova-compute[71321]:   <source dev="/dev/sdb"/>
Apr 12 12:53:53 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:53:53 user nova-compute[71321]:   <serial>3675f4a6-a994-41d9-9477-08b2f072dae0</serial>
Apr 12 12:53:53 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 12:53:53 user nova-compute[71321]: </disk>
Apr 12 12:53:53 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Received event <DeviceRemovedEvent: 1681304034.3724506, 508746c9-705a-4d77-a528-454a10299411 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 508746c9-705a-4d77-a528-454a10299411 {{(pid=71321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 12:53:54 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Successfully detached device vdb from instance 508746c9-705a-4d77-a528-454a10299411 from the live domain config.
Apr 12 12:53:54 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HiUueIZh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:53:54 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:53:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f603396f-0423-4591-a1a2-52fef644ca55]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:53:54 user nova-compute[71321]: No targets found.
Apr 12 12:53:54 user nova-compute[71321]: iSNS:
Apr 12 12:53:54 user nova-compute[71321]: No targets found.
Apr 12 12:53:54 user nova-compute[71321]: STATIC:
Apr 12 12:53:54 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0
Apr 12 12:53:54 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:53:54 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:53:54 user nova-compute[71321]: FIRMWARE:
Apr 12 12:53:54 user nova-compute[71321]: No targets found.
Apr 12 12:53:54 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:53:54 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:53:54 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0238d9fc-124e-4280-9811-af18447fc040]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c17eec2-02f9-4611-86d0-d3369f75670a]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 (non-flash)
Apr 12 12:53:54 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 (non-flash)
Apr 12 12:53:54 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef7c333640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0'): ({'sdb'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Removing single pathed devices sdb {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6237aafb-213d-42ae-9944-4ff42103f96d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG nova.compute.manager [req-981dc29e-9a29-429b-a4d7-9c6fa9295d59 req-a84c1270-03b9-4cea-8201-1ac011d9320d service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Received event network-changed-dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG nova.compute.manager [req-981dc29e-9a29-429b-a4d7-9c6fa9295d59 req-a84c1270-03b9-4cea-8201-1ac011d9320d service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Refreshing instance network info cache due to event network-changed-dab72490-cdfa-4ffa-be0b-feda75d66bcb. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-981dc29e-9a29-429b-a4d7-9c6fa9295d59 req-a84c1270-03b9-4cea-8201-1ac011d9320d service nova] Acquiring lock "refresh_cache-508746c9-705a-4d77-a528-454a10299411" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-981dc29e-9a29-429b-a4d7-9c6fa9295d59 req-a84c1270-03b9-4cea-8201-1ac011d9320d service nova] Acquired lock "refresh_cache-508746c9-705a-4d77-a528-454a10299411" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG nova.network.neutron [req-981dc29e-9a29-429b-a4d7-9c6fa9295d59 req-a84c1270-03b9-4cea-8201-1ac011d9320d service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Refreshing network info cache for port dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[00babf31-2664-4ee8-8326-7907f4ac86b3]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Flushing IO for device /dev/sdb {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6868f911-169b-4f69-b6bd-0dd7d3a1ff93]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[006fd867-8392-481b-8fab-02d732fb691d]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] SCSI volumes sdb have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7c3d4f-af28-4ff8-b519-6979244eefe2]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d534526-83aa-48a4-99b2-5454064a566f]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0, portal: 172.16.0.220,3260]
Apr 12 12:53:54 user nova-compute[71321]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0, portal: 172.16.0.220,3260] successful.
Apr 12 12:53:54 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3675f4a6-a994-41d9-9477-08b2f072dae0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b896b93c-053c-4451-9f35-30968a8172df]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] <== disconnect_volume: return (343ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG nova.network.neutron [req-981dc29e-9a29-429b-a4d7-9c6fa9295d59 req-a84c1270-03b9-4cea-8201-1ac011d9320d service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Updated VIF entry in instance network info cache for port dab72490-cdfa-4ffa-be0b-feda75d66bcb. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:53:54 user nova-compute[71321]: DEBUG nova.network.neutron [req-981dc29e-9a29-429b-a4d7-9c6fa9295d59 req-a84c1270-03b9-4cea-8201-1ac011d9320d service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Updating instance_info_cache with network_info: [{"id": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "address": "fa:16:3e:5d:63:5c", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab72490-cd", "ovs_interfaceid": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:53:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-981dc29e-9a29-429b-a4d7-9c6fa9295d59 req-a84c1270-03b9-4cea-8201-1ac011d9320d service nova] Releasing lock "refresh_cache-508746c9-705a-4d77-a528-454a10299411" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:53:55 user nova-compute[71321]: DEBUG nova.objects.instance [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lazy-loading 'flavor' on Instance uuid 508746c9-705a-4d77-a528-454a10299411 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:53:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "508746c9-705a-4d77-a528-454a10299411" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.779s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:53:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:53:56 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:54:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 12:54:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 12:54:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 12:54:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:54:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:27 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:54:27 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71321) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 12:54:30 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:54:30 user nova-compute[71321]: DEBUG nova.objects.instance [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'flavor' on Instance uuid db9f1454-9e3c-40d4-849b-c13537d6be97 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:54:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:54:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:54:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:54:30 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:54:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "refresh_cache-db9f1454-9e3c-40d4-849b-c13537d6be97" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:54:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquired lock "refresh_cache-db9f1454-9e3c-40d4-849b-c13537d6be97" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:54:30 user nova-compute[71321]: DEBUG nova.network.neutron [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:54:30 user nova-compute[71321]: DEBUG nova.objects.instance [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'info_cache' on Instance uuid db9f1454-9e3c-40d4-849b-c13537d6be97 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:54:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:54:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:30 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG nova.compute.manager [req-d00f273c-8321-4927-8c9c-2a312c10f0b8 req-b714d34c-e5c0-40f3-b6b0-62aeca5cf386 service nova] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Received event network-changed-905fcda2-3c86-4694-a6a5-8a3ba5caddc2 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG nova.compute.manager [req-d00f273c-8321-4927-8c9c-2a312c10f0b8 req-b714d34c-e5c0-40f3-b6b0-62aeca5cf386 service nova] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Refreshing instance network info cache due to event network-changed-905fcda2-3c86-4694-a6a5-8a3ba5caddc2. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d00f273c-8321-4927-8c9c-2a312c10f0b8 req-b714d34c-e5c0-40f3-b6b0-62aeca5cf386 service nova] Acquiring lock "refresh_cache-2647400c-e0e8-4fcb-9fa6-b4ab35197ded" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d00f273c-8321-4927-8c9c-2a312c10f0b8 req-b714d34c-e5c0-40f3-b6b0-62aeca5cf386 service nova] Acquired lock "refresh_cache-2647400c-e0e8-4fcb-9fa6-b4ab35197ded" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG nova.network.neutron [req-d00f273c-8321-4927-8c9c-2a312c10f0b8 req-b714d34c-e5c0-40f3-b6b0-62aeca5cf386 service nova] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Refreshing network info cache for port 905fcda2-3c86-4694-a6a5-8a3ba5caddc2 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG nova.network.neutron [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Updating instance_info_cache with network_info: [{"id": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "address": "fa:16:3e:c8:2c:e7", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30bdfa-5f", "ovs_interfaceid": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Releasing lock "refresh_cache-db9f1454-9e3c-40d4-849b-c13537d6be97" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:54:31 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Instance destroyed successfully.
Apr 12 12:54:31 user nova-compute[71321]: DEBUG nova.objects.instance [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'resources' on Instance uuid db9f1454-9e3c-40d4-849b-c13537d6be97 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:46:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1788527008',display_name='tempest-AttachVolumeTestJSON-server-1788527008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1788527008',id=34,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuwf936taYEtQ87HL5K7RLSYNC7EYwzjJGVWMdDWY17MG7jKDK8n6UiYp0Wx2O8W7vbPN1WZy4g++M2EnVpaeEZHV1BaHycanzlOj8OAfSm/y0qUI9XhqdtXcmqo6mDGg==',key_name='tempest-keypair-1238241126',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:47:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a0e6aaaa9a634f349d371f7c6c15eca2',ramdisk_id='',reservation_id='r-mamvz059',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-905742219',owner_user_name='tempest-AttachVolumeTestJSON-905742219-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:52:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a9c54033c7547c2bae91e6c1dba0976',uuid=db9f1454-9e3c-40d4-849b-c13537d6be97,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "address": "fa:16:3e:c8:2c:e7", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30bdfa-5f", "ovs_interfaceid": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Converting VIF {"id": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "address": "fa:16:3e:c8:2c:e7", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30bdfa-5f", "ovs_interfaceid": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:2c:e7,bridge_name='br-int',has_traffic_filtering=True,id=9c30bdfa-5f39-4454-af8b-f2ccd880807b,network=Network(e1afe3b3-a919-4800-9f1c-c8e602defd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c30bdfa-5f') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG os_vif [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:2c:e7,bridge_name='br-int',has_traffic_filtering=True,id=9c30bdfa-5f39-4454-af8b-f2ccd880807b,network=Network(e1afe3b3-a919-4800-9f1c-c8e602defd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c30bdfa-5f') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c30bdfa-5f, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:54:31 user nova-compute[71321]: INFO os_vif [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:2c:e7,bridge_name='br-int',has_traffic_filtering=True,id=9c30bdfa-5f39-4454-af8b-f2ccd880807b,network=Network(e1afe3b3-a919-4800-9f1c-c8e602defd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c30bdfa-5f')
Apr 12 12:54:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Start _get_guest_xml network_info=[{"id": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "address": "fa:16:3e:c8:2c:e7", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30bdfa-5f", "ovs_interfaceid": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG nova.objects.instance [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'numa_topology' on Instance uuid db9f1454-9e3c-40d4-849b-c13537d6be97 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:54:31 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Error from libvirt while getting description of instance-00000022: [Error Code 42] Domain not found: no domain with matching uuid 'db9f1454-9e3c-40d4-849b-c13537d6be97' (instance-00000022): libvirt.libvirtError: Domain not found: no domain with matching uuid 'db9f1454-9e3c-40d4-849b-c13537d6be97' (instance-00000022)
Apr 12 12:54:31 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:31 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:54:31 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:54:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG nova.objects.instance [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'vcpu_model' on Instance uuid db9f1454-9e3c-40d4-849b-c13537d6be97 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:46:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1788527008',display_name='tempest-AttachVolumeTestJSON-server-1788527008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1788527008',id=34,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuwf936taYEtQ87HL5K7RLSYNC7EYwzjJGVWMdDWY17MG7jKDK8n6UiYp0Wx2O8W7vbPN1WZy4g++M2EnVpaeEZHV1BaHycanzlOj8OAfSm/y0qUI9XhqdtXcmqo6mDGg==',key_name='tempest-keypair-1238241126',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:47:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a0e6aaaa9a634f349d371f7c6c15eca2',ramdisk_id='',reservation_id='r-mamvz059',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-905742219',owner_user_name='tempest-AttachVolumeTestJSON-905742219-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:52:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a9c54033c7547c2bae91e6c1dba0976',uuid=db9f1454-9e3c-40d4-849b-c13537d6be97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "address": "fa:16:3e:c8:2c:e7", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30bdfa-5f", "ovs_interfaceid": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Converting VIF {"id": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "address": "fa:16:3e:c8:2c:e7", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30bdfa-5f", "ovs_interfaceid": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:2c:e7,bridge_name='br-int',has_traffic_filtering=True,id=9c30bdfa-5f39-4454-af8b-f2ccd880807b,network=Network(e1afe3b3-a919-4800-9f1c-c8e602defd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c30bdfa-5f') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG nova.objects.instance [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'pci_devices' on Instance uuid db9f1454-9e3c-40d4-849b-c13537d6be97 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:54:31 user nova-compute[71321]:   <uuid>db9f1454-9e3c-40d4-849b-c13537d6be97</uuid>
Apr 12 12:54:31 user nova-compute[71321]:   <name>instance-00000022</name>
Apr 12 12:54:31 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:54:31 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:54:31 user nova-compute[71321]:   <metadata>
Apr 12 12:54:31 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:54:31 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:54:31 user nova-compute[71321]:       <nova:name>tempest-AttachVolumeTestJSON-server-1788527008</nova:name>
Apr 12 12:54:31 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:54:31</nova:creationTime>
Apr 12 12:54:31 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:54:31 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:54:31 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:54:31 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:54:31 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:54:31 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:54:31 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:54:31 user nova-compute[71321]:       <nova:owner>
Apr 12 12:54:31 user nova-compute[71321]:         <nova:user uuid="8a9c54033c7547c2bae91e6c1dba0976">tempest-AttachVolumeTestJSON-905742219-project-member</nova:user>
Apr 12 12:54:31 user nova-compute[71321]:         <nova:project uuid="a0e6aaaa9a634f349d371f7c6c15eca2">tempest-AttachVolumeTestJSON-905742219</nova:project>
Apr 12 12:54:31 user nova-compute[71321]:       </nova:owner>
Apr 12 12:54:31 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:54:31 user nova-compute[71321]:       <nova:ports>
Apr 12 12:54:31 user nova-compute[71321]:         <nova:port uuid="9c30bdfa-5f39-4454-af8b-f2ccd880807b">
Apr 12 12:54:31 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 12:54:31 user nova-compute[71321]:         </nova:port>
Apr 12 12:54:31 user nova-compute[71321]:       </nova:ports>
Apr 12 12:54:31 user nova-compute[71321]:     </nova:instance>
Apr 12 12:54:31 user nova-compute[71321]:   </metadata>
Apr 12 12:54:31 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:54:31 user nova-compute[71321]:     <system>
Apr 12 12:54:31 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:54:31 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:54:31 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:54:31 user nova-compute[71321]:       <entry name="serial">db9f1454-9e3c-40d4-849b-c13537d6be97</entry>
Apr 12 12:54:31 user nova-compute[71321]:       <entry name="uuid">db9f1454-9e3c-40d4-849b-c13537d6be97</entry>
Apr 12 12:54:31 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:54:31 user nova-compute[71321]:     </system>
Apr 12 12:54:31 user nova-compute[71321]:   </sysinfo>
Apr 12 12:54:31 user nova-compute[71321]:   <os>
Apr 12 12:54:31 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:54:31 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:54:31 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:54:31 user nova-compute[71321]:   </os>
Apr 12 12:54:31 user nova-compute[71321]:   <features>
Apr 12 12:54:31 user nova-compute[71321]:     <acpi/>
Apr 12 12:54:31 user nova-compute[71321]:     <apic/>
Apr 12 12:54:31 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:54:31 user nova-compute[71321]:   </features>
Apr 12 12:54:31 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:54:31 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:54:31 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:54:31 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:54:31 user nova-compute[71321]:   </clock>
Apr 12 12:54:31 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:54:31 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:54:31 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:54:31 user nova-compute[71321]:   </cpu>
Apr 12 12:54:31 user nova-compute[71321]:   <devices>
Apr 12 12:54:31 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:54:31 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:54:31 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk"/>
Apr 12 12:54:31 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:54:31 user nova-compute[71321]:     </disk>
Apr 12 12:54:31 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:54:31 user nova-compute[71321]:       <mac address="fa:16:3e:c8:2c:e7"/>
Apr 12 12:54:31 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:54:31 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:54:31 user nova-compute[71321]:       <target dev="tap9c30bdfa-5f"/>
Apr 12 12:54:31 user nova-compute[71321]:     </interface>
Apr 12 12:54:31 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:54:31 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/console.log" append="off"/>
Apr 12 12:54:31 user nova-compute[71321]:     </serial>
Apr 12 12:54:31 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:54:31 user nova-compute[71321]:     <video>
Apr 12 12:54:31 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:54:31 user nova-compute[71321]:     </video>
Apr 12 12:54:31 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:54:31 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:54:31 user nova-compute[71321]:     </rng>
Apr 12 12:54:31 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:54:31 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:54:31 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:54:31 user nova-compute[71321]:     </memballoon>
Apr 12 12:54:31 user nova-compute[71321]:   </devices>
Apr 12 12:54:31 user nova-compute[71321]: </domain>
Apr 12 12:54:31 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:31 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG nova.network.neutron [req-d00f273c-8321-4927-8c9c-2a312c10f0b8 req-b714d34c-e5c0-40f3-b6b0-62aeca5cf386 service nova] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Updated VIF entry in instance network info cache for port 905fcda2-3c86-4694-a6a5-8a3ba5caddc2. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG nova.network.neutron [req-d00f273c-8321-4927-8c9c-2a312c10f0b8 req-b714d34c-e5c0-40f3-b6b0-62aeca5cf386 service nova] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Updating instance_info_cache with network_info: [{"id": "905fcda2-3c86-4694-a6a5-8a3ba5caddc2", "address": "fa:16:3e:3a:17:b8", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap905fcda2-3c", "ovs_interfaceid": "905fcda2-3c86-4694-a6a5-8a3ba5caddc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json" returned: 0 in 0.443s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG nova.objects.instance [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'trusted_certs' on Instance uuid db9f1454-9e3c-40d4-849b-c13537d6be97 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:54:32 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:54:32 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:54:32 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8526MB free_disk=26.315792083740234GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d00f273c-8321-4927-8c9c-2a312c10f0b8 req-b714d34c-e5c0-40f3-b6b0-62aeca5cf386 service nova] Releasing lock "refresh_cache-2647400c-e0e8-4fcb-9fa6-b4ab35197ded" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.139s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance db9f1454-9e3c-40d4-849b-c13537d6be97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 508746c9-705a-4d77-a528-454a10299411 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Cannot resize image /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG nova.objects.instance [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'migration_context' on Instance uuid db9f1454-9e3c-40d4-849b-c13537d6be97 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:46:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1788527008',display_name='tempest-AttachVolumeTestJSON-server-1788527008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1788527008',id=34,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuwf936taYEtQ87HL5K7RLSYNC7EYwzjJGVWMdDWY17MG7jKDK8n6UiYp0Wx2O8W7vbPN1WZy4g++M2EnVpaeEZHV1BaHycanzlOj8OAfSm/y0qUI9XhqdtXcmqo6mDGg==',key_name='tempest-keypair-1238241126',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:47:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='a0e6aaaa9a634f349d371f7c6c15eca2',ramdisk_id='',reservation_id='r-mamvz059',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-905742219',owner_user_name='tempest-AttachVolumeTestJSON-905742219-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:52:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a9c54033c7547c2bae91e6c1dba0976',uuid=db9f1454-9e3c-40d4-849b-c13537d6be97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "address": "fa:16:3e:c8:2c:e7", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30bdfa-5f", "ovs_interfaceid": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Converting VIF {"id": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "address": "fa:16:3e:c8:2c:e7", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30bdfa-5f", "ovs_interfaceid": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:2c:e7,bridge_name='br-int',has_traffic_filtering=True,id=9c30bdfa-5f39-4454-af8b-f2ccd880807b,network=Network(e1afe3b3-a919-4800-9f1c-c8e602defd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c30bdfa-5f') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG os_vif [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:2c:e7,bridge_name='br-int',has_traffic_filtering=True,id=9c30bdfa-5f39-4454-af8b-f2ccd880807b,network=Network(e1afe3b3-a919-4800-9f1c-c8e602defd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c30bdfa-5f') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c30bdfa-5f, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9c30bdfa-5f, col_values=(('external_ids', {'iface-id': '9c30bdfa-5f39-4454-af8b-f2ccd880807b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:2c:e7', 'vm-uuid': 'db9f1454-9e3c-40d4-849b-c13537d6be97'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:32 user nova-compute[71321]: INFO os_vif [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:2c:e7,bridge_name='br-int',has_traffic_filtering=True,id=9c30bdfa-5f39-4454-af8b-f2ccd880807b,network=Network(e1afe3b3-a919-4800-9f1c-c8e602defd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c30bdfa-5f')
Apr 12 12:54:32 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.416s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "2647400c-e0e8-4fcb-9fa6-b4ab35197ded" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "2647400c-e0e8-4fcb-9fa6-b4ab35197ded" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG nova.objects.instance [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lazy-loading 'flavor' on Instance uuid 2647400c-e0e8-4fcb-9fa6-b4ab35197ded {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "2647400c-e0e8-4fcb-9fa6-b4ab35197ded" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "2647400c-e0e8-4fcb-9fa6-b4ab35197ded" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "2647400c-e0e8-4fcb-9fa6-b4ab35197ded" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:54:32 user nova-compute[71321]: INFO nova.compute.manager [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Attaching volume 51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 to /dev/vdb
Apr 12 12:54:32 user nova-compute[71321]: DEBUG os_brick.utils [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ab7350-22b5-4fd7-9ece-b95b641c2add]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d347d9f6-da06-4f9e-a7c9-ca7671326427]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ac226f-c0fb-4f3c-af40-6266fb290501]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c07d21e-3218-4d9e-8111-545748c3749f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:54:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:54:33 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:54:33 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5b2af3-a423-48a3-ae4e-373d9464f381]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:54:33 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:54:33 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:54:33 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:54:33 user nova-compute[71321]: DEBUG os_brick.utils [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:54:33 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Updating existing volume attachment record: d89273f3-6257-4832-97ad-12677393dc41 {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:54:33 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:33 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:33 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:33 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:33 user nova-compute[71321]: DEBUG nova.compute.manager [req-1a3f3cf5-5fb2-48f9-95b5-8a0fe5af58a5 req-49bf9672-d44d-4b64-b8fc-d6da4db9491d service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Received event network-vif-plugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:54:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-1a3f3cf5-5fb2-48f9-95b5-8a0fe5af58a5 req-49bf9672-d44d-4b64-b8fc-d6da4db9491d service nova] Acquiring lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:54:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-1a3f3cf5-5fb2-48f9-95b5-8a0fe5af58a5 req-49bf9672-d44d-4b64-b8fc-d6da4db9491d service nova] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:54:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-1a3f3cf5-5fb2-48f9-95b5-8a0fe5af58a5 req-49bf9672-d44d-4b64-b8fc-d6da4db9491d service nova] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:54:33 user nova-compute[71321]: DEBUG nova.compute.manager [req-1a3f3cf5-5fb2-48f9-95b5-8a0fe5af58a5 req-49bf9672-d44d-4b64-b8fc-d6da4db9491d service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] No waiting events found dispatching network-vif-plugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:54:33 user nova-compute[71321]: WARNING nova.compute.manager [req-1a3f3cf5-5fb2-48f9-95b5-8a0fe5af58a5 req-49bf9672-d44d-4b64-b8fc-d6da4db9491d service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Received unexpected event network-vif-plugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b for instance with vm_state stopped and task_state powering-on.
Apr 12 12:54:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:35 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681304075.9215522, db9f1454-9e3c-40d4-849b-c13537d6be97 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:54:35 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] VM Resumed (Lifecycle Event)
Apr 12 12:54:35 user nova-compute[71321]: DEBUG nova.compute.manager [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:54:35 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Instance rebooted successfully.
Apr 12 12:54:35 user nova-compute[71321]: DEBUG nova.compute.manager [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:54:35 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:54:35 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:54:35 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 12 12:54:35 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681304075.9265864, db9f1454-9e3c-40d4-849b-c13537d6be97 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:54:35 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] VM Started (Lifecycle Event)
Apr 12 12:54:36 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:54:36 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:54:36 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:54:36 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:54:36 user nova-compute[71321]: DEBUG nova.compute.manager [req-59473d7f-50b1-4502-8df9-edfaaceef567 req-5d5ea250-7e1f-4732-8f88-704d33cb1112 service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Received event network-vif-plugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:54:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-59473d7f-50b1-4502-8df9-edfaaceef567 req-5d5ea250-7e1f-4732-8f88-704d33cb1112 service nova] Acquiring lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:54:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-59473d7f-50b1-4502-8df9-edfaaceef567 req-5d5ea250-7e1f-4732-8f88-704d33cb1112 service nova] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:54:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-59473d7f-50b1-4502-8df9-edfaaceef567 req-5d5ea250-7e1f-4732-8f88-704d33cb1112 service nova] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:54:36 user nova-compute[71321]: DEBUG nova.compute.manager [req-59473d7f-50b1-4502-8df9-edfaaceef567 req-5d5ea250-7e1f-4732-8f88-704d33cb1112 service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] No waiting events found dispatching network-vif-plugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:54:36 user nova-compute[71321]: WARNING nova.compute.manager [req-59473d7f-50b1-4502-8df9-edfaaceef567 req-5d5ea250-7e1f-4732-8f88-704d33cb1112 service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Received unexpected event network-vif-plugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b for instance with vm_state active and task_state None.
Apr 12 12:54:36 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:54:36 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GFChNzos', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:54:37 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:54:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:54:37 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:54:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:54:37 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:54:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4400f88-d928-4b8c-a1bf-633fd846017a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:54:37 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d45b4f-5292-4697-901b-da2c112c8f1e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5] added
Apr 12 12:54:37 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[61950951-84c4-4feb-8eef-cb5a9af3066a]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[863626cd-7daf-4dd2-973e-11070000cd32]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GFChNzos {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GFChNzos" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc826f2e-e5fb-4e9e-b3cc-20d10a7bb252]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GFChNzos'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b962a1a-5c83-4b58-b3a3-3a44976ef036]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe4b50b-e95b-4f23-a0e3-d61fd7550e9f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 12:54:37 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 12:54:37 user nova-compute[71321]:  {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:54:37 user nova-compute[71321]: WARNING os_brick.initiator.connectors.iscsi [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 12:54:37 user nova-compute[71321]: 
Apr 12 12:54:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b9233d-8a09-443f-8f46-326a7b4965c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5, portal: 172.16.0.220,3260]
Apr 12 12:54:37 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5, portal: 172.16.0.220,3260] successful.
Apr 12 12:54:37 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4701d5f-6daf-485f-bc04-59b3f673153b]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c2a57a-178f-48b3-91cf-ac5201ca6189]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 (non-flash)
Apr 12 12:54:37 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 (non-flash)
Apr 12 12:54:37 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e21e1d-7142-4029-8e60-b9038264e445]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:54:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GFChNzos', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:54:38 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:54:38 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:54:38 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23535313565343664', 'path': '/dev/sdb'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:54:38 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535313565343664', 'path': '/dev/sdb'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:54:38 user nova-compute[71321]: DEBUG nova.objects.instance [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lazy-loading 'flavor' on Instance uuid 2647400c-e0e8-4fcb-9fa6-b4ab35197ded {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:54:38 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 12:54:38 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:54:38 user nova-compute[71321]:   <source dev="/dev/sdb"/>
Apr 12 12:54:38 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:54:38 user nova-compute[71321]:   <serial>51ec7610-bca2-4a85-8987-3a7ecb7e7ee5</serial>
Apr 12 12:54:38 user nova-compute[71321]: </disk>
Apr 12 12:54:38 user nova-compute[71321]:  {{(pid=71321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 12:54:39 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:54:39 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:54:39 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] No VIF found with MAC fa:16:3e:3a:17:b8, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:54:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "2647400c-e0e8-4fcb-9fa6-b4ab35197ded" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.476s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:54:40 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:54:40 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:54:40 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:54:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-508746c9-705a-4d77-a528-454a10299411" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:54:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-508746c9-705a-4d77-a528-454a10299411" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:54:40 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 508746c9-705a-4d77-a528-454a10299411] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 12:54:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "2647400c-e0e8-4fcb-9fa6-b4ab35197ded" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:54:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "2647400c-e0e8-4fcb-9fa6-b4ab35197ded" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:54:40 user nova-compute[71321]: INFO nova.compute.manager [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Detaching volume 51ec7610-bca2-4a85-8987-3a7ecb7e7ee5
Apr 12 12:54:40 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 508746c9-705a-4d77-a528-454a10299411] Updating instance_info_cache with network_info: [{"id": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "address": "fa:16:3e:5d:63:5c", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab72490-cd", "ovs_interfaceid": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:54:40 user nova-compute[71321]: INFO nova.virt.block_device [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Attempting to driver detach volume 51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 from mountpoint /dev/vdb
Apr 12 12:54:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-508746c9-705a-4d77-a528-454a10299411" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:54:40 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 508746c9-705a-4d77-a528-454a10299411] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 12:54:40 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Attempting to detach device vdb from instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded from the persistent domain config. {{(pid=71321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:54:41 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:54:41 user nova-compute[71321]:   <source dev="/dev/sdb"/>
Apr 12 12:54:41 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:54:41 user nova-compute[71321]:   <serial>51ec7610-bca2-4a85-8987-3a7ecb7e7ee5</serial>
Apr 12 12:54:41 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 12:54:41 user nova-compute[71321]: </disk>
Apr 12 12:54:41 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:54:41 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Successfully detached device vdb from instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded from the persistent domain config.
Apr 12 12:54:41 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded from the live domain config. {{(pid=71321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:54:41 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:54:41 user nova-compute[71321]:   <source dev="/dev/sdb"/>
Apr 12 12:54:41 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:54:41 user nova-compute[71321]:   <serial>51ec7610-bca2-4a85-8987-3a7ecb7e7ee5</serial>
Apr 12 12:54:41 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 12:54:41 user nova-compute[71321]: </disk>
Apr 12 12:54:41 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Received event <DeviceRemovedEvent: 1681304081.450349, 2647400c-e0e8-4fcb-9fa6-b4ab35197ded => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded {{(pid=71321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 12:54:41 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Successfully detached device vdb from instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded from the live domain config.
Apr 12 12:54:41 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GFChNzos', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:54:41 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:54:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0516252b-bb29-40a9-b4be-aa3a5e963f16]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:54:41 user nova-compute[71321]: No targets found.
Apr 12 12:54:41 user nova-compute[71321]: iSNS:
Apr 12 12:54:41 user nova-compute[71321]: No targets found.
Apr 12 12:54:41 user nova-compute[71321]: STATIC:
Apr 12 12:54:41 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5
Apr 12 12:54:41 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:54:41 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:54:41 user nova-compute[71321]: FIRMWARE:
Apr 12 12:54:41 user nova-compute[71321]: No targets found.
Apr 12 12:54:41 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:54:41 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:54:41 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f494ceab-4f53-4b2b-9618-70c43f721387]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[943b98f7-5538-46c5-b7da-e60e0f11fbf6]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 (non-flash)
Apr 12 12:54:41 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 (non-flash)
Apr 12 12:54:41 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef7c3ba680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5'): ({'sdb'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Removing single pathed devices sdb {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbffb87-d21b-487e-9660-61defe72da4a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7a5fcf-2a19-4e5c-9977-9af4c8cfac37]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Flushing IO for device /dev/sdb {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[5243e8ed-0c64-41eb-8060-04ca95a88a47]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc3a8be-a8fd-40f8-b0ed-b4a0c663a204]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] SCSI volumes sdb have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e6f35c-cae8-4160-ba8a-734d5d701802]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1039297-3287-4d20-b741-fa344b0fc5d4]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5, portal: 172.16.0.220,3260]
Apr 12 12:54:41 user nova-compute[71321]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5, portal: 172.16.0.220,3260] successful.
Apr 12 12:54:41 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba35b73-e75d-4cd2-a09b-1c6020e8908d]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] <== disconnect_volume: return (291ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:54:41 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:54:42 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:42 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:54:42 user nova-compute[71321]: DEBUG nova.objects.instance [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lazy-loading 'flavor' on Instance uuid 2647400c-e0e8-4fcb-9fa6-b4ab35197ded {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:54:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "2647400c-e0e8-4fcb-9fa6-b4ab35197ded" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.701s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:54:43 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:54:45 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:54:45 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Triggering sync for uuid db9f1454-9e3c-40d4-849b-c13537d6be97 {{(pid=71321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 12:54:45 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Triggering sync for uuid 508746c9-705a-4d77-a528-454a10299411 {{(pid=71321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 12:54:45 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Triggering sync for uuid 2647400c-e0e8-4fcb-9fa6-b4ab35197ded {{(pid=71321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 12:54:45 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Triggering sync for uuid e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 {{(pid=71321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 12:54:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "db9f1454-9e3c-40d4-849b-c13537d6be97" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:54:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:54:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "508746c9-705a-4d77-a528-454a10299411" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:54:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "508746c9-705a-4d77-a528-454a10299411" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:54:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "2647400c-e0e8-4fcb-9fa6-b4ab35197ded" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:54:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "2647400c-e0e8-4fcb-9fa6-b4ab35197ded" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:54:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:54:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:54:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "508746c9-705a-4d77-a528-454a10299411" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:54:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:54:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "2647400c-e0e8-4fcb-9fa6-b4ab35197ded" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:54:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:54:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-553e4d04-dd54-449c-9ab8-1dbd6410a2e4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "508746c9-705a-4d77-a528-454a10299411" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:54:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-553e4d04-dd54-449c-9ab8-1dbd6410a2e4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "508746c9-705a-4d77-a528-454a10299411" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:54:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-553e4d04-dd54-449c-9ab8-1dbd6410a2e4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "508746c9-705a-4d77-a528-454a10299411-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:54:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-553e4d04-dd54-449c-9ab8-1dbd6410a2e4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "508746c9-705a-4d77-a528-454a10299411-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:54:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-553e4d04-dd54-449c-9ab8-1dbd6410a2e4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "508746c9-705a-4d77-a528-454a10299411-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:54:46 user nova-compute[71321]: INFO nova.compute.manager [None req-553e4d04-dd54-449c-9ab8-1dbd6410a2e4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Terminating instance
Apr 12 12:54:46 user nova-compute[71321]: DEBUG nova.compute.manager [None req-553e4d04-dd54-449c-9ab8-1dbd6410a2e4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:54:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:46 user nova-compute[71321]: DEBUG nova.compute.manager [req-2f777765-1da3-4349-b4ba-08e9f9153d23 req-a4c2ce4a-2f6d-4720-b124-503f7617ad3d service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Received event network-vif-unplugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:54:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2f777765-1da3-4349-b4ba-08e9f9153d23 req-a4c2ce4a-2f6d-4720-b124-503f7617ad3d service nova] Acquiring lock "508746c9-705a-4d77-a528-454a10299411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:54:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2f777765-1da3-4349-b4ba-08e9f9153d23 req-a4c2ce4a-2f6d-4720-b124-503f7617ad3d service nova] Lock "508746c9-705a-4d77-a528-454a10299411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:54:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2f777765-1da3-4349-b4ba-08e9f9153d23 req-a4c2ce4a-2f6d-4720-b124-503f7617ad3d service nova] Lock "508746c9-705a-4d77-a528-454a10299411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:54:46 user nova-compute[71321]: DEBUG nova.compute.manager [req-2f777765-1da3-4349-b4ba-08e9f9153d23 req-a4c2ce4a-2f6d-4720-b124-503f7617ad3d service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] No waiting events found dispatching network-vif-unplugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:54:46 user nova-compute[71321]: DEBUG nova.compute.manager [req-2f777765-1da3-4349-b4ba-08e9f9153d23 req-a4c2ce4a-2f6d-4720-b124-503f7617ad3d service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Received event network-vif-unplugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:54:47 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 508746c9-705a-4d77-a528-454a10299411] Instance destroyed successfully.
Apr 12 12:54:47 user nova-compute[71321]: DEBUG nova.objects.instance [None req-553e4d04-dd54-449c-9ab8-1dbd6410a2e4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lazy-loading 'resources' on Instance uuid 508746c9-705a-4d77-a528-454a10299411 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:54:47 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-553e4d04-dd54-449c-9ab8-1dbd6410a2e4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:49:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1462256376',display_name='tempest-TestMinimumBasicScenario-server-1462256376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1462256376',id=36,image_ref='71858585-d70e-4cf1-b2dc-0e5921c23e98',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzeWBX6IhC7gCQ6w0T3CIjF58xU+K7xE+03Z94BwQAzy1OeRNbL96UH1iSrsClMKm4rn8M5qup/LJ+NKAIWGUUK2r0ARV/KqOHOttU7oRuA6Ty3XfX6ezVU/ChdOvsk/g==',key_name='tempest-TestMinimumBasicScenario-1590711499',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:49:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f411f36f23e464fa4a395ad6b2b4472',ramdisk_id='',reservation_id='r-pmi48cyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='71858585-d70e-4cf1-b2dc-0e5921c23e98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-381334085',owner_user_name='tempest-TestMinimumBasicScenario-381334085-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:52:09Z,user_data=None,user_id='924c3a968d734a1c9ddfc5a44d8f6352',uuid=508746c9-705a-4d77-a528-454a10299411,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "address": "fa:16:3e:5d:63:5c", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab72490-cd", "ovs_interfaceid": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:54:47 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-553e4d04-dd54-449c-9ab8-1dbd6410a2e4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Converting VIF {"id": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "address": "fa:16:3e:5d:63:5c", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab72490-cd", "ovs_interfaceid": "dab72490-cdfa-4ffa-be0b-feda75d66bcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:54:47 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-553e4d04-dd54-449c-9ab8-1dbd6410a2e4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:63:5c,bridge_name='br-int',has_traffic_filtering=True,id=dab72490-cdfa-4ffa-be0b-feda75d66bcb,network=Network(76f8fc2b-41cf-4efd-9820-c4d4056deaca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab72490-cd') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:54:47 user nova-compute[71321]: DEBUG os_vif [None req-553e4d04-dd54-449c-9ab8-1dbd6410a2e4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:63:5c,bridge_name='br-int',has_traffic_filtering=True,id=dab72490-cdfa-4ffa-be0b-feda75d66bcb,network=Network(76f8fc2b-41cf-4efd-9820-c4d4056deaca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab72490-cd') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:54:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdab72490-cd, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:54:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:54:47 user nova-compute[71321]: INFO os_vif [None req-553e4d04-dd54-449c-9ab8-1dbd6410a2e4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:63:5c,bridge_name='br-int',has_traffic_filtering=True,id=dab72490-cdfa-4ffa-be0b-feda75d66bcb,network=Network(76f8fc2b-41cf-4efd-9820-c4d4056deaca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab72490-cd')
Apr 12 12:54:47 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-553e4d04-dd54-449c-9ab8-1dbd6410a2e4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Deleting instance files /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411_del
Apr 12 12:54:47 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-553e4d04-dd54-449c-9ab8-1dbd6410a2e4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Deletion of /opt/stack/data/nova/instances/508746c9-705a-4d77-a528-454a10299411_del complete
Apr 12 12:54:47 user nova-compute[71321]: INFO nova.compute.manager [None req-553e4d04-dd54-449c-9ab8-1dbd6410a2e4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 12 12:54:47 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-553e4d04-dd54-449c-9ab8-1dbd6410a2e4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:54:47 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: 508746c9-705a-4d77-a528-454a10299411] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:54:47 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 508746c9-705a-4d77-a528-454a10299411] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:54:47 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:54:47 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 508746c9-705a-4d77-a528-454a10299411] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:54:47 user nova-compute[71321]: DEBUG nova.compute.manager [req-a1114d68-a1a9-444e-a55c-ff6fe664c967 req-d38f3ecb-ede3-487d-b644-75cb1c87f270 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Received event network-vif-deleted-dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:54:47 user nova-compute[71321]: INFO nova.compute.manager [req-a1114d68-a1a9-444e-a55c-ff6fe664c967 req-d38f3ecb-ede3-487d-b644-75cb1c87f270 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Neutron deleted interface dab72490-cdfa-4ffa-be0b-feda75d66bcb; detaching it from the instance and deleting it from the info cache
Apr 12 12:54:47 user nova-compute[71321]: DEBUG nova.network.neutron [req-a1114d68-a1a9-444e-a55c-ff6fe664c967 req-d38f3ecb-ede3-487d-b644-75cb1c87f270 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:54:47 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 508746c9-705a-4d77-a528-454a10299411] Took 0.67 seconds to deallocate network for instance.
Apr 12 12:54:47 user nova-compute[71321]: DEBUG nova.compute.manager [req-a1114d68-a1a9-444e-a55c-ff6fe664c967 req-d38f3ecb-ede3-487d-b644-75cb1c87f270 service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Detach interface failed, port_id=dab72490-cdfa-4ffa-be0b-feda75d66bcb, reason: Instance 508746c9-705a-4d77-a528-454a10299411 could not be found. {{(pid=71321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 12:54:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-553e4d04-dd54-449c-9ab8-1dbd6410a2e4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:54:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-553e4d04-dd54-449c-9ab8-1dbd6410a2e4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:54:48 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-553e4d04-dd54-449c-9ab8-1dbd6410a2e4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:54:48 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-553e4d04-dd54-449c-9ab8-1dbd6410a2e4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:54:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-553e4d04-dd54-449c-9ab8-1dbd6410a2e4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:54:48 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-553e4d04-dd54-449c-9ab8-1dbd6410a2e4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Deleted allocations for instance 508746c9-705a-4d77-a528-454a10299411
Apr 12 12:54:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-553e4d04-dd54-449c-9ab8-1dbd6410a2e4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "508746c9-705a-4d77-a528-454a10299411" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.876s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:54:48 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:54:48 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Cleaning up deleted instances {{(pid=71321) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 12:54:48 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] There are 0 instances to clean {{(pid=71321) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 12:54:48 user nova-compute[71321]: DEBUG nova.compute.manager [req-9a6bfd54-f3d2-4cc7-a074-78e478b55774 req-bfde65f6-42dd-4c2f-850d-9e7c0a0899be service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Received event network-vif-plugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:54:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9a6bfd54-f3d2-4cc7-a074-78e478b55774 req-bfde65f6-42dd-4c2f-850d-9e7c0a0899be service nova] Acquiring lock "508746c9-705a-4d77-a528-454a10299411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:54:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9a6bfd54-f3d2-4cc7-a074-78e478b55774 req-bfde65f6-42dd-4c2f-850d-9e7c0a0899be service nova] Lock "508746c9-705a-4d77-a528-454a10299411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:54:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9a6bfd54-f3d2-4cc7-a074-78e478b55774 req-bfde65f6-42dd-4c2f-850d-9e7c0a0899be service nova] Lock "508746c9-705a-4d77-a528-454a10299411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:54:48 user nova-compute[71321]: DEBUG nova.compute.manager [req-9a6bfd54-f3d2-4cc7-a074-78e478b55774 req-bfde65f6-42dd-4c2f-850d-9e7c0a0899be service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] No waiting events found dispatching network-vif-plugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:54:48 user nova-compute[71321]: WARNING nova.compute.manager [req-9a6bfd54-f3d2-4cc7-a074-78e478b55774 req-bfde65f6-42dd-4c2f-850d-9e7c0a0899be service nova] [instance: 508746c9-705a-4d77-a528-454a10299411] Received unexpected event network-vif-plugged-dab72490-cdfa-4ffa-be0b-feda75d66bcb for instance with vm_state deleted and task_state None.
Apr 12 12:54:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:54:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:55:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:55:02 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681304087.082236, 508746c9-705a-4d77-a528-454a10299411 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:55:02 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 508746c9-705a-4d77-a528-454a10299411] VM Stopped (Lifecycle Event)
Apr 12 12:55:02 user nova-compute[71321]: DEBUG nova.compute.manager [None req-9c50b634-e015-4e7f-a2d4-4ac4d41c397a None None] [instance: 508746c9-705a-4d77-a528-454a10299411] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:55:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:55:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:55:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:55:09 user nova-compute[71321]: DEBUG nova.compute.manager [None req-cd9548b6-0d5c-4fcd-936a-2a232e415453 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:55:09 user nova-compute[71321]: INFO nova.compute.manager [None req-cd9548b6-0d5c-4fcd-936a-2a232e415453 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] instance snapshotting
Apr 12 12:55:09 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-cd9548b6-0d5c-4fcd-936a-2a232e415453 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Beginning live snapshot process
Apr 12 12:55:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-cd9548b6-0d5c-4fcd-936a-2a232e415453 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json -f qcow2 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:55:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-cd9548b6-0d5c-4fcd-936a-2a232e415453 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json -f qcow2" returned: 0 in 0.145s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:55:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-cd9548b6-0d5c-4fcd-936a-2a232e415453 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json -f qcow2 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:55:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-cd9548b6-0d5c-4fcd-936a-2a232e415453 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json -f qcow2" returned: 0 in 0.140s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:55:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-cd9548b6-0d5c-4fcd-936a-2a232e415453 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:55:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-cd9548b6-0d5c-4fcd-936a-2a232e415453 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.141s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:55:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-cd9548b6-0d5c-4fcd-936a-2a232e415453 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpz0iue_28/72dd82ccdc694991925a3141929ba547.delta 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:55:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-cd9548b6-0d5c-4fcd-936a-2a232e415453 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpz0iue_28/72dd82ccdc694991925a3141929ba547.delta 1073741824" returned: 0 in 0.064s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:55:10 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-cd9548b6-0d5c-4fcd-936a-2a232e415453 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 12 12:55:11 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-cd9548b6-0d5c-4fcd-936a-2a232e415453 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71321) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 12:55:11 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-cd9548b6-0d5c-4fcd-936a-2a232e415453 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71321) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 12:55:11 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-cd9548b6-0d5c-4fcd-936a-2a232e415453 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 12 12:55:11 user nova-compute[71321]: DEBUG nova.privsep.utils [None req-cd9548b6-0d5c-4fcd-936a-2a232e415453 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 12:55:11 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-cd9548b6-0d5c-4fcd-936a-2a232e415453 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpz0iue_28/72dd82ccdc694991925a3141929ba547.delta /opt/stack/data/nova/instances/snapshots/tmpz0iue_28/72dd82ccdc694991925a3141929ba547 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:55:12 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:55:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-cd9548b6-0d5c-4fcd-936a-2a232e415453 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpz0iue_28/72dd82ccdc694991925a3141929ba547.delta /opt/stack/data/nova/instances/snapshots/tmpz0iue_28/72dd82ccdc694991925a3141929ba547" returned: 0 in 0.694s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:55:12 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-cd9548b6-0d5c-4fcd-936a-2a232e415453 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Snapshot extracted, beginning image upload
Apr 12 12:55:14 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-cd9548b6-0d5c-4fcd-936a-2a232e415453 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Snapshot image upload complete
Apr 12 12:55:14 user nova-compute[71321]: INFO nova.compute.manager [None req-cd9548b6-0d5c-4fcd-936a-2a232e415453 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Took 5.11 seconds to snapshot the instance on the hypervisor.
Apr 12 12:55:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:55:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:55:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 12:55:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 12:55:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 12:55:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:55:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:55:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:55:27 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:55:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a9454004-0d6d-447a-a6f0-2bdbde000566 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "2647400c-e0e8-4fcb-9fa6-b4ab35197ded" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:55:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a9454004-0d6d-447a-a6f0-2bdbde000566 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "2647400c-e0e8-4fcb-9fa6-b4ab35197ded" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:55:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a9454004-0d6d-447a-a6f0-2bdbde000566 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "2647400c-e0e8-4fcb-9fa6-b4ab35197ded-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:55:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a9454004-0d6d-447a-a6f0-2bdbde000566 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "2647400c-e0e8-4fcb-9fa6-b4ab35197ded-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:55:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a9454004-0d6d-447a-a6f0-2bdbde000566 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "2647400c-e0e8-4fcb-9fa6-b4ab35197ded-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:55:31 user nova-compute[71321]: INFO nova.compute.manager [None req-a9454004-0d6d-447a-a6f0-2bdbde000566 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Terminating instance
Apr 12 12:55:31 user nova-compute[71321]: DEBUG nova.compute.manager [None req-a9454004-0d6d-447a-a6f0-2bdbde000566 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:55:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:55:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:55:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:55:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:55:31 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:55:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:55:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:55:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:55:31 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:55:31 user nova-compute[71321]: DEBUG nova.compute.manager [req-a594941c-5652-4cf7-b68e-0a31e4b83492 req-6852c2a7-e169-42e3-befa-895a455a0d0f service nova] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Received event network-vif-unplugged-905fcda2-3c86-4694-a6a5-8a3ba5caddc2 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:55:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a594941c-5652-4cf7-b68e-0a31e4b83492 req-6852c2a7-e169-42e3-befa-895a455a0d0f service nova] Acquiring lock "2647400c-e0e8-4fcb-9fa6-b4ab35197ded-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:55:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a594941c-5652-4cf7-b68e-0a31e4b83492 req-6852c2a7-e169-42e3-befa-895a455a0d0f service nova] Lock "2647400c-e0e8-4fcb-9fa6-b4ab35197ded-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:55:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a594941c-5652-4cf7-b68e-0a31e4b83492 req-6852c2a7-e169-42e3-befa-895a455a0d0f service nova] Lock "2647400c-e0e8-4fcb-9fa6-b4ab35197ded-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:55:31 user nova-compute[71321]: DEBUG nova.compute.manager [req-a594941c-5652-4cf7-b68e-0a31e4b83492 req-6852c2a7-e169-42e3-befa-895a455a0d0f service nova] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] No waiting events found dispatching network-vif-unplugged-905fcda2-3c86-4694-a6a5-8a3ba5caddc2 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:55:31 user nova-compute[71321]: DEBUG nova.compute.manager [req-a594941c-5652-4cf7-b68e-0a31e4b83492 req-6852c2a7-e169-42e3-befa-895a455a0d0f service nova] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Received event network-vif-unplugged-905fcda2-3c86-4694-a6a5-8a3ba5caddc2 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:55:31 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Instance destroyed successfully.
Apr 12 12:55:31 user nova-compute[71321]: DEBUG nova.objects.instance [None req-a9454004-0d6d-447a-a6f0-2bdbde000566 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lazy-loading 'resources' on Instance uuid 2647400c-e0e8-4fcb-9fa6-b4ab35197ded {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:55:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-a9454004-0d6d-447a-a6f0-2bdbde000566 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:52:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-340676982',display_name='tempest-AttachVolumeNegativeTest-server-340676982',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-340676982',id=37,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMLQV4OYLyMmtyTwZQdfM7eQv90t/w0Zy18uxOBWsTm7SBpfqSmHMZQX/a46Mf0UUJAryT8HawQd0Kl3bVzgXGFh3W1gBTGM674XVwhaaRT7BEtN9RyRIJIyGrXcCufZzg==',key_name='tempest-keypair-1839792919',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:52:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e61975273ccb41229e0138b96eb7f5e9',ramdisk_id='',reservation_id='r-6ssbt4bk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-941338837',owner_user_name='tempest-AttachVolumeNegativeTest-941338837-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3d9f4516bee4f8d9af7a40ed1298f03',uuid=2647400c-e0e8-4fcb-9fa6-b4ab35197ded,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "905fcda2-3c86-4694-a6a5-8a3ba5caddc2", "address": "fa:16:3e:3a:17:b8", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap905fcda2-3c", "ovs_interfaceid": "905fcda2-3c86-4694-a6a5-8a3ba5caddc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:55:31 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-a9454004-0d6d-447a-a6f0-2bdbde000566 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Converting VIF {"id": "905fcda2-3c86-4694-a6a5-8a3ba5caddc2", "address": "fa:16:3e:3a:17:b8", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap905fcda2-3c", "ovs_interfaceid": "905fcda2-3c86-4694-a6a5-8a3ba5caddc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:55:31 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-a9454004-0d6d-447a-a6f0-2bdbde000566 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:17:b8,bridge_name='br-int',has_traffic_filtering=True,id=905fcda2-3c86-4694-a6a5-8a3ba5caddc2,network=Network(e211a286-ade0-4930-a327-4c6a41785094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap905fcda2-3c') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:55:31 user nova-compute[71321]: DEBUG os_vif [None req-a9454004-0d6d-447a-a6f0-2bdbde000566 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:17:b8,bridge_name='br-int',has_traffic_filtering=True,id=905fcda2-3c86-4694-a6a5-8a3ba5caddc2,network=Network(e211a286-ade0-4930-a327-4c6a41785094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap905fcda2-3c') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:55:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:55:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap905fcda2-3c, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:55:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:55:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:55:32 user nova-compute[71321]: INFO os_vif [None req-a9454004-0d6d-447a-a6f0-2bdbde000566 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:17:b8,bridge_name='br-int',has_traffic_filtering=True,id=905fcda2-3c86-4694-a6a5-8a3ba5caddc2,network=Network(e211a286-ade0-4930-a327-4c6a41785094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap905fcda2-3c')
Apr 12 12:55:32 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-a9454004-0d6d-447a-a6f0-2bdbde000566 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Deleting instance files /opt/stack/data/nova/instances/2647400c-e0e8-4fcb-9fa6-b4ab35197ded_del
Apr 12 12:55:32 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-a9454004-0d6d-447a-a6f0-2bdbde000566 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Deletion of /opt/stack/data/nova/instances/2647400c-e0e8-4fcb-9fa6-b4ab35197ded_del complete
Apr 12 12:55:32 user nova-compute[71321]: INFO nova.compute.manager [None req-a9454004-0d6d-447a-a6f0-2bdbde000566 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 12 12:55:32 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-a9454004-0d6d-447a-a6f0-2bdbde000566 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:55:32 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000025, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/disk
Apr 12 12:55:32 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:55:32 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:55:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:55:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:55:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:55:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:55:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:55:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:55:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:55:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:55:33 user nova-compute[71321]: DEBUG nova.compute.manager [req-f223d4b2-5321-49cb-b2c7-478a0d6b2f12 req-c20ab47a-1561-4272-961d-de121a9f4313 service nova] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Received event network-vif-deleted-905fcda2-3c86-4694-a6a5-8a3ba5caddc2 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:55:33 user nova-compute[71321]: INFO nova.compute.manager [req-f223d4b2-5321-49cb-b2c7-478a0d6b2f12 req-c20ab47a-1561-4272-961d-de121a9f4313 service nova] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Neutron deleted interface 905fcda2-3c86-4694-a6a5-8a3ba5caddc2; detaching it from the instance and deleting it from the info cache
Apr 12 12:55:33 user nova-compute[71321]: DEBUG nova.network.neutron [req-f223d4b2-5321-49cb-b2c7-478a0d6b2f12 req-c20ab47a-1561-4272-961d-de121a9f4313 service nova] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:55:33 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:55:33 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:55:33 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:55:33 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8564MB free_disk=26.297298431396484GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:55:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:55:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:55:33 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Took 1.04 seconds to deallocate network for instance.
Apr 12 12:55:33 user nova-compute[71321]: DEBUG nova.compute.manager [req-f223d4b2-5321-49cb-b2c7-478a0d6b2f12 req-c20ab47a-1561-4272-961d-de121a9f4313 service nova] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Detach interface failed, port_id=905fcda2-3c86-4694-a6a5-8a3ba5caddc2, reason: Instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded could not be found. {{(pid=71321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 12:55:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a9454004-0d6d-447a-a6f0-2bdbde000566 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:55:33 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance db9f1454-9e3c-40d4-849b-c13537d6be97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:55:33 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:55:33 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:55:33 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:55:33 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:55:33 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Refreshing inventories for resource provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 12:55:33 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Updating ProviderTree inventory for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 12:55:33 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Updating inventory in ProviderTree for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 12:55:33 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Refreshing aggregate associations for resource provider 7ca624fd-d5cc-42af-93e3-9d62256fa231, aggregates: None {{(pid=71321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 12:55:33 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Refreshing trait associations for resource provider 7ca624fd-d5cc-42af-93e3-9d62256fa231, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=71321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 12:55:33 user nova-compute[71321]: DEBUG nova.compute.manager [req-2d421082-cfb8-468c-98fd-7a7b3114b3d7 req-23e6e94b-20b0-401a-97e0-b54cef8c38be service nova] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Received event network-vif-plugged-905fcda2-3c86-4694-a6a5-8a3ba5caddc2 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:55:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2d421082-cfb8-468c-98fd-7a7b3114b3d7 req-23e6e94b-20b0-401a-97e0-b54cef8c38be service nova] Acquiring lock "2647400c-e0e8-4fcb-9fa6-b4ab35197ded-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:55:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2d421082-cfb8-468c-98fd-7a7b3114b3d7 req-23e6e94b-20b0-401a-97e0-b54cef8c38be service nova] Lock "2647400c-e0e8-4fcb-9fa6-b4ab35197ded-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:55:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2d421082-cfb8-468c-98fd-7a7b3114b3d7 req-23e6e94b-20b0-401a-97e0-b54cef8c38be service nova] Lock "2647400c-e0e8-4fcb-9fa6-b4ab35197ded-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:55:33 user nova-compute[71321]: DEBUG nova.compute.manager [req-2d421082-cfb8-468c-98fd-7a7b3114b3d7 req-23e6e94b-20b0-401a-97e0-b54cef8c38be service nova] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] No waiting events found dispatching network-vif-plugged-905fcda2-3c86-4694-a6a5-8a3ba5caddc2 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:55:33 user nova-compute[71321]: WARNING nova.compute.manager [req-2d421082-cfb8-468c-98fd-7a7b3114b3d7 req-23e6e94b-20b0-401a-97e0-b54cef8c38be service nova] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Received unexpected event network-vif-plugged-905fcda2-3c86-4694-a6a5-8a3ba5caddc2 for instance with vm_state deleted and task_state None.
Apr 12 12:55:33 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:55:33 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:55:33 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:55:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.726s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:55:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a9454004-0d6d-447a-a6f0-2bdbde000566 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.656s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:55:33 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-a9454004-0d6d-447a-a6f0-2bdbde000566 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:55:33 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-a9454004-0d6d-447a-a6f0-2bdbde000566 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:55:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a9454004-0d6d-447a-a6f0-2bdbde000566 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:55:34 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-a9454004-0d6d-447a-a6f0-2bdbde000566 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Deleted allocations for instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded
Apr 12 12:55:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a9454004-0d6d-447a-a6f0-2bdbde000566 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "2647400c-e0e8-4fcb-9fa6-b4ab35197ded" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.948s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:55:36 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:55:36 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:55:36 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:55:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:55:37 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:55:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:55:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:55:40 user nova-compute[71321]: DEBUG nova.compute.manager [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:55:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:55:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:55:40 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:55:40 user nova-compute[71321]: INFO nova.compute.claims [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Claim successful on node user
Apr 12 12:55:40 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:55:40 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:55:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.224s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:55:40 user nova-compute[71321]: DEBUG nova.compute.manager [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:55:40 user nova-compute[71321]: DEBUG nova.compute.manager [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:55:40 user nova-compute[71321]: DEBUG nova.network.neutron [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:55:40 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:55:40 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:55:40 user nova-compute[71321]: DEBUG nova.compute.manager [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:55:40 user nova-compute[71321]: DEBUG nova.policy [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '924c3a968d734a1c9ddfc5a44d8f6352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f411f36f23e464fa4a395ad6b2b4472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:55:40 user nova-compute[71321]: DEBUG nova.compute.manager [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:55:40 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:55:40 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Creating image(s)
Apr 12 12:55:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "/opt/stack/data/nova/instances/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:55:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "/opt/stack/data/nova/instances/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:55:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "/opt/stack/data/nova/instances/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:55:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "ef338b5476e03f8d83899b8e304a2ad808f2b08f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:55:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "ef338b5476e03f8d83899b8e304a2ad808f2b08f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:55:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef338b5476e03f8d83899b8e304a2ad808f2b08f.part --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:55:41 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:55:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef338b5476e03f8d83899b8e304a2ad808f2b08f.part --force-share --output=json" returned: 0 in 0.143s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:55:41 user nova-compute[71321]: DEBUG nova.virt.images [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] f4fa635a-1809-4235-81a6-a8a97e8cf13c was qcow2, converting to raw {{(pid=71321) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 12:55:41 user nova-compute[71321]: DEBUG nova.privsep.utils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 12:55:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ef338b5476e03f8d83899b8e304a2ad808f2b08f.part /opt/stack/data/nova/instances/_base/ef338b5476e03f8d83899b8e304a2ad808f2b08f.converted {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:55:41 user nova-compute[71321]: DEBUG nova.network.neutron [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Successfully created port: 7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:55:41 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:55:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ef338b5476e03f8d83899b8e304a2ad808f2b08f.part /opt/stack/data/nova/instances/_base/ef338b5476e03f8d83899b8e304a2ad808f2b08f.converted" returned: 0 in 0.244s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:55:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef338b5476e03f8d83899b8e304a2ad808f2b08f.converted --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:55:41 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:55:41 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:55:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef338b5476e03f8d83899b8e304a2ad808f2b08f.converted --force-share --output=json" returned: 0 in 0.151s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:55:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "ef338b5476e03f8d83899b8e304a2ad808f2b08f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.023s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:55:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:55:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:55:41 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 12:55:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef338b5476e03f8d83899b8e304a2ad808f2b08f --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:55:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef338b5476e03f8d83899b8e304a2ad808f2b08f --force-share --output=json" returned: 0 in 0.136s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:55:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "ef338b5476e03f8d83899b8e304a2ad808f2b08f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:55:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "ef338b5476e03f8d83899b8e304a2ad808f2b08f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:55:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef338b5476e03f8d83899b8e304a2ad808f2b08f --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:55:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef338b5476e03f8d83899b8e304a2ad808f2b08f --force-share --output=json" returned: 0 in 0.127s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:55:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef338b5476e03f8d83899b8e304a2ad808f2b08f,backing_fmt=raw /opt/stack/data/nova/instances/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:55:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef338b5476e03f8d83899b8e304a2ad808f2b08f,backing_fmt=raw /opt/stack/data/nova/instances/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/disk 1073741824" returned: 0 in 0.047s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:55:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "ef338b5476e03f8d83899b8e304a2ad808f2b08f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.180s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:55:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef338b5476e03f8d83899b8e304a2ad808f2b08f --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:55:42 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:55:42 user nova-compute[71321]: DEBUG nova.network.neutron [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Successfully updated port: 7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:55:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef338b5476e03f8d83899b8e304a2ad808f2b08f --force-share --output=json" returned: 0 in 0.131s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:55:42 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:55:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:55:42 user nova-compute[71321]: DEBUG nova.compute.manager [req-67ca3bbd-52a1-4533-8cab-a06fb3f3039c req-a30434aa-354d-4e9f-ac17-f3592fda85f4 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Received event network-changed-7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:55:42 user nova-compute[71321]: DEBUG nova.compute.manager [req-67ca3bbd-52a1-4533-8cab-a06fb3f3039c req-a30434aa-354d-4e9f-ac17-f3592fda85f4 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Refreshing instance network info cache due to event network-changed-7103abd2-88c5-437a-9661-64ca6379a130. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:55:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-67ca3bbd-52a1-4533-8cab-a06fb3f3039c req-a30434aa-354d-4e9f-ac17-f3592fda85f4 service nova] Acquiring lock "refresh_cache-a73a4b87-a9a8-4b01-af1f-4b2a64554b54" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:55:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-67ca3bbd-52a1-4533-8cab-a06fb3f3039c req-a30434aa-354d-4e9f-ac17-f3592fda85f4 service nova] Acquired lock "refresh_cache-a73a4b87-a9a8-4b01-af1f-4b2a64554b54" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:55:42 user nova-compute[71321]: DEBUG nova.network.neutron [req-67ca3bbd-52a1-4533-8cab-a06fb3f3039c req-a30434aa-354d-4e9f-ac17-f3592fda85f4 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Refreshing network info cache for port 7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:55:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "refresh_cache-a73a4b87-a9a8-4b01-af1f-4b2a64554b54" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:55:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:55:42 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Cannot resize image /opt/stack/data/nova/instances/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:55:42 user nova-compute[71321]: DEBUG nova.objects.instance [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lazy-loading 'migration_context' on Instance uuid a73a4b87-a9a8-4b01-af1f-4b2a64554b54 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:55:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:55:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Ensure instance console log exists: /opt/stack/data/nova/instances/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:55:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:55:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:55:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:55:42 user nova-compute[71321]: DEBUG nova.network.neutron [req-67ca3bbd-52a1-4533-8cab-a06fb3f3039c req-a30434aa-354d-4e9f-ac17-f3592fda85f4 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:55:42 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Updating instance_info_cache with network_info: [{"id": "9f228391-1910-4bd3-b317-f1afa3e98a0f", "address": "fa:16:3e:bf:a8:a8", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f228391-19", "ovs_interfaceid": "9f228391-1910-4bd3-b317-f1afa3e98a0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:55:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:55:42 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 12:55:42 user nova-compute[71321]: DEBUG nova.network.neutron [req-67ca3bbd-52a1-4533-8cab-a06fb3f3039c req-a30434aa-354d-4e9f-ac17-f3592fda85f4 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:55:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-67ca3bbd-52a1-4533-8cab-a06fb3f3039c req-a30434aa-354d-4e9f-ac17-f3592fda85f4 service nova] Releasing lock "refresh_cache-a73a4b87-a9a8-4b01-af1f-4b2a64554b54" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:55:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquired lock "refresh_cache-a73a4b87-a9a8-4b01-af1f-4b2a64554b54" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:55:42 user nova-compute[71321]: DEBUG nova.network.neutron [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:55:42 user nova-compute[71321]: DEBUG nova.network.neutron [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:55:43 user nova-compute[71321]: DEBUG nova.network.neutron [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Updating instance_info_cache with network_info: [{"id": "7103abd2-88c5-437a-9661-64ca6379a130", "address": "fa:16:3e:48:0a:10", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7103abd2-88", "ovs_interfaceid": "7103abd2-88c5-437a-9661-64ca6379a130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:55:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Releasing lock "refresh_cache-a73a4b87-a9a8-4b01-af1f-4b2a64554b54" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:55:43 user nova-compute[71321]: DEBUG nova.compute.manager [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Instance network_info: |[{"id": "7103abd2-88c5-437a-9661-64ca6379a130", "address": "fa:16:3e:48:0a:10", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7103abd2-88", "ovs_interfaceid": "7103abd2-88c5-437a-9661-64ca6379a130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:55:43 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Start _get_guest_xml network_info=[{"id": "7103abd2-88c5-437a-9661-64ca6379a130", "address": "fa:16:3e:48:0a:10", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7103abd2-88", "ovs_interfaceid": "7103abd2-88c5-437a-9661-64ca6379a130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:55:37Z,direct_url=<?>,disk_format='qcow2',id=f4fa635a-1809-4235-81a6-a8a97e8cf13c,min_disk=0,min_ram=0,name='tempest-scenario-img--1251687874',owner='2f411f36f23e464fa4a395ad6b2b4472',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'f4fa635a-1809-4235-81a6-a8a97e8cf13c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:55:43 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:55:43 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:55:43 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:55:43 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:55:37Z,direct_url=<?>,disk_format='qcow2',id=f4fa635a-1809-4235-81a6-a8a97e8cf13c,min_disk=0,min_ram=0,name='tempest-scenario-img--1251687874',owner='2f411f36f23e464fa4a395ad6b2b4472',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:55:43 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:55:43 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:55:43 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:55:43 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:55:43 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:55:43 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:55:43 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:55:43 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:55:43 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:55:43 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:55:43 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:55:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-976781852',display_name='tempest-TestMinimumBasicScenario-server-976781852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-976781852',id=39,image_ref='f4fa635a-1809-4235-81a6-a8a97e8cf13c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYCqWk/TodEqXsFi9a7cw3/KtXFhdAQR1LawDDCKO0HiyA4rhVlzn+IXohB9sc83lFxQA8eJtIOy2mHpy8PwlgJxikvBMjWpAvkMzRpwgQMaxEEQSVlwbt2ix9mDjAByw==',key_name='tempest-TestMinimumBasicScenario-1710707159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f411f36f23e464fa4a395ad6b2b4472',ramdisk_id='',reservation_id='r-3wtg7ztk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f4fa635a-1809-4235-81a6-a8a97e8cf13c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-381334085',owner_user_name='tempest-TestMinimumBasicScenario-381334085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:55:40Z,user_data=None,user_id='924c3a968d734a1c9ddfc5a44d8f6352',uuid=a73a4b87-a9a8-4b01-af1f-4b2a64554b54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7103abd2-88c5-437a-9661-64ca6379a130", "address": "fa:16:3e:48:0a:10", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7103abd2-88", "ovs_interfaceid": "7103abd2-88c5-437a-9661-64ca6379a130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:55:43 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Converting VIF {"id": "7103abd2-88c5-437a-9661-64ca6379a130", "address": "fa:16:3e:48:0a:10", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7103abd2-88", "ovs_interfaceid": "7103abd2-88c5-437a-9661-64ca6379a130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:55:43 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:0a:10,bridge_name='br-int',has_traffic_filtering=True,id=7103abd2-88c5-437a-9661-64ca6379a130,network=Network(76f8fc2b-41cf-4efd-9820-c4d4056deaca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7103abd2-88') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:55:43 user nova-compute[71321]: DEBUG nova.objects.instance [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lazy-loading 'pci_devices' on Instance uuid a73a4b87-a9a8-4b01-af1f-4b2a64554b54 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:55:43 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:55:43 user nova-compute[71321]:   <uuid>a73a4b87-a9a8-4b01-af1f-4b2a64554b54</uuid>
Apr 12 12:55:43 user nova-compute[71321]:   <name>instance-00000027</name>
Apr 12 12:55:43 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:55:43 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:55:43 user nova-compute[71321]:   <metadata>
Apr 12 12:55:43 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:55:43 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:55:43 user nova-compute[71321]:       <nova:name>tempest-TestMinimumBasicScenario-server-976781852</nova:name>
Apr 12 12:55:43 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:55:43</nova:creationTime>
Apr 12 12:55:43 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:55:43 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:55:43 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:55:43 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:55:43 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:55:43 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:55:43 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:55:43 user nova-compute[71321]:       <nova:owner>
Apr 12 12:55:43 user nova-compute[71321]:         <nova:user uuid="924c3a968d734a1c9ddfc5a44d8f6352">tempest-TestMinimumBasicScenario-381334085-project-member</nova:user>
Apr 12 12:55:43 user nova-compute[71321]:         <nova:project uuid="2f411f36f23e464fa4a395ad6b2b4472">tempest-TestMinimumBasicScenario-381334085</nova:project>
Apr 12 12:55:43 user nova-compute[71321]:       </nova:owner>
Apr 12 12:55:43 user nova-compute[71321]:       <nova:root type="image" uuid="f4fa635a-1809-4235-81a6-a8a97e8cf13c"/>
Apr 12 12:55:43 user nova-compute[71321]:       <nova:ports>
Apr 12 12:55:43 user nova-compute[71321]:         <nova:port uuid="7103abd2-88c5-437a-9661-64ca6379a130">
Apr 12 12:55:43 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 12:55:43 user nova-compute[71321]:         </nova:port>
Apr 12 12:55:43 user nova-compute[71321]:       </nova:ports>
Apr 12 12:55:43 user nova-compute[71321]:     </nova:instance>
Apr 12 12:55:43 user nova-compute[71321]:   </metadata>
Apr 12 12:55:43 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:55:43 user nova-compute[71321]:     <system>
Apr 12 12:55:43 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:55:43 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:55:43 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:55:43 user nova-compute[71321]:       <entry name="serial">a73a4b87-a9a8-4b01-af1f-4b2a64554b54</entry>
Apr 12 12:55:43 user nova-compute[71321]:       <entry name="uuid">a73a4b87-a9a8-4b01-af1f-4b2a64554b54</entry>
Apr 12 12:55:43 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:55:43 user nova-compute[71321]:     </system>
Apr 12 12:55:43 user nova-compute[71321]:   </sysinfo>
Apr 12 12:55:43 user nova-compute[71321]:   <os>
Apr 12 12:55:43 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:55:43 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:55:43 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:55:43 user nova-compute[71321]:   </os>
Apr 12 12:55:43 user nova-compute[71321]:   <features>
Apr 12 12:55:43 user nova-compute[71321]:     <acpi/>
Apr 12 12:55:43 user nova-compute[71321]:     <apic/>
Apr 12 12:55:43 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:55:43 user nova-compute[71321]:   </features>
Apr 12 12:55:43 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:55:43 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:55:43 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:55:43 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:55:43 user nova-compute[71321]:   </clock>
Apr 12 12:55:43 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:55:43 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:55:43 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:55:43 user nova-compute[71321]:   </cpu>
Apr 12 12:55:43 user nova-compute[71321]:   <devices>
Apr 12 12:55:43 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:55:43 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:55:43 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/disk"/>
Apr 12 12:55:43 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:55:43 user nova-compute[71321]:     </disk>
Apr 12 12:55:43 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:55:43 user nova-compute[71321]:       <mac address="fa:16:3e:48:0a:10"/>
Apr 12 12:55:43 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:55:43 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:55:43 user nova-compute[71321]:       <target dev="tap7103abd2-88"/>
Apr 12 12:55:43 user nova-compute[71321]:     </interface>
Apr 12 12:55:43 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:55:43 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/console.log" append="off"/>
Apr 12 12:55:43 user nova-compute[71321]:     </serial>
Apr 12 12:55:43 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:55:43 user nova-compute[71321]:     <video>
Apr 12 12:55:43 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:55:43 user nova-compute[71321]:     </video>
Apr 12 12:55:43 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:55:43 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:55:43 user nova-compute[71321]:     </rng>
Apr 12 12:55:43 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:55:43 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:55:43 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:55:43 user nova-compute[71321]:     </memballoon>
Apr 12 12:55:43 user nova-compute[71321]:   </devices>
Apr 12 12:55:43 user nova-compute[71321]: </domain>
Apr 12 12:55:43 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:55:43 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:55:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-976781852',display_name='tempest-TestMinimumBasicScenario-server-976781852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-976781852',id=39,image_ref='f4fa635a-1809-4235-81a6-a8a97e8cf13c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYCqWk/TodEqXsFi9a7cw3/KtXFhdAQR1LawDDCKO0HiyA4rhVlzn+IXohB9sc83lFxQA8eJtIOy2mHpy8PwlgJxikvBMjWpAvkMzRpwgQMaxEEQSVlwbt2ix9mDjAByw==',key_name='tempest-TestMinimumBasicScenario-1710707159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f411f36f23e464fa4a395ad6b2b4472',ramdisk_id='',reservation_id='r-3wtg7ztk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f4fa635a-1809-4235-81a6-a8a97e8cf13c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-381334085',owner_user_name='tempest-TestMinimumBasicScenario-381334085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:55:40Z,user_data=None,user_id='924c3a968d734a1c9ddfc5a44d8f6352',uuid=a73a4b87-a9a8-4b01-af1f-4b2a64554b54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7103abd2-88c5-437a-9661-64ca6379a130", "address": "fa:16:3e:48:0a:10", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7103abd2-88", "ovs_interfaceid": "7103abd2-88c5-437a-9661-64ca6379a130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:55:43 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Converting VIF {"id": "7103abd2-88c5-437a-9661-64ca6379a130", "address": "fa:16:3e:48:0a:10", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7103abd2-88", "ovs_interfaceid": "7103abd2-88c5-437a-9661-64ca6379a130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:55:43 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:0a:10,bridge_name='br-int',has_traffic_filtering=True,id=7103abd2-88c5-437a-9661-64ca6379a130,network=Network(76f8fc2b-41cf-4efd-9820-c4d4056deaca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7103abd2-88') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:55:43 user nova-compute[71321]: DEBUG os_vif [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:0a:10,bridge_name='br-int',has_traffic_filtering=True,id=7103abd2-88c5-437a-9661-64ca6379a130,network=Network(76f8fc2b-41cf-4efd-9820-c4d4056deaca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7103abd2-88') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:55:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:55:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:55:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:55:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:55:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7103abd2-88, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:55:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7103abd2-88, col_values=(('external_ids', {'iface-id': '7103abd2-88c5-437a-9661-64ca6379a130', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:0a:10', 'vm-uuid': 'a73a4b87-a9a8-4b01-af1f-4b2a64554b54'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:55:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:55:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:55:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:55:43 user nova-compute[71321]: INFO os_vif [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:0a:10,bridge_name='br-int',has_traffic_filtering=True,id=7103abd2-88c5-437a-9661-64ca6379a130,network=Network(76f8fc2b-41cf-4efd-9820-c4d4056deaca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7103abd2-88')
Apr 12 12:55:43 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:55:43 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] No VIF found with MAC fa:16:3e:48:0a:10, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:55:44 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:55:44 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:55:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:55:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:55:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:55:44 user nova-compute[71321]: DEBUG nova.compute.manager [req-a71590d0-907c-49cb-9b1d-3760bad8e847 req-6c9b89ec-f579-4f8f-9c1a-c0a6a09396b0 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Received event network-vif-plugged-7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:55:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a71590d0-907c-49cb-9b1d-3760bad8e847 req-6c9b89ec-f579-4f8f-9c1a-c0a6a09396b0 service nova] Acquiring lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:55:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a71590d0-907c-49cb-9b1d-3760bad8e847 req-6c9b89ec-f579-4f8f-9c1a-c0a6a09396b0 service nova] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:55:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a71590d0-907c-49cb-9b1d-3760bad8e847 req-6c9b89ec-f579-4f8f-9c1a-c0a6a09396b0 service nova] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:55:44 user nova-compute[71321]: DEBUG nova.compute.manager [req-a71590d0-907c-49cb-9b1d-3760bad8e847 req-6c9b89ec-f579-4f8f-9c1a-c0a6a09396b0 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] No waiting events found dispatching network-vif-plugged-7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:55:44 user nova-compute[71321]: WARNING nova.compute.manager [req-a71590d0-907c-49cb-9b1d-3760bad8e847 req-6c9b89ec-f579-4f8f-9c1a-c0a6a09396b0 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Received unexpected event network-vif-plugged-7103abd2-88c5-437a-9661-64ca6379a130 for instance with vm_state building and task_state spawning.
Apr 12 12:55:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:55:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:55:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:55:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:55:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:55:46 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681304146.7722566, a73a4b87-a9a8-4b01-af1f-4b2a64554b54 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:55:46 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] VM Resumed (Lifecycle Event)
Apr 12 12:55:46 user nova-compute[71321]: DEBUG nova.compute.manager [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:55:46 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:55:46 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Instance spawned successfully.
Apr 12 12:55:46 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:55:46 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:55:46 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:55:46 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:55:46 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:55:46 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:55:46 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:55:46 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:55:46 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:55:46 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:55:46 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681304146.7739327, a73a4b87-a9a8-4b01-af1f-4b2a64554b54 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:55:46 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] VM Started (Lifecycle Event)
Apr 12 12:55:46 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:55:46 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:55:46 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:55:46 user nova-compute[71321]: INFO nova.compute.manager [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Took 6.37 seconds to spawn the instance on the hypervisor.
Apr 12 12:55:46 user nova-compute[71321]: DEBUG nova.compute.manager [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:55:46 user nova-compute[71321]: DEBUG nova.compute.manager [req-e61bfdbe-f075-4d67-a517-6a5c5b3e2e14 req-e912f443-66c5-4f2f-9674-35090cf6c812 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Received event network-vif-plugged-7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:55:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e61bfdbe-f075-4d67-a517-6a5c5b3e2e14 req-e912f443-66c5-4f2f-9674-35090cf6c812 service nova] Acquiring lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:55:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e61bfdbe-f075-4d67-a517-6a5c5b3e2e14 req-e912f443-66c5-4f2f-9674-35090cf6c812 service nova] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:55:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e61bfdbe-f075-4d67-a517-6a5c5b3e2e14 req-e912f443-66c5-4f2f-9674-35090cf6c812 service nova] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:55:46 user nova-compute[71321]: DEBUG nova.compute.manager [req-e61bfdbe-f075-4d67-a517-6a5c5b3e2e14 req-e912f443-66c5-4f2f-9674-35090cf6c812 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] No waiting events found dispatching network-vif-plugged-7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:55:46 user nova-compute[71321]: WARNING nova.compute.manager [req-e61bfdbe-f075-4d67-a517-6a5c5b3e2e14 req-e912f443-66c5-4f2f-9674-35090cf6c812 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Received unexpected event network-vif-plugged-7103abd2-88c5-437a-9661-64ca6379a130 for instance with vm_state building and task_state spawning.
Apr 12 12:55:46 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681304131.956711, 2647400c-e0e8-4fcb-9fa6-b4ab35197ded => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:55:46 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] VM Stopped (Lifecycle Event)
Apr 12 12:55:46 user nova-compute[71321]: DEBUG nova.compute.manager [None req-9257743a-7118-4563-8bcf-b9129df89b37 None None] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:55:47 user nova-compute[71321]: INFO nova.compute.manager [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Took 6.95 seconds to build instance.
Apr 12 12:55:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.056s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:55:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:55:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:55:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:55:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:55:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:55:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 12:55:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 12:55:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 12:55:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:13 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "38198e86-bd23-4196-98a0-79455206305f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:56:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "38198e86-bd23-4196-98a0-79455206305f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:56:17 user nova-compute[71321]: DEBUG nova.compute.manager [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:56:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:56:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:56:17 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:56:17 user nova-compute[71321]: INFO nova.compute.claims [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Claim successful on node user
Apr 12 12:56:17 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:56:17 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:56:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.234s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:56:17 user nova-compute[71321]: DEBUG nova.compute.manager [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:56:17 user nova-compute[71321]: DEBUG nova.compute.manager [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:56:17 user nova-compute[71321]: DEBUG nova.network.neutron [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:56:17 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:56:17 user nova-compute[71321]: DEBUG nova.compute.manager [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:56:17 user nova-compute[71321]: INFO nova.virt.block_device [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Booting with blank volume at /dev/vda
Apr 12 12:56:17 user nova-compute[71321]: DEBUG nova.policy [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:56:18 user nova-compute[71321]: DEBUG nova.network.neutron [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Successfully created port: 5621687b-5d0b-47f7-b11c-a24c403a590a {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:56:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:18 user nova-compute[71321]: DEBUG nova.network.neutron [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Successfully updated port: 5621687b-5d0b-47f7-b11c-a24c403a590a {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:56:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "refresh_cache-38198e86-bd23-4196-98a0-79455206305f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:56:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquired lock "refresh_cache-38198e86-bd23-4196-98a0-79455206305f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:56:18 user nova-compute[71321]: DEBUG nova.network.neutron [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:56:18 user nova-compute[71321]: DEBUG nova.compute.manager [req-7131336c-24b9-4374-b510-bad947afd96b req-91797f52-3678-4f45-a308-f0978a916037 service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] Received event network-changed-5621687b-5d0b-47f7-b11c-a24c403a590a {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:56:18 user nova-compute[71321]: DEBUG nova.compute.manager [req-7131336c-24b9-4374-b510-bad947afd96b req-91797f52-3678-4f45-a308-f0978a916037 service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] Refreshing instance network info cache due to event network-changed-5621687b-5d0b-47f7-b11c-a24c403a590a. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:56:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7131336c-24b9-4374-b510-bad947afd96b req-91797f52-3678-4f45-a308-f0978a916037 service nova] Acquiring lock "refresh_cache-38198e86-bd23-4196-98a0-79455206305f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:56:18 user nova-compute[71321]: DEBUG nova.network.neutron [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:56:19 user nova-compute[71321]: DEBUG nova.network.neutron [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Updating instance_info_cache with network_info: [{"id": "5621687b-5d0b-47f7-b11c-a24c403a590a", "address": "fa:16:3e:0e:91:7d", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621687b-5d", "ovs_interfaceid": "5621687b-5d0b-47f7-b11c-a24c403a590a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:56:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Releasing lock "refresh_cache-38198e86-bd23-4196-98a0-79455206305f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:56:19 user nova-compute[71321]: DEBUG nova.compute.manager [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Instance network_info: |[{"id": "5621687b-5d0b-47f7-b11c-a24c403a590a", "address": "fa:16:3e:0e:91:7d", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621687b-5d", "ovs_interfaceid": "5621687b-5d0b-47f7-b11c-a24c403a590a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:56:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7131336c-24b9-4374-b510-bad947afd96b req-91797f52-3678-4f45-a308-f0978a916037 service nova] Acquired lock "refresh_cache-38198e86-bd23-4196-98a0-79455206305f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:56:19 user nova-compute[71321]: DEBUG nova.network.neutron [req-7131336c-24b9-4374-b510-bad947afd96b req-91797f52-3678-4f45-a308-f0978a916037 service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] Refreshing network info cache for port 5621687b-5d0b-47f7-b11c-a24c403a590a {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:56:19 user nova-compute[71321]: DEBUG nova.network.neutron [req-7131336c-24b9-4374-b510-bad947afd96b req-91797f52-3678-4f45-a308-f0978a916037 service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] Updated VIF entry in instance network info cache for port 5621687b-5d0b-47f7-b11c-a24c403a590a. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:56:19 user nova-compute[71321]: DEBUG nova.network.neutron [req-7131336c-24b9-4374-b510-bad947afd96b req-91797f52-3678-4f45-a308-f0978a916037 service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] Updating instance_info_cache with network_info: [{"id": "5621687b-5d0b-47f7-b11c-a24c403a590a", "address": "fa:16:3e:0e:91:7d", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621687b-5d", "ovs_interfaceid": "5621687b-5d0b-47f7-b11c-a24c403a590a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:56:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7131336c-24b9-4374-b510-bad947afd96b req-91797f52-3678-4f45-a308-f0978a916037 service nova] Releasing lock "refresh_cache-38198e86-bd23-4196-98a0-79455206305f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:56:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a1e95105-0f12-44bb-913b-4146983433aa tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "db9f1454-9e3c-40d4-849b-c13537d6be97" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:56:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a1e95105-0f12-44bb-913b-4146983433aa tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:56:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a1e95105-0f12-44bb-913b-4146983433aa tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:56:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a1e95105-0f12-44bb-913b-4146983433aa tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:56:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a1e95105-0f12-44bb-913b-4146983433aa tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:56:21 user nova-compute[71321]: INFO nova.compute.manager [None req-a1e95105-0f12-44bb-913b-4146983433aa tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Terminating instance
Apr 12 12:56:21 user nova-compute[71321]: DEBUG nova.compute.manager [None req-a1e95105-0f12-44bb-913b-4146983433aa tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:56:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:21 user nova-compute[71321]: DEBUG nova.compute.manager [req-9da5d00a-898d-4981-a88a-880fddd6660a req-dab64c9a-37db-4aa3-b631-e67d2c335bc9 service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Received event network-vif-unplugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:56:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9da5d00a-898d-4981-a88a-880fddd6660a req-dab64c9a-37db-4aa3-b631-e67d2c335bc9 service nova] Acquiring lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:56:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9da5d00a-898d-4981-a88a-880fddd6660a req-dab64c9a-37db-4aa3-b631-e67d2c335bc9 service nova] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:56:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9da5d00a-898d-4981-a88a-880fddd6660a req-dab64c9a-37db-4aa3-b631-e67d2c335bc9 service nova] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:56:21 user nova-compute[71321]: DEBUG nova.compute.manager [req-9da5d00a-898d-4981-a88a-880fddd6660a req-dab64c9a-37db-4aa3-b631-e67d2c335bc9 service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] No waiting events found dispatching network-vif-unplugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:56:21 user nova-compute[71321]: DEBUG nova.compute.manager [req-9da5d00a-898d-4981-a88a-880fddd6660a req-dab64c9a-37db-4aa3-b631-e67d2c335bc9 service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Received event network-vif-unplugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:56:22 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Instance destroyed successfully.
Apr 12 12:56:22 user nova-compute[71321]: DEBUG nova.objects.instance [None req-a1e95105-0f12-44bb-913b-4146983433aa tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'resources' on Instance uuid db9f1454-9e3c-40d4-849b-c13537d6be97 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:56:22 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-a1e95105-0f12-44bb-913b-4146983433aa tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:46:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1788527008',display_name='tempest-AttachVolumeTestJSON-server-1788527008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1788527008',id=34,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuwf936taYEtQ87HL5K7RLSYNC7EYwzjJGVWMdDWY17MG7jKDK8n6UiYp0Wx2O8W7vbPN1WZy4g++M2EnVpaeEZHV1BaHycanzlOj8OAfSm/y0qUI9XhqdtXcmqo6mDGg==',key_name='tempest-keypair-1238241126',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:47:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0e6aaaa9a634f349d371f7c6c15eca2',ramdisk_id='',reservation_id='r-mamvz059',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-905742219',owner_user_name='tempest-AttachVolumeTestJSON-905742219-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:54:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a9c54033c7547c2bae91e6c1dba0976',uuid=db9f1454-9e3c-40d4-849b-c13537d6be97,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "address": "fa:16:3e:c8:2c:e7", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30bdfa-5f", "ovs_interfaceid": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:56:22 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-a1e95105-0f12-44bb-913b-4146983433aa tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Converting VIF {"id": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "address": "fa:16:3e:c8:2c:e7", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30bdfa-5f", "ovs_interfaceid": "9c30bdfa-5f39-4454-af8b-f2ccd880807b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:56:22 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-a1e95105-0f12-44bb-913b-4146983433aa tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:2c:e7,bridge_name='br-int',has_traffic_filtering=True,id=9c30bdfa-5f39-4454-af8b-f2ccd880807b,network=Network(e1afe3b3-a919-4800-9f1c-c8e602defd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c30bdfa-5f') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:56:22 user nova-compute[71321]: DEBUG os_vif [None req-a1e95105-0f12-44bb-913b-4146983433aa tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:2c:e7,bridge_name='br-int',has_traffic_filtering=True,id=9c30bdfa-5f39-4454-af8b-f2ccd880807b,network=Network(e1afe3b3-a919-4800-9f1c-c8e602defd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c30bdfa-5f') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:56:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c30bdfa-5f, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:56:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:56:22 user nova-compute[71321]: INFO os_vif [None req-a1e95105-0f12-44bb-913b-4146983433aa tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:2c:e7,bridge_name='br-int',has_traffic_filtering=True,id=9c30bdfa-5f39-4454-af8b-f2ccd880807b,network=Network(e1afe3b3-a919-4800-9f1c-c8e602defd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c30bdfa-5f')
Apr 12 12:56:22 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-a1e95105-0f12-44bb-913b-4146983433aa tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Deleting instance files /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97_del
Apr 12 12:56:22 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-a1e95105-0f12-44bb-913b-4146983433aa tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Deletion of /opt/stack/data/nova/instances/db9f1454-9e3c-40d4-849b-c13537d6be97_del complete
Apr 12 12:56:22 user nova-compute[71321]: INFO nova.compute.manager [None req-a1e95105-0f12-44bb-913b-4146983433aa tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 12 12:56:22 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-a1e95105-0f12-44bb-913b-4146983433aa tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:56:22 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:56:22 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:56:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:23 user nova-compute[71321]: DEBUG os_brick.utils [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:56:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:56:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:56:23 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f04470-2792-4d38-b5b0-592b6c9d5bb1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:56:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:56:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:56:23 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf767d8f-cea0-4b5f-b4f7-946b81a0b444]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:56:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:56:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:56:23 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[474530b2-a39b-458a-9e6f-d70238ea00a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:56:23 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e26030-3d65-4646-bdc0-1742a5cd51a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:56:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:56:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:56:23 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:56:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:56:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:56:23 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:56:23 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c4229f-1bef-45f1-a769-14e7c5247941]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:56:23 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:56:23 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:56:23 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:56:23 user nova-compute[71321]: DEBUG os_brick.utils [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:56:23 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Updating existing volume attachment record: b66eb1f3-af61-4801-ba56-46da5263151f {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:56:23 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:56:23 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Took 0.90 seconds to deallocate network for instance.
Apr 12 12:56:23 user nova-compute[71321]: DEBUG nova.compute.manager [req-9fa310f9-65d6-4b0a-8b09-962feaca4e46 req-0c4584c9-d3f9-460d-9dc0-a004a0d74d10 service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Received event network-vif-deleted-9c30bdfa-5f39-4454-af8b-f2ccd880807b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:56:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a1e95105-0f12-44bb-913b-4146983433aa tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:56:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a1e95105-0f12-44bb-913b-4146983433aa tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:56:23 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-a1e95105-0f12-44bb-913b-4146983433aa tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:56:23 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-a1e95105-0f12-44bb-913b-4146983433aa tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:56:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a1e95105-0f12-44bb-913b-4146983433aa tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.209s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:56:23 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-a1e95105-0f12-44bb-913b-4146983433aa tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Deleted allocations for instance db9f1454-9e3c-40d4-849b-c13537d6be97
Apr 12 12:56:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-a1e95105-0f12-44bb-913b-4146983433aa tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.184s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:56:23 user nova-compute[71321]: DEBUG nova.compute.manager [req-2fbab5a9-7c2f-43f0-ae6d-87b1454135c7 req-395ffba5-9f5e-4ea8-a234-039bee0895c8 service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Received event network-vif-plugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:56:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2fbab5a9-7c2f-43f0-ae6d-87b1454135c7 req-395ffba5-9f5e-4ea8-a234-039bee0895c8 service nova] Acquiring lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:56:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2fbab5a9-7c2f-43f0-ae6d-87b1454135c7 req-395ffba5-9f5e-4ea8-a234-039bee0895c8 service nova] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:56:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2fbab5a9-7c2f-43f0-ae6d-87b1454135c7 req-395ffba5-9f5e-4ea8-a234-039bee0895c8 service nova] Lock "db9f1454-9e3c-40d4-849b-c13537d6be97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:56:23 user nova-compute[71321]: DEBUG nova.compute.manager [req-2fbab5a9-7c2f-43f0-ae6d-87b1454135c7 req-395ffba5-9f5e-4ea8-a234-039bee0895c8 service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] No waiting events found dispatching network-vif-plugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:56:23 user nova-compute[71321]: WARNING nova.compute.manager [req-2fbab5a9-7c2f-43f0-ae6d-87b1454135c7 req-395ffba5-9f5e-4ea8-a234-039bee0895c8 service nova] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Received unexpected event network-vif-plugged-9c30bdfa-5f39-4454-af8b-f2ccd880807b for instance with vm_state deleted and task_state None.
Apr 12 12:56:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "88c7dd97-0390-4b2b-b803-7ab023366fd4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:56:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "88c7dd97-0390-4b2b-b803-7ab023366fd4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:56:25 user nova-compute[71321]: DEBUG nova.compute.manager [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:56:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:56:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:56:25 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:56:25 user nova-compute[71321]: INFO nova.compute.claims [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Claim successful on node user
Apr 12 12:56:25 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:56:25 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:56:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:56:25 user nova-compute[71321]: DEBUG nova.compute.manager [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:56:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:25 user nova-compute[71321]: DEBUG nova.compute.manager [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:56:25 user nova-compute[71321]: DEBUG nova.network.neutron [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:56:25 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:56:25 user nova-compute[71321]: DEBUG nova.compute.manager [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:56:26 user nova-compute[71321]: DEBUG nova.policy [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a3d9f4516bee4f8d9af7a40ed1298f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61975273ccb41229e0138b96eb7f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:56:26 user nova-compute[71321]: DEBUG nova.compute.manager [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:56:26 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:56:26 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Creating image(s)
Apr 12 12:56:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "/opt/stack/data/nova/instances/88c7dd97-0390-4b2b-b803-7ab023366fd4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:56:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "/opt/stack/data/nova/instances/88c7dd97-0390-4b2b-b803-7ab023366fd4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:56:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "/opt/stack/data/nova/instances/88c7dd97-0390-4b2b-b803-7ab023366fd4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:56:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:56:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.155s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:56:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:56:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:56:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:56:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.184s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:56:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/88c7dd97-0390-4b2b-b803-7ab023366fd4/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:56:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/88c7dd97-0390-4b2b-b803-7ab023366fd4/disk 1073741824" returned: 0 in 0.092s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:56:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:56:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:56:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.189s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:56:26 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Checking if we can resize image /opt/stack/data/nova/instances/88c7dd97-0390-4b2b-b803-7ab023366fd4/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:56:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88c7dd97-0390-4b2b-b803-7ab023366fd4/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:56:26 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88c7dd97-0390-4b2b-b803-7ab023366fd4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:56:26 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Cannot resize image /opt/stack/data/nova/instances/88c7dd97-0390-4b2b-b803-7ab023366fd4/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:56:26 user nova-compute[71321]: DEBUG nova.objects.instance [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lazy-loading 'migration_context' on Instance uuid 88c7dd97-0390-4b2b-b803-7ab023366fd4 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:56:26 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:56:26 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Ensure instance console log exists: /opt/stack/data/nova/instances/88c7dd97-0390-4b2b-b803-7ab023366fd4/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:56:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:56:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:56:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:56:26 user nova-compute[71321]: DEBUG nova.network.neutron [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Successfully created port: 9b06c0b4-3cd0-4352-958a-1a39e37e7925 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:56:27 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:27 user nova-compute[71321]: DEBUG nova.network.neutron [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Successfully updated port: 9b06c0b4-3cd0-4352-958a-1a39e37e7925 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:56:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "refresh_cache-88c7dd97-0390-4b2b-b803-7ab023366fd4" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:56:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquired lock "refresh_cache-88c7dd97-0390-4b2b-b803-7ab023366fd4" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:56:27 user nova-compute[71321]: DEBUG nova.network.neutron [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:56:27 user nova-compute[71321]: DEBUG nova.compute.manager [req-db7a8dd7-bcba-48fa-b228-9ff19335e12b req-f7722351-fb16-4b94-a863-5902195f8da0 service nova] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Received event network-changed-9b06c0b4-3cd0-4352-958a-1a39e37e7925 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:56:27 user nova-compute[71321]: DEBUG nova.compute.manager [req-db7a8dd7-bcba-48fa-b228-9ff19335e12b req-f7722351-fb16-4b94-a863-5902195f8da0 service nova] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Refreshing instance network info cache due to event network-changed-9b06c0b4-3cd0-4352-958a-1a39e37e7925. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:56:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-db7a8dd7-bcba-48fa-b228-9ff19335e12b req-f7722351-fb16-4b94-a863-5902195f8da0 service nova] Acquiring lock "refresh_cache-88c7dd97-0390-4b2b-b803-7ab023366fd4" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:56:27 user nova-compute[71321]: DEBUG nova.network.neutron [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.compute.manager [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:56:28 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Creating image(s)
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Did not create local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Ensure instance console log exists: /opt/stack/data/nova/instances/38198e86-bd23-4196-98a0-79455206305f/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Start _get_guest_xml network_info=[{"id": "5621687b-5d0b-47f7-b11c-a24c403a590a", "address": "fa:16:3e:0e:91:7d", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621687b-5d", "ovs_interfaceid": "5621687b-5d0b-47f7-b11c-a24c403a590a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b66eb1f3-af61-4801-ba56-46da5263151f', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VtOdZwTM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '38198e86-bd23-4196-98a0-79455206305f', 'attached_at': '', 'detached_at': '', 'volume_id': '667b3302-208b-42d6-8f06-0baa6b9482b2', 'serial': '667b3302-208b-42d6-8f06-0baa6b9482b2'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:56:28 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:56:28 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VtOdZwTM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:56:28 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:56:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:56:28 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:56:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:56:28 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad95d4a0-07d6-429d-8b43-58ddb0fc65be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:56:28 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d51e040-a9d4-4a2b-a764-7f1863bff341]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2] added
Apr 12 12:56:28 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0768aea-12a1-4f82-8825-fa470ff1f5ff]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[96762f11-6094-4e96-89a4-c9f30633103a]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VtOdZwTM {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VtOdZwTM" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be63ef2-3040-4b86-b76f-52347e1d8494]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VtOdZwTM'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6372d9f-ace5-4725-a32b-0949b49b4473]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b323bb-a4af-4096-a024-082a7df98007]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 12:56:28 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 12:56:28 user nova-compute[71321]:  {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:56:28 user nova-compute[71321]: WARNING os_brick.initiator.connectors.iscsi [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 12:56:28 user nova-compute[71321]: 
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1717b7-a5e2-4b2d-b032-df9507f8a822]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2, portal: 172.16.0.220,3260]
Apr 12 12:56:28 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2, portal: 172.16.0.220,3260] successful.
Apr 12 12:56:28 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4623ef-0210-4b2c-b969-2e8d95907b87]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b33ae4-de0c-4703-a67c-36d0d33fc446]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 12:56:28 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 12:56:28 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff4ad70-8658-433e-93b5-f07adb885a95]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VtOdZwTM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.network.neutron [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Updating instance_info_cache with network_info: [{"id": "9b06c0b4-3cd0-4352-958a-1a39e37e7925", "address": "fa:16:3e:8f:3f:14", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b06c0b4-3c", "ovs_interfaceid": "9b06c0b4-3cd0-4352-958a-1a39e37e7925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Releasing lock "refresh_cache-88c7dd97-0390-4b2b-b803-7ab023366fd4" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.compute.manager [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Instance network_info: |[{"id": "9b06c0b4-3cd0-4352-958a-1a39e37e7925", "address": "fa:16:3e:8f:3f:14", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b06c0b4-3c", "ovs_interfaceid": "9b06c0b4-3cd0-4352-958a-1a39e37e7925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-db7a8dd7-bcba-48fa-b228-9ff19335e12b req-f7722351-fb16-4b94-a863-5902195f8da0 service nova] Acquired lock "refresh_cache-88c7dd97-0390-4b2b-b803-7ab023366fd4" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.network.neutron [req-db7a8dd7-bcba-48fa-b228-9ff19335e12b req-f7722351-fb16-4b94-a863-5902195f8da0 service nova] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Refreshing network info cache for port 9b06c0b4-3cd0-4352-958a-1a39e37e7925 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Start _get_guest_xml network_info=[{"id": "9b06c0b4-3cd0-4352-958a-1a39e37e7925", "address": "fa:16:3e:8f:3f:14", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b06c0b4-3c", "ovs_interfaceid": "9b06c0b4-3cd0-4352-958a-1a39e37e7925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:56:28 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:56:28 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:56:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2056889362',display_name='tempest-AttachVolumeNegativeTest-server-2056889362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2056889362',id=41,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZmFPVnE4tAmO1yvRexE4d4I4G/HJpMr2SSk8OHxjALBh+f9CTblVVcbe0HlQ0Ch4FIcsGZHFLQnnDkwtJS/ZH/cxRy05QKijU/FHTuCeYRAgiZ/fISBnryI0uJ+P1pLA==',key_name='tempest-keypair-1304891791',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e61975273ccb41229e0138b96eb7f5e9',ramdisk_id='',reservation_id='r-b34rbxyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-941338837',owner_user_name='tempest-AttachVolumeNegativeTest-941338837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:56:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3d9f4516bee4f8d9af7a40ed1298f03',uuid=88c7dd97-0390-4b2b-b803-7ab023366fd4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b06c0b4-3cd0-4352-958a-1a39e37e7925", "address": "fa:16:3e:8f:3f:14", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b06c0b4-3c", "ovs_interfaceid": "9b06c0b4-3cd0-4352-958a-1a39e37e7925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Converting VIF {"id": "9b06c0b4-3cd0-4352-958a-1a39e37e7925", "address": "fa:16:3e:8f:3f:14", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b06c0b4-3c", "ovs_interfaceid": "9b06c0b4-3cd0-4352-958a-1a39e37e7925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:3f:14,bridge_name='br-int',has_traffic_filtering=True,id=9b06c0b4-3cd0-4352-958a-1a39e37e7925,network=Network(e211a286-ade0-4930-a327-4c6a41785094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b06c0b4-3c') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.objects.instance [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lazy-loading 'pci_devices' on Instance uuid 88c7dd97-0390-4b2b-b803-7ab023366fd4 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:56:28 user nova-compute[71321]:   <uuid>88c7dd97-0390-4b2b-b803-7ab023366fd4</uuid>
Apr 12 12:56:28 user nova-compute[71321]:   <name>instance-00000029</name>
Apr 12 12:56:28 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:56:28 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:56:28 user nova-compute[71321]:   <metadata>
Apr 12 12:56:28 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:56:28 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:56:28 user nova-compute[71321]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2056889362</nova:name>
Apr 12 12:56:28 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:56:28</nova:creationTime>
Apr 12 12:56:28 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:56:28 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:56:28 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:56:28 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:56:28 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:56:28 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:56:28 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:56:28 user nova-compute[71321]:       <nova:owner>
Apr 12 12:56:28 user nova-compute[71321]:         <nova:user uuid="a3d9f4516bee4f8d9af7a40ed1298f03">tempest-AttachVolumeNegativeTest-941338837-project-member</nova:user>
Apr 12 12:56:28 user nova-compute[71321]:         <nova:project uuid="e61975273ccb41229e0138b96eb7f5e9">tempest-AttachVolumeNegativeTest-941338837</nova:project>
Apr 12 12:56:28 user nova-compute[71321]:       </nova:owner>
Apr 12 12:56:28 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:56:28 user nova-compute[71321]:       <nova:ports>
Apr 12 12:56:28 user nova-compute[71321]:         <nova:port uuid="9b06c0b4-3cd0-4352-958a-1a39e37e7925">
Apr 12 12:56:28 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 12:56:28 user nova-compute[71321]:         </nova:port>
Apr 12 12:56:28 user nova-compute[71321]:       </nova:ports>
Apr 12 12:56:28 user nova-compute[71321]:     </nova:instance>
Apr 12 12:56:28 user nova-compute[71321]:   </metadata>
Apr 12 12:56:28 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:56:28 user nova-compute[71321]:     <system>
Apr 12 12:56:28 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:56:28 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:56:28 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:56:28 user nova-compute[71321]:       <entry name="serial">88c7dd97-0390-4b2b-b803-7ab023366fd4</entry>
Apr 12 12:56:28 user nova-compute[71321]:       <entry name="uuid">88c7dd97-0390-4b2b-b803-7ab023366fd4</entry>
Apr 12 12:56:28 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:56:28 user nova-compute[71321]:     </system>
Apr 12 12:56:28 user nova-compute[71321]:   </sysinfo>
Apr 12 12:56:28 user nova-compute[71321]:   <os>
Apr 12 12:56:28 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:56:28 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:56:28 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:56:28 user nova-compute[71321]:   </os>
Apr 12 12:56:28 user nova-compute[71321]:   <features>
Apr 12 12:56:28 user nova-compute[71321]:     <acpi/>
Apr 12 12:56:28 user nova-compute[71321]:     <apic/>
Apr 12 12:56:28 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:56:28 user nova-compute[71321]:   </features>
Apr 12 12:56:28 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:56:28 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:56:28 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:56:28 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:56:28 user nova-compute[71321]:   </clock>
Apr 12 12:56:28 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:56:28 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:56:28 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:56:28 user nova-compute[71321]:   </cpu>
Apr 12 12:56:28 user nova-compute[71321]:   <devices>
Apr 12 12:56:28 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:56:28 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:56:28 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/88c7dd97-0390-4b2b-b803-7ab023366fd4/disk"/>
Apr 12 12:56:28 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:56:28 user nova-compute[71321]:     </disk>
Apr 12 12:56:28 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:56:28 user nova-compute[71321]:       <mac address="fa:16:3e:8f:3f:14"/>
Apr 12 12:56:28 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:56:28 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:56:28 user nova-compute[71321]:       <target dev="tap9b06c0b4-3c"/>
Apr 12 12:56:28 user nova-compute[71321]:     </interface>
Apr 12 12:56:28 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:56:28 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/88c7dd97-0390-4b2b-b803-7ab023366fd4/console.log" append="off"/>
Apr 12 12:56:28 user nova-compute[71321]:     </serial>
Apr 12 12:56:28 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:56:28 user nova-compute[71321]:     <video>
Apr 12 12:56:28 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:56:28 user nova-compute[71321]:     </video>
Apr 12 12:56:28 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:56:28 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:56:28 user nova-compute[71321]:     </rng>
Apr 12 12:56:28 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:56:28 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:56:28 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:56:28 user nova-compute[71321]:     </memballoon>
Apr 12 12:56:28 user nova-compute[71321]:   </devices>
Apr 12 12:56:28 user nova-compute[71321]: </domain>
Apr 12 12:56:28 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:56:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2056889362',display_name='tempest-AttachVolumeNegativeTest-server-2056889362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2056889362',id=41,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZmFPVnE4tAmO1yvRexE4d4I4G/HJpMr2SSk8OHxjALBh+f9CTblVVcbe0HlQ0Ch4FIcsGZHFLQnnDkwtJS/ZH/cxRy05QKijU/FHTuCeYRAgiZ/fISBnryI0uJ+P1pLA==',key_name='tempest-keypair-1304891791',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e61975273ccb41229e0138b96eb7f5e9',ramdisk_id='',reservation_id='r-b34rbxyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-941338837',owner_user_name='tempest-AttachVolumeNegativeTest-941338837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:56:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3d9f4516bee4f8d9af7a40ed1298f03',uuid=88c7dd97-0390-4b2b-b803-7ab023366fd4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b06c0b4-3cd0-4352-958a-1a39e37e7925", "address": "fa:16:3e:8f:3f:14", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b06c0b4-3c", "ovs_interfaceid": "9b06c0b4-3cd0-4352-958a-1a39e37e7925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Converting VIF {"id": "9b06c0b4-3cd0-4352-958a-1a39e37e7925", "address": "fa:16:3e:8f:3f:14", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b06c0b4-3c", "ovs_interfaceid": "9b06c0b4-3cd0-4352-958a-1a39e37e7925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:3f:14,bridge_name='br-int',has_traffic_filtering=True,id=9b06c0b4-3cd0-4352-958a-1a39e37e7925,network=Network(e211a286-ade0-4930-a327-4c6a41785094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b06c0b4-3c') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG os_vif [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:3f:14,bridge_name='br-int',has_traffic_filtering=True,id=9b06c0b4-3cd0-4352-958a-1a39e37e7925,network=Network(e211a286-ade0-4930-a327-4c6a41785094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b06c0b4-3c') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b06c0b4-3c, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9b06c0b4-3c, col_values=(('external_ids', {'iface-id': '9b06c0b4-3cd0-4352-958a-1a39e37e7925', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:3f:14', 'vm-uuid': '88c7dd97-0390-4b2b-b803-7ab023366fd4'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:28 user nova-compute[71321]: INFO os_vif [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:3f:14,bridge_name='br-int',has_traffic_filtering=True,id=9b06c0b4-3cd0-4352-958a-1a39e37e7925,network=Network(e211a286-ade0-4930-a327-4c6a41785094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b06c0b4-3c')
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] No VIF found with MAC fa:16:3e:8f:3f:14, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.network.neutron [req-db7a8dd7-bcba-48fa-b228-9ff19335e12b req-f7722351-fb16-4b94-a863-5902195f8da0 service nova] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Updated VIF entry in instance network info cache for port 9b06c0b4-3cd0-4352-958a-1a39e37e7925. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG nova.network.neutron [req-db7a8dd7-bcba-48fa-b228-9ff19335e12b req-f7722351-fb16-4b94-a863-5902195f8da0 service nova] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Updating instance_info_cache with network_info: [{"id": "9b06c0b4-3cd0-4352-958a-1a39e37e7925", "address": "fa:16:3e:8f:3f:14", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b06c0b4-3c", "ovs_interfaceid": "9b06c0b4-3cd0-4352-958a-1a39e37e7925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:56:28 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-db7a8dd7-bcba-48fa-b228-9ff19335e12b req-f7722351-fb16-4b94-a863-5902195f8da0 service nova] Releasing lock "refresh_cache-88c7dd97-0390-4b2b-b803-7ab023366fd4" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:56:29 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.270s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:56:29 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] <== connect_volume: return (1271ms) {'type': 'block', 'scsi_wwn': '23166633766306438', 'path': '/dev/sdb'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:56:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166633766306438', 'path': '/dev/sdb'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:56:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:56:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1998019959',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1998019959',id=40,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f20ad21427a04683b9b102d2ff0290a5',ramdisk_id='',reservation_id='r-dgt4i0o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-636247513',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:56:17Z,user_data=None,user_id='435e0d6fd2b3437f837e82730b4d955f',uuid=38198e86-bd23-4196-98a0-79455206305f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5621687b-5d0b-47f7-b11c-a24c403a590a", "address": "fa:16:3e:0e:91:7d", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621687b-5d", "ovs_interfaceid": "5621687b-5d0b-47f7-b11c-a24c403a590a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:56:29 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Converting VIF {"id": "5621687b-5d0b-47f7-b11c-a24c403a590a", "address": "fa:16:3e:0e:91:7d", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621687b-5d", "ovs_interfaceid": "5621687b-5d0b-47f7-b11c-a24c403a590a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:56:29 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:91:7d,bridge_name='br-int',has_traffic_filtering=True,id=5621687b-5d0b-47f7-b11c-a24c403a590a,network=Network(bb52f82e-56ca-41f7-b171-a3cacb549ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5621687b-5d') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:56:29 user nova-compute[71321]: DEBUG nova.objects.instance [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lazy-loading 'pci_devices' on Instance uuid 38198e86-bd23-4196-98a0-79455206305f {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:56:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:56:29 user nova-compute[71321]:   <uuid>38198e86-bd23-4196-98a0-79455206305f</uuid>
Apr 12 12:56:29 user nova-compute[71321]:   <name>instance-00000028</name>
Apr 12 12:56:29 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:56:29 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:56:29 user nova-compute[71321]:   <metadata>
Apr 12 12:56:29 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:56:29 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:56:29 user nova-compute[71321]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1998019959</nova:name>
Apr 12 12:56:29 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:56:28</nova:creationTime>
Apr 12 12:56:29 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:56:29 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:56:29 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:56:29 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:56:29 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:56:29 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:56:29 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:56:29 user nova-compute[71321]:       <nova:owner>
Apr 12 12:56:29 user nova-compute[71321]:         <nova:user uuid="435e0d6fd2b3437f837e82730b4d955f">tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member</nova:user>
Apr 12 12:56:29 user nova-compute[71321]:         <nova:project uuid="f20ad21427a04683b9b102d2ff0290a5">tempest-ServerBootFromVolumeStableRescueTest-636247513</nova:project>
Apr 12 12:56:29 user nova-compute[71321]:       </nova:owner>
Apr 12 12:56:29 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:56:29 user nova-compute[71321]:       <nova:ports>
Apr 12 12:56:29 user nova-compute[71321]:         <nova:port uuid="5621687b-5d0b-47f7-b11c-a24c403a590a">
Apr 12 12:56:29 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 12:56:29 user nova-compute[71321]:         </nova:port>
Apr 12 12:56:29 user nova-compute[71321]:       </nova:ports>
Apr 12 12:56:29 user nova-compute[71321]:     </nova:instance>
Apr 12 12:56:29 user nova-compute[71321]:   </metadata>
Apr 12 12:56:29 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:56:29 user nova-compute[71321]:     <system>
Apr 12 12:56:29 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:56:29 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:56:29 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:56:29 user nova-compute[71321]:       <entry name="serial">38198e86-bd23-4196-98a0-79455206305f</entry>
Apr 12 12:56:29 user nova-compute[71321]:       <entry name="uuid">38198e86-bd23-4196-98a0-79455206305f</entry>
Apr 12 12:56:29 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:56:29 user nova-compute[71321]:     </system>
Apr 12 12:56:29 user nova-compute[71321]:   </sysinfo>
Apr 12 12:56:29 user nova-compute[71321]:   <os>
Apr 12 12:56:29 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:56:29 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:56:29 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:56:29 user nova-compute[71321]:   </os>
Apr 12 12:56:29 user nova-compute[71321]:   <features>
Apr 12 12:56:29 user nova-compute[71321]:     <acpi/>
Apr 12 12:56:29 user nova-compute[71321]:     <apic/>
Apr 12 12:56:29 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:56:29 user nova-compute[71321]:   </features>
Apr 12 12:56:29 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:56:29 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:56:29 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:56:29 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:56:29 user nova-compute[71321]:   </clock>
Apr 12 12:56:29 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:56:29 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:56:29 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:56:29 user nova-compute[71321]:   </cpu>
Apr 12 12:56:29 user nova-compute[71321]:   <devices>
Apr 12 12:56:29 user nova-compute[71321]:     <disk type="block" device="disk">
Apr 12 12:56:29 user nova-compute[71321]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:56:29 user nova-compute[71321]:       <source dev="/dev/sdb"/>
Apr 12 12:56:29 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:56:29 user nova-compute[71321]:       <serial>667b3302-208b-42d6-8f06-0baa6b9482b2</serial>
Apr 12 12:56:29 user nova-compute[71321]:     </disk>
Apr 12 12:56:29 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:56:29 user nova-compute[71321]:       <mac address="fa:16:3e:0e:91:7d"/>
Apr 12 12:56:29 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:56:29 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:56:29 user nova-compute[71321]:       <target dev="tap5621687b-5d"/>
Apr 12 12:56:29 user nova-compute[71321]:     </interface>
Apr 12 12:56:29 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:56:29 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/38198e86-bd23-4196-98a0-79455206305f/console.log" append="off"/>
Apr 12 12:56:29 user nova-compute[71321]:     </serial>
Apr 12 12:56:29 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:56:29 user nova-compute[71321]:     <video>
Apr 12 12:56:29 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:56:29 user nova-compute[71321]:     </video>
Apr 12 12:56:29 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:56:29 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:56:29 user nova-compute[71321]:     </rng>
Apr 12 12:56:29 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:56:29 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:56:29 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:56:29 user nova-compute[71321]:     </memballoon>
Apr 12 12:56:29 user nova-compute[71321]:   </devices>
Apr 12 12:56:29 user nova-compute[71321]: </domain>
Apr 12 12:56:29 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:56:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:56:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1998019959',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1998019959',id=40,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f20ad21427a04683b9b102d2ff0290a5',ramdisk_id='',reservation_id='r-dgt4i0o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-636247513',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:56:17Z,user_data=None,user_id='435e0d6fd2b3437f837e82730b4d955f',uuid=38198e86-bd23-4196-98a0-79455206305f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5621687b-5d0b-47f7-b11c-a24c403a590a", "address": "fa:16:3e:0e:91:7d", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621687b-5d", "ovs_interfaceid": "5621687b-5d0b-47f7-b11c-a24c403a590a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:56:29 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Converting VIF {"id": "5621687b-5d0b-47f7-b11c-a24c403a590a", "address": "fa:16:3e:0e:91:7d", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621687b-5d", "ovs_interfaceid": "5621687b-5d0b-47f7-b11c-a24c403a590a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:56:29 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:91:7d,bridge_name='br-int',has_traffic_filtering=True,id=5621687b-5d0b-47f7-b11c-a24c403a590a,network=Network(bb52f82e-56ca-41f7-b171-a3cacb549ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5621687b-5d') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:56:29 user nova-compute[71321]: DEBUG os_vif [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:91:7d,bridge_name='br-int',has_traffic_filtering=True,id=5621687b-5d0b-47f7-b11c-a24c403a590a,network=Network(bb52f82e-56ca-41f7-b171-a3cacb549ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5621687b-5d') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:56:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:56:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:56:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5621687b-5d, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:56:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5621687b-5d, col_values=(('external_ids', {'iface-id': '5621687b-5d0b-47f7-b11c-a24c403a590a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:91:7d', 'vm-uuid': '38198e86-bd23-4196-98a0-79455206305f'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:56:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:56:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:29 user nova-compute[71321]: INFO os_vif [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:91:7d,bridge_name='br-int',has_traffic_filtering=True,id=5621687b-5d0b-47f7-b11c-a24c403a590a,network=Network(bb52f82e-56ca-41f7-b171-a3cacb549ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5621687b-5d')
Apr 12 12:56:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:56:29 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] No VIF found with MAC fa:16:3e:0e:91:7d, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:56:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:30 user nova-compute[71321]: DEBUG nova.compute.manager [req-1344b07d-d96c-4872-8e9e-a5d0033562ff req-5eea21b8-d366-4d62-8b98-3078187a8119 service nova] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Received event network-vif-plugged-9b06c0b4-3cd0-4352-958a-1a39e37e7925 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:56:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-1344b07d-d96c-4872-8e9e-a5d0033562ff req-5eea21b8-d366-4d62-8b98-3078187a8119 service nova] Acquiring lock "88c7dd97-0390-4b2b-b803-7ab023366fd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:56:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-1344b07d-d96c-4872-8e9e-a5d0033562ff req-5eea21b8-d366-4d62-8b98-3078187a8119 service nova] Lock "88c7dd97-0390-4b2b-b803-7ab023366fd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:56:30 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-1344b07d-d96c-4872-8e9e-a5d0033562ff req-5eea21b8-d366-4d62-8b98-3078187a8119 service nova] Lock "88c7dd97-0390-4b2b-b803-7ab023366fd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:56:30 user nova-compute[71321]: DEBUG nova.compute.manager [req-1344b07d-d96c-4872-8e9e-a5d0033562ff req-5eea21b8-d366-4d62-8b98-3078187a8119 service nova] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] No waiting events found dispatching network-vif-plugged-9b06c0b4-3cd0-4352-958a-1a39e37e7925 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:56:30 user nova-compute[71321]: WARNING nova.compute.manager [req-1344b07d-d96c-4872-8e9e-a5d0033562ff req-5eea21b8-d366-4d62-8b98-3078187a8119 service nova] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Received unexpected event network-vif-plugged-9b06c0b4-3cd0-4352-958a-1a39e37e7925 for instance with vm_state building and task_state spawning.
Apr 12 12:56:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:32 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:56:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:56:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:56:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:56:32 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:56:32 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:56:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:56:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:56:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:56:32 user nova-compute[71321]: DEBUG nova.compute.manager [req-57e7e541-6979-4eb4-b345-60bcd0247bdd req-635f7d0a-c059-4b8f-9315-2e8e4ef4fe8a service nova] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Received event network-vif-plugged-9b06c0b4-3cd0-4352-958a-1a39e37e7925 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:56:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-57e7e541-6979-4eb4-b345-60bcd0247bdd req-635f7d0a-c059-4b8f-9315-2e8e4ef4fe8a service nova] Acquiring lock "88c7dd97-0390-4b2b-b803-7ab023366fd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:56:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-57e7e541-6979-4eb4-b345-60bcd0247bdd req-635f7d0a-c059-4b8f-9315-2e8e4ef4fe8a service nova] Lock "88c7dd97-0390-4b2b-b803-7ab023366fd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:56:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-57e7e541-6979-4eb4-b345-60bcd0247bdd req-635f7d0a-c059-4b8f-9315-2e8e4ef4fe8a service nova] Lock "88c7dd97-0390-4b2b-b803-7ab023366fd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:56:32 user nova-compute[71321]: DEBUG nova.compute.manager [req-57e7e541-6979-4eb4-b345-60bcd0247bdd req-635f7d0a-c059-4b8f-9315-2e8e4ef4fe8a service nova] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] No waiting events found dispatching network-vif-plugged-9b06c0b4-3cd0-4352-958a-1a39e37e7925 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:56:32 user nova-compute[71321]: WARNING nova.compute.manager [req-57e7e541-6979-4eb4-b345-60bcd0247bdd req-635f7d0a-c059-4b8f-9315-2e8e4ef4fe8a service nova] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Received unexpected event network-vif-plugged-9b06c0b4-3cd0-4352-958a-1a39e37e7925 for instance with vm_state building and task_state spawning.
Apr 12 12:56:32 user nova-compute[71321]: DEBUG nova.compute.manager [req-57e7e541-6979-4eb4-b345-60bcd0247bdd req-635f7d0a-c059-4b8f-9315-2e8e4ef4fe8a service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] Received event network-vif-plugged-5621687b-5d0b-47f7-b11c-a24c403a590a {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:56:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-57e7e541-6979-4eb4-b345-60bcd0247bdd req-635f7d0a-c059-4b8f-9315-2e8e4ef4fe8a service nova] Acquiring lock "38198e86-bd23-4196-98a0-79455206305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:56:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-57e7e541-6979-4eb4-b345-60bcd0247bdd req-635f7d0a-c059-4b8f-9315-2e8e4ef4fe8a service nova] Lock "38198e86-bd23-4196-98a0-79455206305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:56:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-57e7e541-6979-4eb4-b345-60bcd0247bdd req-635f7d0a-c059-4b8f-9315-2e8e4ef4fe8a service nova] Lock "38198e86-bd23-4196-98a0-79455206305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:56:32 user nova-compute[71321]: DEBUG nova.compute.manager [req-57e7e541-6979-4eb4-b345-60bcd0247bdd req-635f7d0a-c059-4b8f-9315-2e8e4ef4fe8a service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] No waiting events found dispatching network-vif-plugged-5621687b-5d0b-47f7-b11c-a24c403a590a {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:56:32 user nova-compute[71321]: WARNING nova.compute.manager [req-57e7e541-6979-4eb4-b345-60bcd0247bdd req-635f7d0a-c059-4b8f-9315-2e8e4ef4fe8a service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] Received unexpected event network-vif-plugged-5621687b-5d0b-47f7-b11c-a24c403a590a for instance with vm_state building and task_state spawning.
Apr 12 12:56:32 user nova-compute[71321]: DEBUG nova.compute.manager [req-57e7e541-6979-4eb4-b345-60bcd0247bdd req-635f7d0a-c059-4b8f-9315-2e8e4ef4fe8a service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] Received event network-vif-plugged-5621687b-5d0b-47f7-b11c-a24c403a590a {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:56:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-57e7e541-6979-4eb4-b345-60bcd0247bdd req-635f7d0a-c059-4b8f-9315-2e8e4ef4fe8a service nova] Acquiring lock "38198e86-bd23-4196-98a0-79455206305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:56:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-57e7e541-6979-4eb4-b345-60bcd0247bdd req-635f7d0a-c059-4b8f-9315-2e8e4ef4fe8a service nova] Lock "38198e86-bd23-4196-98a0-79455206305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:56:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-57e7e541-6979-4eb4-b345-60bcd0247bdd req-635f7d0a-c059-4b8f-9315-2e8e4ef4fe8a service nova] Lock "38198e86-bd23-4196-98a0-79455206305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:56:32 user nova-compute[71321]: DEBUG nova.compute.manager [req-57e7e541-6979-4eb4-b345-60bcd0247bdd req-635f7d0a-c059-4b8f-9315-2e8e4ef4fe8a service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] No waiting events found dispatching network-vif-plugged-5621687b-5d0b-47f7-b11c-a24c403a590a {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:56:32 user nova-compute[71321]: WARNING nova.compute.manager [req-57e7e541-6979-4eb4-b345-60bcd0247bdd req-635f7d0a-c059-4b8f-9315-2e8e4ef4fe8a service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] Received unexpected event network-vif-plugged-5621687b-5d0b-47f7-b11c-a24c403a590a for instance with vm_state building and task_state spawning.
Apr 12 12:56:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:56:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88c7dd97-0390-4b2b-b803-7ab023366fd4/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:56:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88c7dd97-0390-4b2b-b803-7ab023366fd4/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:56:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88c7dd97-0390-4b2b-b803-7ab023366fd4/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:56:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88c7dd97-0390-4b2b-b803-7ab023366fd4/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:56:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:56:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:56:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:56:33 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:56:33 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681304193.4991171, 88c7dd97-0390-4b2b-b803-7ab023366fd4 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:56:33 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] VM Resumed (Lifecycle Event)
Apr 12 12:56:33 user nova-compute[71321]: DEBUG nova.compute.manager [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:56:33 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:56:33 user nova-compute[71321]: DEBUG nova.compute.manager [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:56:33 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:56:33 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Instance spawned successfully.
Apr 12 12:56:33 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:56:33 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:56:33 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:56:33 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:56:33 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8458MB free_disk=26.289569854736328GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:56:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:56:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:56:33 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 38198e86-bd23-4196-98a0-79455206305f] Instance spawned successfully.
Apr 12 12:56:33 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:56:33 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:56:33 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:56:33 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:56:33 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:56:33 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:56:33 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:56:33 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:56:33 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:56:33 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681304193.4992938, 88c7dd97-0390-4b2b-b803-7ab023366fd4 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:56:33 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] VM Started (Lifecycle Event)
Apr 12 12:56:33 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:56:33 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:56:33 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:56:33 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:56:33 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:56:33 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:56:34 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:56:34 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:56:34 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:56:34 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681304193.5222487, 38198e86-bd23-4196-98a0-79455206305f => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:56:34 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] VM Resumed (Lifecycle Event)
Apr 12 12:56:34 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:56:34 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:56:34 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:56:34 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 38198e86-bd23-4196-98a0-79455206305f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:56:34 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 88c7dd97-0390-4b2b-b803-7ab023366fd4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:56:34 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:56:34 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:56:34 user nova-compute[71321]: INFO nova.compute.manager [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Took 8.00 seconds to spawn the instance on the hypervisor.
Apr 12 12:56:34 user nova-compute[71321]: DEBUG nova.compute.manager [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:56:34 user nova-compute[71321]: INFO nova.compute.manager [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Took 6.09 seconds to spawn the instance on the hypervisor.
Apr 12 12:56:34 user nova-compute[71321]: DEBUG nova.compute.manager [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:56:34 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:56:34 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:56:34 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681304193.524144, 38198e86-bd23-4196-98a0-79455206305f => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:56:34 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] VM Started (Lifecycle Event)
Apr 12 12:56:34 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:56:34 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:56:34 user nova-compute[71321]: INFO nova.compute.manager [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Took 17.09 seconds to build instance.
Apr 12 12:56:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "38198e86-bd23-4196-98a0-79455206305f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.175s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:56:34 user nova-compute[71321]: INFO nova.compute.manager [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Took 8.94 seconds to build instance.
Apr 12 12:56:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "88c7dd97-0390-4b2b-b803-7ab023366fd4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.034s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:56:34 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:56:34 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:56:34 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:56:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.353s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:56:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:36 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:56:37 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681304182.2075667, db9f1454-9e3c-40d4-849b-c13537d6be97 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:56:37 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] VM Stopped (Lifecycle Event)
Apr 12 12:56:37 user nova-compute[71321]: DEBUG nova.compute.manager [None req-846404de-d808-4ad2-a460-826a46e7690f None None] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:56:37 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:56:37 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:56:38 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:56:39 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:40 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:56:41 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:56:41 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:56:42 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:56:42 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:56:42 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Rebuilding the list of instances to heal {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 12:56:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:56:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:56:42 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 12:56:42 user nova-compute[71321]: DEBUG nova.objects.instance [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lazy-loading 'info_cache' on Instance uuid e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:56:42 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Updating instance_info_cache with network_info: [{"id": "9f228391-1910-4bd3-b317-f1afa3e98a0f", "address": "fa:16:3e:bf:a8:a8", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f228391-19", "ovs_interfaceid": "9f228391-1910-4bd3-b317-f1afa3e98a0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:56:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:56:42 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 12:56:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:56:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:56:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 12:56:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 12:56:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 12:56:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:45 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:56:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:46 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:56:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:56:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:57:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:57:15 user nova-compute[71321]: DEBUG nova.compute.manager [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 12:57:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:57:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:57:15 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 12:57:15 user nova-compute[71321]: INFO nova.compute.claims [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Claim successful on node user
Apr 12 12:57:15 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:57:15 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:57:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.278s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:57:15 user nova-compute[71321]: DEBUG nova.compute.manager [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 12:57:15 user nova-compute[71321]: DEBUG nova.compute.manager [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 12:57:15 user nova-compute[71321]: DEBUG nova.network.neutron [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 12:57:15 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 12:57:15 user nova-compute[71321]: DEBUG nova.compute.manager [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 12:57:15 user nova-compute[71321]: DEBUG nova.policy [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8a9c54033c7547c2bae91e6c1dba0976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e6aaaa9a634f349d371f7c6c15eca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 12:57:15 user nova-compute[71321]: DEBUG nova.compute.manager [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 12:57:15 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 12:57:15 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Creating image(s)
Apr 12 12:57:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ebf6f6b-3940-40fa-9a20-a28a957961e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:57:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "/opt/stack/data/nova/instances/9ebf6f6b-3940-40fa-9a20-a28a957961e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:57:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "/opt/stack/data/nova/instances/9ebf6f6b-3940-40fa-9a20-a28a957961e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:57:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:57:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.145s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:57:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:57:15 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:57:15 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:57:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.139s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:57:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/9ebf6f6b-3940-40fa-9a20-a28a957961e2/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:57:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/9ebf6f6b-3940-40fa-9a20-a28a957961e2/disk 1073741824" returned: 0 in 0.049s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:57:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:57:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:57:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.137s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:57:16 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ebf6f6b-3940-40fa-9a20-a28a957961e2/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 12:57:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ebf6f6b-3940-40fa-9a20-a28a957961e2/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:57:16 user nova-compute[71321]: DEBUG nova.network.neutron [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Successfully created port: 82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 12:57:16 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ebf6f6b-3940-40fa-9a20-a28a957961e2/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:57:16 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Cannot resize image /opt/stack/data/nova/instances/9ebf6f6b-3940-40fa-9a20-a28a957961e2/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 12:57:16 user nova-compute[71321]: DEBUG nova.objects.instance [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'migration_context' on Instance uuid 9ebf6f6b-3940-40fa-9a20-a28a957961e2 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:57:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:57:16 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Ensure instance console log exists: /opt/stack/data/nova/instances/9ebf6f6b-3940-40fa-9a20-a28a957961e2/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 12:57:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:57:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:57:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG nova.network.neutron [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Successfully updated port: 82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "refresh_cache-9ebf6f6b-3940-40fa-9a20-a28a957961e2" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquired lock "refresh_cache-9ebf6f6b-3940-40fa-9a20-a28a957961e2" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG nova.network.neutron [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG nova.compute.manager [req-34af886c-f258-4592-89cf-94aa29bf24c2 req-4f19a4ea-6dda-4252-b877-30f287b22797 service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Received event network-changed-82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG nova.compute.manager [req-34af886c-f258-4592-89cf-94aa29bf24c2 req-4f19a4ea-6dda-4252-b877-30f287b22797 service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Refreshing instance network info cache due to event network-changed-82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-34af886c-f258-4592-89cf-94aa29bf24c2 req-4f19a4ea-6dda-4252-b877-30f287b22797 service nova] Acquiring lock "refresh_cache-9ebf6f6b-3940-40fa-9a20-a28a957961e2" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG nova.network.neutron [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG nova.network.neutron [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Updating instance_info_cache with network_info: [{"id": "82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf", "address": "fa:16:3e:4d:b8:a2", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82eff0a4-60", "ovs_interfaceid": "82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Releasing lock "refresh_cache-9ebf6f6b-3940-40fa-9a20-a28a957961e2" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG nova.compute.manager [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Instance network_info: |[{"id": "82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf", "address": "fa:16:3e:4d:b8:a2", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82eff0a4-60", "ovs_interfaceid": "82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-34af886c-f258-4592-89cf-94aa29bf24c2 req-4f19a4ea-6dda-4252-b877-30f287b22797 service nova] Acquired lock "refresh_cache-9ebf6f6b-3940-40fa-9a20-a28a957961e2" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG nova.network.neutron [req-34af886c-f258-4592-89cf-94aa29bf24c2 req-4f19a4ea-6dda-4252-b877-30f287b22797 service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Refreshing network info cache for port 82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Start _get_guest_xml network_info=[{"id": "82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf", "address": "fa:16:3e:4d:b8:a2", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82eff0a4-60", "ovs_interfaceid": "82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:57:17 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:57:17 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:57:17 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:57:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-65757566',display_name='tempest-AttachVolumeTestJSON-server-65757566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-65757566',id=42,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+VqciJ+AVvCe/N0xwWOn/nJY1e4lfokIJeJ1FKR2w8X6Y9f/4CVW/1X9EydJvxQYb4/9jutiZdSGF9cw4hZDSkkxaTg/Y/3AIuAySVrBR5vodpwIgm/ehG2VQ4V0w+AQ==',key_name='tempest-keypair-990566308',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0e6aaaa9a634f349d371f7c6c15eca2',ramdisk_id='',reservation_id='r-u9ahjxxj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-905742219',owner_user_name='tempest-AttachVolumeTestJSON-905742219-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:57:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a9c54033c7547c2bae91e6c1dba0976',uuid=9ebf6f6b-3940-40fa-9a20-a28a957961e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf", "address": "fa:16:3e:4d:b8:a2", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82eff0a4-60", "ovs_interfaceid": "82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Converting VIF {"id": "82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf", "address": "fa:16:3e:4d:b8:a2", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82eff0a4-60", "ovs_interfaceid": "82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:b8:a2,bridge_name='br-int',has_traffic_filtering=True,id=82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf,network=Network(e1afe3b3-a919-4800-9f1c-c8e602defd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82eff0a4-60') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG nova.objects.instance [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ebf6f6b-3940-40fa-9a20-a28a957961e2 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:57:17 user nova-compute[71321]:   <uuid>9ebf6f6b-3940-40fa-9a20-a28a957961e2</uuid>
Apr 12 12:57:17 user nova-compute[71321]:   <name>instance-0000002a</name>
Apr 12 12:57:17 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:57:17 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:57:17 user nova-compute[71321]:   <metadata>
Apr 12 12:57:17 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:57:17 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:57:17 user nova-compute[71321]:       <nova:name>tempest-AttachVolumeTestJSON-server-65757566</nova:name>
Apr 12 12:57:17 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:57:17</nova:creationTime>
Apr 12 12:57:17 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:57:17 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:57:17 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:57:17 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:57:17 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:57:17 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:57:17 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:57:17 user nova-compute[71321]:       <nova:owner>
Apr 12 12:57:17 user nova-compute[71321]:         <nova:user uuid="8a9c54033c7547c2bae91e6c1dba0976">tempest-AttachVolumeTestJSON-905742219-project-member</nova:user>
Apr 12 12:57:17 user nova-compute[71321]:         <nova:project uuid="a0e6aaaa9a634f349d371f7c6c15eca2">tempest-AttachVolumeTestJSON-905742219</nova:project>
Apr 12 12:57:17 user nova-compute[71321]:       </nova:owner>
Apr 12 12:57:17 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:57:17 user nova-compute[71321]:       <nova:ports>
Apr 12 12:57:17 user nova-compute[71321]:         <nova:port uuid="82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf">
Apr 12 12:57:17 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 12:57:17 user nova-compute[71321]:         </nova:port>
Apr 12 12:57:17 user nova-compute[71321]:       </nova:ports>
Apr 12 12:57:17 user nova-compute[71321]:     </nova:instance>
Apr 12 12:57:17 user nova-compute[71321]:   </metadata>
Apr 12 12:57:17 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:57:17 user nova-compute[71321]:     <system>
Apr 12 12:57:17 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:57:17 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:57:17 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:57:17 user nova-compute[71321]:       <entry name="serial">9ebf6f6b-3940-40fa-9a20-a28a957961e2</entry>
Apr 12 12:57:17 user nova-compute[71321]:       <entry name="uuid">9ebf6f6b-3940-40fa-9a20-a28a957961e2</entry>
Apr 12 12:57:17 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:57:17 user nova-compute[71321]:     </system>
Apr 12 12:57:17 user nova-compute[71321]:   </sysinfo>
Apr 12 12:57:17 user nova-compute[71321]:   <os>
Apr 12 12:57:17 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:57:17 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 12:57:17 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:57:17 user nova-compute[71321]:   </os>
Apr 12 12:57:17 user nova-compute[71321]:   <features>
Apr 12 12:57:17 user nova-compute[71321]:     <acpi/>
Apr 12 12:57:17 user nova-compute[71321]:     <apic/>
Apr 12 12:57:17 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:57:17 user nova-compute[71321]:   </features>
Apr 12 12:57:17 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:57:17 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:57:17 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:57:17 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:57:17 user nova-compute[71321]:   </clock>
Apr 12 12:57:17 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:57:17 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:57:17 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:57:17 user nova-compute[71321]:   </cpu>
Apr 12 12:57:17 user nova-compute[71321]:   <devices>
Apr 12 12:57:17 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:57:17 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:57:17 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/9ebf6f6b-3940-40fa-9a20-a28a957961e2/disk"/>
Apr 12 12:57:17 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:57:17 user nova-compute[71321]:     </disk>
Apr 12 12:57:17 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:57:17 user nova-compute[71321]:       <mac address="fa:16:3e:4d:b8:a2"/>
Apr 12 12:57:17 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:57:17 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:57:17 user nova-compute[71321]:       <target dev="tap82eff0a4-60"/>
Apr 12 12:57:17 user nova-compute[71321]:     </interface>
Apr 12 12:57:17 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:57:17 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/9ebf6f6b-3940-40fa-9a20-a28a957961e2/console.log" append="off"/>
Apr 12 12:57:17 user nova-compute[71321]:     </serial>
Apr 12 12:57:17 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:57:17 user nova-compute[71321]:     <video>
Apr 12 12:57:17 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:57:17 user nova-compute[71321]:     </video>
Apr 12 12:57:17 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:57:17 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:57:17 user nova-compute[71321]:     </rng>
Apr 12 12:57:17 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:57:17 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:57:17 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:57:17 user nova-compute[71321]:     </memballoon>
Apr 12 12:57:17 user nova-compute[71321]:   </devices>
Apr 12 12:57:17 user nova-compute[71321]: </domain>
Apr 12 12:57:17 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:57:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-65757566',display_name='tempest-AttachVolumeTestJSON-server-65757566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-65757566',id=42,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+VqciJ+AVvCe/N0xwWOn/nJY1e4lfokIJeJ1FKR2w8X6Y9f/4CVW/1X9EydJvxQYb4/9jutiZdSGF9cw4hZDSkkxaTg/Y/3AIuAySVrBR5vodpwIgm/ehG2VQ4V0w+AQ==',key_name='tempest-keypair-990566308',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0e6aaaa9a634f349d371f7c6c15eca2',ramdisk_id='',reservation_id='r-u9ahjxxj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-905742219',owner_user_name='tempest-AttachVolumeTestJSON-905742219-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:57:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a9c54033c7547c2bae91e6c1dba0976',uuid=9ebf6f6b-3940-40fa-9a20-a28a957961e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf", "address": "fa:16:3e:4d:b8:a2", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82eff0a4-60", "ovs_interfaceid": "82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Converting VIF {"id": "82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf", "address": "fa:16:3e:4d:b8:a2", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82eff0a4-60", "ovs_interfaceid": "82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:b8:a2,bridge_name='br-int',has_traffic_filtering=True,id=82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf,network=Network(e1afe3b3-a919-4800-9f1c-c8e602defd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82eff0a4-60') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG os_vif [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:b8:a2,bridge_name='br-int',has_traffic_filtering=True,id=82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf,network=Network(e1afe3b3-a919-4800-9f1c-c8e602defd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82eff0a4-60') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82eff0a4-60, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap82eff0a4-60, col_values=(('external_ids', {'iface-id': '82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:b8:a2', 'vm-uuid': '9ebf6f6b-3940-40fa-9a20-a28a957961e2'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:17 user nova-compute[71321]: INFO os_vif [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:b8:a2,bridge_name='br-int',has_traffic_filtering=True,id=82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf,network=Network(e1afe3b3-a919-4800-9f1c-c8e602defd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82eff0a4-60')
Apr 12 12:57:17 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] No VIF found with MAC fa:16:3e:4d:b8:a2, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG nova.network.neutron [req-34af886c-f258-4592-89cf-94aa29bf24c2 req-4f19a4ea-6dda-4252-b877-30f287b22797 service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Updated VIF entry in instance network info cache for port 82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG nova.network.neutron [req-34af886c-f258-4592-89cf-94aa29bf24c2 req-4f19a4ea-6dda-4252-b877-30f287b22797 service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Updating instance_info_cache with network_info: [{"id": "82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf", "address": "fa:16:3e:4d:b8:a2", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82eff0a4-60", "ovs_interfaceid": "82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:57:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-34af886c-f258-4592-89cf-94aa29bf24c2 req-4f19a4ea-6dda-4252-b877-30f287b22797 service nova] Releasing lock "refresh_cache-9ebf6f6b-3940-40fa-9a20-a28a957961e2" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:57:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:19 user nova-compute[71321]: DEBUG nova.compute.manager [req-78151827-c823-41e1-94cd-2b9328f77b6f req-a3f604c8-3a05-4e52-8c59-f61c8c422bf8 service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Received event network-vif-plugged-82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:57:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-78151827-c823-41e1-94cd-2b9328f77b6f req-a3f604c8-3a05-4e52-8c59-f61c8c422bf8 service nova] Acquiring lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:57:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-78151827-c823-41e1-94cd-2b9328f77b6f req-a3f604c8-3a05-4e52-8c59-f61c8c422bf8 service nova] Lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:57:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-78151827-c823-41e1-94cd-2b9328f77b6f req-a3f604c8-3a05-4e52-8c59-f61c8c422bf8 service nova] Lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:57:19 user nova-compute[71321]: DEBUG nova.compute.manager [req-78151827-c823-41e1-94cd-2b9328f77b6f req-a3f604c8-3a05-4e52-8c59-f61c8c422bf8 service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] No waiting events found dispatching network-vif-plugged-82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:57:19 user nova-compute[71321]: WARNING nova.compute.manager [req-78151827-c823-41e1-94cd-2b9328f77b6f req-a3f604c8-3a05-4e52-8c59-f61c8c422bf8 service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Received unexpected event network-vif-plugged-82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf for instance with vm_state building and task_state spawning.
Apr 12 12:57:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:20 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681304240.9564312, 9ebf6f6b-3940-40fa-9a20-a28a957961e2 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:57:20 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] VM Resumed (Lifecycle Event)
Apr 12 12:57:20 user nova-compute[71321]: DEBUG nova.compute.manager [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 12:57:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 12:57:20 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Instance spawned successfully.
Apr 12 12:57:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 12:57:20 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:57:20 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:57:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:57:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:57:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:57:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:57:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:57:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 12:57:21 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:57:21 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681304240.957781, 9ebf6f6b-3940-40fa-9a20-a28a957961e2 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:57:21 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] VM Started (Lifecycle Event)
Apr 12 12:57:21 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:57:21 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:57:21 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 12:57:21 user nova-compute[71321]: INFO nova.compute.manager [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Took 5.28 seconds to spawn the instance on the hypervisor.
Apr 12 12:57:21 user nova-compute[71321]: DEBUG nova.compute.manager [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:57:21 user nova-compute[71321]: INFO nova.compute.manager [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Took 5.88 seconds to build instance.
Apr 12 12:57:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.979s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:57:21 user nova-compute[71321]: DEBUG nova.compute.manager [req-11765187-e67d-4226-84c9-0633771e2509 req-0c28b04d-5779-4994-9d09-5d1cc598852a service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Received event network-vif-plugged-82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:57:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-11765187-e67d-4226-84c9-0633771e2509 req-0c28b04d-5779-4994-9d09-5d1cc598852a service nova] Acquiring lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:57:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-11765187-e67d-4226-84c9-0633771e2509 req-0c28b04d-5779-4994-9d09-5d1cc598852a service nova] Lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:57:21 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-11765187-e67d-4226-84c9-0633771e2509 req-0c28b04d-5779-4994-9d09-5d1cc598852a service nova] Lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:57:21 user nova-compute[71321]: DEBUG nova.compute.manager [req-11765187-e67d-4226-84c9-0633771e2509 req-0c28b04d-5779-4994-9d09-5d1cc598852a service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] No waiting events found dispatching network-vif-plugged-82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:57:21 user nova-compute[71321]: WARNING nova.compute.manager [req-11765187-e67d-4226-84c9-0633771e2509 req-0c28b04d-5779-4994-9d09-5d1cc598852a service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Received unexpected event network-vif-plugged-82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf for instance with vm_state active and task_state None.
Apr 12 12:57:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:27 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:57:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.004s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:57:32 user nova-compute[71321]: DEBUG nova.objects.instance [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lazy-loading 'flavor' on Instance uuid a73a4b87-a9a8-4b01-af1f-4b2a64554b54 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:57:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:57:32 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:57:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:57:32 user nova-compute[71321]: INFO nova.compute.manager [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Attaching volume 5d5655e9-ab41-4361-a57b-817e42037463 to /dev/vdb
Apr 12 12:57:32 user nova-compute[71321]: DEBUG os_brick.utils [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:57:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:57:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:57:32 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4028e43-4a56-4189-a16d-b80c6a709cc6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:57:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:57:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:57:32 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6c53fd-68ff-4de8-b2d6-851072c4db77]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:57:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:57:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:57:32 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ca1218-dd0b-48f8-9bf5-68fd0fe9eddb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:57:32 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[42611118-15f2-4c8b-8e03-dd824efc213b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:57:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:57:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:57:32 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:57:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:57:32 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:57:32 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:57:32 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba35f97-69ab-47d0-990d-6d6e650fea66]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:57:32 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:57:32 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:57:32 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:57:32 user nova-compute[71321]: DEBUG os_brick.utils [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:57:32 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Updating existing volume attachment record: 0680fa99-caa7-486e-af76-a6dbfa0ca7be {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:57:34 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:57:34 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:57:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:57:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:57:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:57:34 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:57:34 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ebf6f6b-3940-40fa-9a20-a28a957961e2/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:57:34 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ebf6f6b-3940-40fa-9a20-a28a957961e2/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:57:34 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ebf6f6b-3940-40fa-9a20-a28a957961e2/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:57:34 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ebf6f6b-3940-40fa-9a20-a28a957961e2/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:57:34 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:57:34 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:57:35 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:57:35 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:57:35 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:57:35 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88c7dd97-0390-4b2b-b803-7ab023366fd4/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:57:35 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88c7dd97-0390-4b2b-b803-7ab023366fd4/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:57:35 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88c7dd97-0390-4b2b-b803-7ab023366fd4/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:57:35 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88c7dd97-0390-4b2b-b803-7ab023366fd4/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:57:35 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:57:35 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:57:35 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:57:35 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:57:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:36 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:57:36 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:57:36 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8294MB free_disk=26.247753143310547GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:57:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:57:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:57:36 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:57:36 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:57:36 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 38198e86-bd23-4196-98a0-79455206305f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:57:36 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 88c7dd97-0390-4b2b-b803-7ab023366fd4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:57:36 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:57:36 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:57:36 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:57:36 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:57:36 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:57:36 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:57:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.303s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:57:36 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:57:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJoAIzpk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:57:36 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:57:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:57:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:57:36 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:57:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:57:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:57:36 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:57:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:57:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:57:36 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8493ecd8-c75e-4fca-851a-fed31efbe521]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:57:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:57:36 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:57:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:57:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:57:36 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc14d2ad-1ff1-4ecd-8d95-55d84dbdeb48]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:57:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463] added
Apr 12 12:57:36 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:57:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ba4331-a274-4995-9ffa-a1d45c582c6f]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3761c33c-9a8a-41ee-82bc-43d735150fdf]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FJoAIzpk {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FJoAIzpk" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccbeb16-a8c8-4920-bc9a-ce7da6c69ea8]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FJoAIzpk'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f47241-5fe5-4587-b74a-38a1d373ab80]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5d5c4c-ce74-400e-a6c8-af89333af46b]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 12:57:37 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 12:57:37 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d46233-c99a-4b42-8451-d39dcefcb279]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463, portal: 172.16.0.220,3260]
Apr 12 12:57:37 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463, portal: 172.16.0.220,3260] successful.
Apr 12 12:57:37 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5025fd-61b8-4fc3-8e7b-d378692c8bac]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0225bb-75a8-4286-8f32-9306a7fd1abb]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 12:57:37 user nova-compute[71321]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)
Apr 12 12:57:37 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 12:57:37 user nova-compute[71321]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)
Apr 12 12:57:37 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[923889c4-6645-48b7-9c51-0f5ec68ed25a]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJoAIzpk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:57:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:38 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:57:38 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23636633232663635', 'path': '/dev/sdc'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:57:38 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636633232663635', 'path': '/dev/sdc'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:57:38 user nova-compute[71321]: DEBUG nova.objects.instance [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lazy-loading 'flavor' on Instance uuid a73a4b87-a9a8-4b01-af1f-4b2a64554b54 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:57:38 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 12:57:38 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:57:38 user nova-compute[71321]:   <source dev="/dev/sdc"/>
Apr 12 12:57:38 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:57:38 user nova-compute[71321]:   <serial>5d5655e9-ab41-4361-a57b-817e42037463</serial>
Apr 12 12:57:38 user nova-compute[71321]: </disk>
Apr 12 12:57:38 user nova-compute[71321]:  {{(pid=71321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 12:57:38 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:57:38 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:57:38 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] No VIF found with MAC fa:16:3e:48:0a:10, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:57:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.253s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:57:39 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:57:39 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:57:39 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:57:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:41 user nova-compute[71321]: DEBUG nova.compute.manager [req-9c2488c9-f9d1-417b-b84b-ed65c4d62c97 req-6a401919-5247-4c21-ad33-1286aeb01ea7 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Received event network-changed-7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:57:41 user nova-compute[71321]: DEBUG nova.compute.manager [req-9c2488c9-f9d1-417b-b84b-ed65c4d62c97 req-6a401919-5247-4c21-ad33-1286aeb01ea7 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Refreshing instance network info cache due to event network-changed-7103abd2-88c5-437a-9661-64ca6379a130. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:57:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9c2488c9-f9d1-417b-b84b-ed65c4d62c97 req-6a401919-5247-4c21-ad33-1286aeb01ea7 service nova] Acquiring lock "refresh_cache-a73a4b87-a9a8-4b01-af1f-4b2a64554b54" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:57:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9c2488c9-f9d1-417b-b84b-ed65c4d62c97 req-6a401919-5247-4c21-ad33-1286aeb01ea7 service nova] Acquired lock "refresh_cache-a73a4b87-a9a8-4b01-af1f-4b2a64554b54" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:57:41 user nova-compute[71321]: DEBUG nova.network.neutron [req-9c2488c9-f9d1-417b-b84b-ed65c4d62c97 req-6a401919-5247-4c21-ad33-1286aeb01ea7 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Refreshing network info cache for port 7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:57:41 user nova-compute[71321]: DEBUG nova.network.neutron [req-9c2488c9-f9d1-417b-b84b-ed65c4d62c97 req-6a401919-5247-4c21-ad33-1286aeb01ea7 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Updated VIF entry in instance network info cache for port 7103abd2-88c5-437a-9661-64ca6379a130. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:57:41 user nova-compute[71321]: DEBUG nova.network.neutron [req-9c2488c9-f9d1-417b-b84b-ed65c4d62c97 req-6a401919-5247-4c21-ad33-1286aeb01ea7 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Updating instance_info_cache with network_info: [{"id": "7103abd2-88c5-437a-9661-64ca6379a130", "address": "fa:16:3e:48:0a:10", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7103abd2-88", "ovs_interfaceid": "7103abd2-88c5-437a-9661-64ca6379a130", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:57:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9c2488c9-f9d1-417b-b84b-ed65c4d62c97 req-6a401919-5247-4c21-ad33-1286aeb01ea7 service nova] Releasing lock "refresh_cache-a73a4b87-a9a8-4b01-af1f-4b2a64554b54" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:57:42 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:57:42 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:57:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-a73a4b87-a9a8-4b01-af1f-4b2a64554b54" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:57:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-a73a4b87-a9a8-4b01-af1f-4b2a64554b54" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:57:42 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 12:57:42 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:43 user nova-compute[71321]: DEBUG nova.compute.manager [req-9efbd915-554e-4054-a64a-76a67fb9400b req-6bdb9ae7-d402-45a9-927f-1092dfb56f75 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Received event network-changed-7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:57:43 user nova-compute[71321]: DEBUG nova.compute.manager [req-9efbd915-554e-4054-a64a-76a67fb9400b req-6bdb9ae7-d402-45a9-927f-1092dfb56f75 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Refreshing instance network info cache due to event network-changed-7103abd2-88c5-437a-9661-64ca6379a130. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:57:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9efbd915-554e-4054-a64a-76a67fb9400b req-6bdb9ae7-d402-45a9-927f-1092dfb56f75 service nova] Acquiring lock "refresh_cache-a73a4b87-a9a8-4b01-af1f-4b2a64554b54" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:57:43 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Updating instance_info_cache with network_info: [{"id": "7103abd2-88c5-437a-9661-64ca6379a130", "address": "fa:16:3e:48:0a:10", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7103abd2-88", "ovs_interfaceid": "7103abd2-88c5-437a-9661-64ca6379a130", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:57:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-a73a4b87-a9a8-4b01-af1f-4b2a64554b54" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:57:43 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 12:57:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9efbd915-554e-4054-a64a-76a67fb9400b req-6bdb9ae7-d402-45a9-927f-1092dfb56f75 service nova] Acquired lock "refresh_cache-a73a4b87-a9a8-4b01-af1f-4b2a64554b54" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:57:43 user nova-compute[71321]: DEBUG nova.network.neutron [req-9efbd915-554e-4054-a64a-76a67fb9400b req-6bdb9ae7-d402-45a9-927f-1092dfb56f75 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Refreshing network info cache for port 7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:57:43 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:57:43 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:57:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4fdba8be-c3e1-4e20-bdc5-27525dce8f78 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:57:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4fdba8be-c3e1-4e20-bdc5-27525dce8f78 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:57:43 user nova-compute[71321]: INFO nova.compute.manager [None req-4fdba8be-c3e1-4e20-bdc5-27525dce8f78 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Rebooting instance
Apr 12 12:57:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4fdba8be-c3e1-4e20-bdc5-27525dce8f78 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "refresh_cache-a73a4b87-a9a8-4b01-af1f-4b2a64554b54" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:57:43 user nova-compute[71321]: DEBUG nova.network.neutron [req-9efbd915-554e-4054-a64a-76a67fb9400b req-6bdb9ae7-d402-45a9-927f-1092dfb56f75 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Updated VIF entry in instance network info cache for port 7103abd2-88c5-437a-9661-64ca6379a130. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:57:43 user nova-compute[71321]: DEBUG nova.network.neutron [req-9efbd915-554e-4054-a64a-76a67fb9400b req-6bdb9ae7-d402-45a9-927f-1092dfb56f75 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Updating instance_info_cache with network_info: [{"id": "7103abd2-88c5-437a-9661-64ca6379a130", "address": "fa:16:3e:48:0a:10", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7103abd2-88", "ovs_interfaceid": "7103abd2-88c5-437a-9661-64ca6379a130", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:57:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9efbd915-554e-4054-a64a-76a67fb9400b req-6bdb9ae7-d402-45a9-927f-1092dfb56f75 service nova] Releasing lock "refresh_cache-a73a4b87-a9a8-4b01-af1f-4b2a64554b54" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:57:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4fdba8be-c3e1-4e20-bdc5-27525dce8f78 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquired lock "refresh_cache-a73a4b87-a9a8-4b01-af1f-4b2a64554b54" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:57:43 user nova-compute[71321]: DEBUG nova.network.neutron [None req-4fdba8be-c3e1-4e20-bdc5-27525dce8f78 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:57:44 user nova-compute[71321]: DEBUG nova.network.neutron [None req-4fdba8be-c3e1-4e20-bdc5-27525dce8f78 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Updating instance_info_cache with network_info: [{"id": "7103abd2-88c5-437a-9661-64ca6379a130", "address": "fa:16:3e:48:0a:10", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7103abd2-88", "ovs_interfaceid": "7103abd2-88c5-437a-9661-64ca6379a130", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:57:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4fdba8be-c3e1-4e20-bdc5-27525dce8f78 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Releasing lock "refresh_cache-a73a4b87-a9a8-4b01-af1f-4b2a64554b54" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:57:44 user nova-compute[71321]: DEBUG nova.compute.manager [None req-4fdba8be-c3e1-4e20-bdc5-27525dce8f78 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:57:45 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:57:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:46 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:57:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:46 user nova-compute[71321]: DEBUG nova.compute.manager [req-a035ccad-affa-4ff1-8d60-b7b0383ae2cf req-010ea5e3-917d-4008-8780-e1296507dc9f service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Received event network-vif-unplugged-7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:57:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a035ccad-affa-4ff1-8d60-b7b0383ae2cf req-010ea5e3-917d-4008-8780-e1296507dc9f service nova] Acquiring lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:57:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a035ccad-affa-4ff1-8d60-b7b0383ae2cf req-010ea5e3-917d-4008-8780-e1296507dc9f service nova] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:57:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a035ccad-affa-4ff1-8d60-b7b0383ae2cf req-010ea5e3-917d-4008-8780-e1296507dc9f service nova] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:57:46 user nova-compute[71321]: DEBUG nova.compute.manager [req-a035ccad-affa-4ff1-8d60-b7b0383ae2cf req-010ea5e3-917d-4008-8780-e1296507dc9f service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] No waiting events found dispatching network-vif-unplugged-7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:57:46 user nova-compute[71321]: WARNING nova.compute.manager [req-a035ccad-affa-4ff1-8d60-b7b0383ae2cf req-010ea5e3-917d-4008-8780-e1296507dc9f service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Received unexpected event network-vif-unplugged-7103abd2-88c5-437a-9661-64ca6379a130 for instance with vm_state active and task_state reboot_started.
Apr 12 12:57:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:47 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-4fdba8be-c3e1-4e20-bdc5-27525dce8f78 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Instance shutdown successfully.
Apr 12 12:57:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:48 user nova-compute[71321]: DEBUG nova.compute.manager [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Received event network-vif-plugged-7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:57:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] Acquiring lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:57:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:57:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:57:48 user nova-compute[71321]: DEBUG nova.compute.manager [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] No waiting events found dispatching network-vif-plugged-7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:57:48 user nova-compute[71321]: WARNING nova.compute.manager [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Received unexpected event network-vif-plugged-7103abd2-88c5-437a-9661-64ca6379a130 for instance with vm_state active and task_state reboot_started.
Apr 12 12:57:48 user nova-compute[71321]: DEBUG nova.compute.manager [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Received event network-vif-plugged-7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:57:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] Acquiring lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:57:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:57:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:57:48 user nova-compute[71321]: DEBUG nova.compute.manager [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] No waiting events found dispatching network-vif-plugged-7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:57:48 user nova-compute[71321]: WARNING nova.compute.manager [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Received unexpected event network-vif-plugged-7103abd2-88c5-437a-9661-64ca6379a130 for instance with vm_state active and task_state reboot_started.
Apr 12 12:57:48 user nova-compute[71321]: DEBUG nova.compute.manager [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Received event network-vif-plugged-7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:57:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] Acquiring lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:57:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:57:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:57:48 user nova-compute[71321]: DEBUG nova.compute.manager [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] No waiting events found dispatching network-vif-plugged-7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:57:48 user nova-compute[71321]: WARNING nova.compute.manager [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Received unexpected event network-vif-plugged-7103abd2-88c5-437a-9661-64ca6379a130 for instance with vm_state active and task_state reboot_started.
Apr 12 12:57:48 user nova-compute[71321]: DEBUG nova.compute.manager [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Received event network-vif-unplugged-7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:57:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] Acquiring lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:57:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:57:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:57:48 user nova-compute[71321]: DEBUG nova.compute.manager [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] No waiting events found dispatching network-vif-unplugged-7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:57:48 user nova-compute[71321]: WARNING nova.compute.manager [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Received unexpected event network-vif-unplugged-7103abd2-88c5-437a-9661-64ca6379a130 for instance with vm_state active and task_state reboot_started.
Apr 12 12:57:48 user nova-compute[71321]: DEBUG nova.compute.manager [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Received event network-vif-plugged-7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:57:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] Acquiring lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:57:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:57:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:57:48 user nova-compute[71321]: DEBUG nova.compute.manager [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] No waiting events found dispatching network-vif-plugged-7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:57:48 user nova-compute[71321]: WARNING nova.compute.manager [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Received unexpected event network-vif-plugged-7103abd2-88c5-437a-9661-64ca6379a130 for instance with vm_state active and task_state reboot_started.
Apr 12 12:57:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:50 user nova-compute[71321]: DEBUG nova.compute.manager [req-72ea0147-b185-4967-8671-f7e420bdc23b req-5fb1be2f-ed9e-4ff7-849c-96eaf943d085 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Received event network-vif-plugged-7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:57:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-72ea0147-b185-4967-8671-f7e420bdc23b req-5fb1be2f-ed9e-4ff7-849c-96eaf943d085 service nova] Acquiring lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:57:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-72ea0147-b185-4967-8671-f7e420bdc23b req-5fb1be2f-ed9e-4ff7-849c-96eaf943d085 service nova] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:57:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-72ea0147-b185-4967-8671-f7e420bdc23b req-5fb1be2f-ed9e-4ff7-849c-96eaf943d085 service nova] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:57:50 user nova-compute[71321]: DEBUG nova.compute.manager [req-72ea0147-b185-4967-8671-f7e420bdc23b req-5fb1be2f-ed9e-4ff7-849c-96eaf943d085 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] No waiting events found dispatching network-vif-plugged-7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:57:50 user nova-compute[71321]: WARNING nova.compute.manager [req-72ea0147-b185-4967-8671-f7e420bdc23b req-5fb1be2f-ed9e-4ff7-849c-96eaf943d085 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Received unexpected event network-vif-plugged-7103abd2-88c5-437a-9661-64ca6379a130 for instance with vm_state active and task_state reboot_started.
Apr 12 12:57:50 user nova-compute[71321]: DEBUG nova.compute.manager [req-72ea0147-b185-4967-8671-f7e420bdc23b req-5fb1be2f-ed9e-4ff7-849c-96eaf943d085 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Received event network-vif-plugged-7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:57:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-72ea0147-b185-4967-8671-f7e420bdc23b req-5fb1be2f-ed9e-4ff7-849c-96eaf943d085 service nova] Acquiring lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:57:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-72ea0147-b185-4967-8671-f7e420bdc23b req-5fb1be2f-ed9e-4ff7-849c-96eaf943d085 service nova] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:57:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-72ea0147-b185-4967-8671-f7e420bdc23b req-5fb1be2f-ed9e-4ff7-849c-96eaf943d085 service nova] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:57:50 user nova-compute[71321]: DEBUG nova.compute.manager [req-72ea0147-b185-4967-8671-f7e420bdc23b req-5fb1be2f-ed9e-4ff7-849c-96eaf943d085 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] No waiting events found dispatching network-vif-plugged-7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:57:50 user nova-compute[71321]: WARNING nova.compute.manager [req-72ea0147-b185-4967-8671-f7e420bdc23b req-5fb1be2f-ed9e-4ff7-849c-96eaf943d085 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Received unexpected event network-vif-plugged-7103abd2-88c5-437a-9661-64ca6379a130 for instance with vm_state active and task_state reboot_started.
Apr 12 12:57:50 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Removed pending event for a73a4b87-a9a8-4b01-af1f-4b2a64554b54 due to event {{(pid=71321) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 12:57:50 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681304270.9437597, a73a4b87-a9a8-4b01-af1f-4b2a64554b54 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:57:50 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] VM Resumed (Lifecycle Event)
Apr 12 12:57:50 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Instance running successfully.
Apr 12 12:57:50 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-4fdba8be-c3e1-4e20-bdc5-27525dce8f78 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Instance soft rebooted successfully.
Apr 12 12:57:50 user nova-compute[71321]: DEBUG nova.compute.manager [None req-4fdba8be-c3e1-4e20-bdc5-27525dce8f78 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:57:50 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:57:50 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:57:50 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] During sync_power_state the instance has a pending task (reboot_started). Skip.
Apr 12 12:57:50 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681304270.943917, a73a4b87-a9a8-4b01-af1f-4b2a64554b54 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:57:50 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] VM Started (Lifecycle Event)
Apr 12 12:57:51 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:57:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4fdba8be-c3e1-4e20-bdc5-27525dce8f78 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.426s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:57:51 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:57:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:57:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:58:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:58:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:58:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:58:07 user nova-compute[71321]: INFO nova.compute.manager [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Rescuing
Apr 12 12:58:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "refresh_cache-38198e86-bd23-4196-98a0-79455206305f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:58:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquired lock "refresh_cache-38198e86-bd23-4196-98a0-79455206305f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:58:07 user nova-compute[71321]: DEBUG nova.network.neutron [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:58:08 user nova-compute[71321]: DEBUG nova.network.neutron [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Updating instance_info_cache with network_info: [{"id": "5621687b-5d0b-47f7-b11c-a24c403a590a", "address": "fa:16:3e:0e:91:7d", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621687b-5d", "ovs_interfaceid": "5621687b-5d0b-47f7-b11c-a24c403a590a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:58:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Releasing lock "refresh_cache-38198e86-bd23-4196-98a0-79455206305f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:58:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:58:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:58:08 user nova-compute[71321]: DEBUG nova.compute.manager [req-6c3b4aa6-e381-444f-b930-bf9e669966d3 req-750ad10b-73d0-44c2-bf90-0e8a0b1f2d4c service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] Received event network-vif-unplugged-5621687b-5d0b-47f7-b11c-a24c403a590a {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:58:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-6c3b4aa6-e381-444f-b930-bf9e669966d3 req-750ad10b-73d0-44c2-bf90-0e8a0b1f2d4c service nova] Acquiring lock "38198e86-bd23-4196-98a0-79455206305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:58:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-6c3b4aa6-e381-444f-b930-bf9e669966d3 req-750ad10b-73d0-44c2-bf90-0e8a0b1f2d4c service nova] Lock "38198e86-bd23-4196-98a0-79455206305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:58:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-6c3b4aa6-e381-444f-b930-bf9e669966d3 req-750ad10b-73d0-44c2-bf90-0e8a0b1f2d4c service nova] Lock "38198e86-bd23-4196-98a0-79455206305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:58:08 user nova-compute[71321]: DEBUG nova.compute.manager [req-6c3b4aa6-e381-444f-b930-bf9e669966d3 req-750ad10b-73d0-44c2-bf90-0e8a0b1f2d4c service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] No waiting events found dispatching network-vif-unplugged-5621687b-5d0b-47f7-b11c-a24c403a590a {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:58:08 user nova-compute[71321]: WARNING nova.compute.manager [req-6c3b4aa6-e381-444f-b930-bf9e669966d3 req-750ad10b-73d0-44c2-bf90-0e8a0b1f2d4c service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] Received unexpected event network-vif-unplugged-5621687b-5d0b-47f7-b11c-a24c403a590a for instance with vm_state active and task_state rescuing.
Apr 12 12:58:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:58:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:58:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:58:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:58:09 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 38198e86-bd23-4196-98a0-79455206305f] Instance destroyed successfully.
Apr 12 12:58:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:58:09 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Attempting a stable device rescue
Apr 12 12:58:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71321) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 12:58:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Instance directory exists: not creating {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 12:58:09 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Creating image(s)
Apr 12 12:58:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "/opt/stack/data/nova/instances/38198e86-bd23-4196-98a0-79455206305f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:58:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "/opt/stack/data/nova/instances/38198e86-bd23-4196-98a0-79455206305f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:58:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "/opt/stack/data/nova/instances/38198e86-bd23-4196-98a0-79455206305f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:58:09 user nova-compute[71321]: DEBUG nova.objects.instance [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lazy-loading 'trusted_certs' on Instance uuid 38198e86-bd23-4196-98a0-79455206305f {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:58:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "a64a687b87678709f7c094c62955f5494b293537" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:58:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "a64a687b87678709f7c094c62955f5494b293537" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:58:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a64a687b87678709f7c094c62955f5494b293537.part --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a64a687b87678709f7c094c62955f5494b293537.part --force-share --output=json" returned: 0 in 0.150s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG nova.virt.images [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 88de56de-eb65-4f80-95d7-853e3d487914 was qcow2, converting to raw {{(pid=71321) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG nova.privsep.utils [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a64a687b87678709f7c094c62955f5494b293537.part /opt/stack/data/nova/instances/_base/a64a687b87678709f7c094c62955f5494b293537.converted {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a64a687b87678709f7c094c62955f5494b293537.part /opt/stack/data/nova/instances/_base/a64a687b87678709f7c094c62955f5494b293537.converted" returned: 0 in 0.224s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a64a687b87678709f7c094c62955f5494b293537.converted --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a64a687b87678709f7c094c62955f5494b293537.converted --force-share --output=json" returned: 0 in 0.137s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "a64a687b87678709f7c094c62955f5494b293537" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.219s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "a64a687b87678709f7c094c62955f5494b293537" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "a64a687b87678709f7c094c62955f5494b293537" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a64a687b87678709f7c094c62955f5494b293537 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a64a687b87678709f7c094c62955f5494b293537 --force-share --output=json" returned: 0 in 0.135s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a64a687b87678709f7c094c62955f5494b293537,backing_fmt=raw /opt/stack/data/nova/instances/38198e86-bd23-4196-98a0-79455206305f/disk.rescue {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a64a687b87678709f7c094c62955f5494b293537,backing_fmt=raw /opt/stack/data/nova/instances/38198e86-bd23-4196-98a0-79455206305f/disk.rescue" returned: 0 in 0.051s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "a64a687b87678709f7c094c62955f5494b293537" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG nova.objects.instance [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lazy-loading 'migration_context' on Instance uuid 38198e86-bd23-4196-98a0-79455206305f {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Start _get_guest_xml network_info=[{"id": "5621687b-5d0b-47f7-b11c-a24c403a590a", "address": "fa:16:3e:0e:91:7d", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "vif_mac": "fa:16:3e:0e:91:7d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621687b-5d", "ovs_interfaceid": "5621687b-5d0b-47f7-b11c-a24c403a590a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '88de56de-eb65-4f80-95d7-853e3d487914', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b66eb1f3-af61-4801-ba56-46da5263151f', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VtOdZwTM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '38198e86-bd23-4196-98a0-79455206305f', 'attached_at': '', 'detached_at': '', 'volume_id': '667b3302-208b-42d6-8f06-0baa6b9482b2', 'serial': '667b3302-208b-42d6-8f06-0baa6b9482b2'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG nova.objects.instance [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lazy-loading 'resources' on Instance uuid 38198e86-bd23-4196-98a0-79455206305f {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG nova.objects.instance [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lazy-loading 'numa_topology' on Instance uuid 38198e86-bd23-4196-98a0-79455206305f {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:58:10 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:58:10 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:58:10 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG nova.objects.instance [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lazy-loading 'vcpu_model' on Instance uuid 38198e86-bd23-4196-98a0-79455206305f {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG nova.compute.manager [req-533d124d-092b-44fa-a5d5-77ea0e814f27 req-81d7115c-c3d4-44cf-87ed-4b571091d3c0 service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] Received event network-vif-plugged-5621687b-5d0b-47f7-b11c-a24c403a590a {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-533d124d-092b-44fa-a5d5-77ea0e814f27 req-81d7115c-c3d4-44cf-87ed-4b571091d3c0 service nova] Acquiring lock "38198e86-bd23-4196-98a0-79455206305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-533d124d-092b-44fa-a5d5-77ea0e814f27 req-81d7115c-c3d4-44cf-87ed-4b571091d3c0 service nova] Lock "38198e86-bd23-4196-98a0-79455206305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-533d124d-092b-44fa-a5d5-77ea0e814f27 req-81d7115c-c3d4-44cf-87ed-4b571091d3c0 service nova] Lock "38198e86-bd23-4196-98a0-79455206305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG nova.compute.manager [req-533d124d-092b-44fa-a5d5-77ea0e814f27 req-81d7115c-c3d4-44cf-87ed-4b571091d3c0 service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] No waiting events found dispatching network-vif-plugged-5621687b-5d0b-47f7-b11c-a24c403a590a {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:58:10 user nova-compute[71321]: WARNING nova.compute.manager [req-533d124d-092b-44fa-a5d5-77ea0e814f27 req-81d7115c-c3d4-44cf-87ed-4b571091d3c0 service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] Received unexpected event network-vif-plugged-5621687b-5d0b-47f7-b11c-a24c403a590a for instance with vm_state active and task_state rescuing.
Apr 12 12:58:10 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VtOdZwTM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:58:10 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:58:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:58:10 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:58:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:58:10 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[652f161f-5c1a-4330-9c35-5e02b4ebbc20]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = VtOdZwTM\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 12 12:58:10 user nova-compute[71321]: node.name = iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2
Apr 12 12:58:10 user nova-compute[71321]: node.tpgt = -1
Apr 12 12:58:10 user nova-compute[71321]: node.startup = automatic
Apr 12 12:58:10 user nova-compute[71321]: node.leading_login = No
Apr 12 12:58:10 user nova-compute[71321]: iface.iscsi_ifacename = default
Apr 12 12:58:10 user nova-compute[71321]: iface.net_ifacename = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.ipaddress = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.prefix_len = 0
Apr 12 12:58:10 user nova-compute[71321]: iface.hwaddress = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.transport_name = tcp
Apr 12 12:58:10 user nova-compute[71321]: iface.initiatorname = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.state = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.vlan_id = 0
Apr 12 12:58:10 user nova-compute[71321]: iface.vlan_priority = 0
Apr 12 12:58:10 user nova-compute[71321]: iface.vlan_state = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.iface_num = 0
Apr 12 12:58:10 user nova-compute[71321]: iface.mtu = 0
Apr 12 12:58:10 user nova-compute[71321]: iface.port = 0
Apr 12 12:58:10 user nova-compute[71321]: iface.bootproto = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.subnet_mask = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.gateway = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.dhcp_alt_client_id_state = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.dhcp_alt_client_id = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.dhcp_dns = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.dhcp_learn_iqn = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.dhcp_req_vendor_id_state = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.dhcp_vendor_id_state = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.dhcp_vendor_id = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.dhcp_slp_da = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.fragmentation = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.gratuitous_arp = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.incoming_forwarding = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.tos_state = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.tos = 0
Apr 12 12:58:10 user nova-compute[71321]: iface.ttl = 0
Apr 12 12:58:10 user nova-compute[71321]: iface.delayed_ack = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.tcp_nagle = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.tcp_wsf_state = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.tcp_wsf = 0
Apr 12 12:58:10 user nova-compute[71321]: iface.tcp_timer_scale = 0
Apr 12 12:58:10 user nova-compute[71321]: iface.tcp_timestamp = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.redirect = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.def_task_mgmt_timeout = 0
Apr 12 12:58:10 user nova-compute[71321]: iface.header_digest = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.data_digest = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.immediate_data = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.initial_r2t = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.data_seq_inorder = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.data_pdu_inorder = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.erl = 0
Apr 12 12:58:10 user nova-compute[71321]: iface.max_receive_data_len = 0
Apr 12 12:58:10 user nova-compute[71321]: iface.first_burst_len = 0
Apr 12 12:58:10 user nova-compute[71321]: iface.max_outstanding_r2t = 0
Apr 12 12:58:10 user nova-compute[71321]: iface.max_burst_len = 0
Apr 12 12:58:10 user nova-compute[71321]: iface.chap_auth = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.bidi_chap = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.strict_login_compliance = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.discovery_auth = <empty>
Apr 12 12:58:10 user nova-compute[71321]: iface.discovery_logout = <empty>
Apr 12 12:58:10 user nova-compute[71321]: node.discovery_address = <empty>
Apr 12 12:58:10 user nova-compute[71321]: node.discovery_port = 0
Apr 12 12:58:10 user nova-compute[71321]: node.discovery_type = static
Apr 12 12:58:10 user nova-compute[71321]: node.session.initial_cmdsn = 0
Apr 12 12:58:10 user nova-compute[71321]: node.session.initial_login_retry_max = 8
Apr 12 12:58:10 user nova-compute[71321]: node.session.xmit_thread_priority = -20
Apr 12 12:58:10 user nova-compute[71321]: node.session.cmds_max = 128
Apr 12 12:58:10 user nova-compute[71321]: node.session.queue_depth = 32
Apr 12 12:58:10 user nova-compute[71321]: node.session.nr_sessions = 1
Apr 12 12:58:10 user nova-compute[71321]: node.session.auth.authmethod = CHAP
Apr 12 12:58:10 user nova-compute[71321]: node.session.auth.username = VtOdZwTM
Apr 12 12:58:10 user nova-compute[71321]: node.session.auth.password = ***
Apr 12 12:58:10 user nova-compute[71321]: node.session.auth.username_in = <empty>
Apr 12 12:58:10 user nova-compute[71321]: node.session.auth.password_in = <empty>
Apr 12 12:58:10 user nova-compute[71321]: node.session.auth.chap_algs = MD5
Apr 12 12:58:10 user nova-compute[71321]: node.session.timeo.replacement_timeout = 120
Apr 12 12:58:10 user nova-compute[71321]: node.session.err_timeo.abort_timeout = 15
Apr 12 12:58:10 user nova-compute[71321]: node.session.err_timeo.lu_reset_timeout = 30
Apr 12 12:58:10 user nova-compute[71321]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 12 12:58:10 user nova-compute[71321]: node.session.err_timeo.host_reset_timeout = 60
Apr 12 12:58:10 user nova-compute[71321]: node.session.iscsi.FastAbort = Yes
Apr 12 12:58:10 user nova-compute[71321]: node.session.iscsi.InitialR2T = No
Apr 12 12:58:10 user nova-compute[71321]: node.session.iscsi.ImmediateData = Yes
Apr 12 12:58:10 user nova-compute[71321]: node.session.iscsi.FirstBurstLength = 262144
Apr 12 12:58:10 user nova-compute[71321]: node.session.iscsi.MaxBurstLength = 16776192
Apr 12 12:58:10 user nova-compute[71321]: node.session.iscsi.DefaultTime2Retain = 0
Apr 12 12:58:10 user nova-compute[71321]: node.session.iscsi.DefaultTime2Wait = 2
Apr 12 12:58:10 user nova-compute[71321]: node.session.iscsi.MaxConnections = 1
Apr 12 12:58:10 user nova-compute[71321]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 12 12:58:10 user nova-compute[71321]: node.session.iscsi.ERL = 0
Apr 12 12:58:10 user nova-compute[71321]: node.session.scan = manual
Apr 12 12:58:10 user nova-compute[71321]: node.session.reopen_max = 0
Apr 12 12:58:10 user nova-compute[71321]: node.conn[0].address = 172.16.0.220
Apr 12 12:58:10 user nova-compute[71321]: node.conn[0].port = 3260
Apr 12 12:58:10 user nova-compute[71321]: node.conn[0].startup = manual
Apr 12 12:58:10 user nova-compute[71321]: node.conn[0].tcp.window_size = 524288
Apr 12 12:58:10 user nova-compute[71321]: node.conn[0].tcp.type_of_service = 0
Apr 12 12:58:10 user nova-compute[71321]: node.conn[0].timeo.logout_timeout = 15
Apr 12 12:58:10 user nova-compute[71321]: node.conn[0].timeo.login_timeout = 15
Apr 12 12:58:10 user nova-compute[71321]: node.conn[0].timeo.auth_timeout = 45
Apr 12 12:58:10 user nova-compute[71321]: node.conn[0].timeo.noop_out_interval = 5
Apr 12 12:58:10 user nova-compute[71321]: node.conn[0].timeo.noop_out_timeout = 5
Apr 12 12:58:10 user nova-compute[71321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 12 12:58:10 user nova-compute[71321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 12 12:58:10 user nova-compute[71321]: node.conn[0].iscsi.HeaderDigest = None
Apr 12 12:58:10 user nova-compute[71321]: node.conn[0].iscsi.DataDigest = None
Apr 12 12:58:10 user nova-compute[71321]: node.conn[0].iscsi.IFMarker = No
Apr 12 12:58:10 user nova-compute[71321]: node.conn[0].iscsi.OFMarker = No
Apr 12 12:58:10 user nova-compute[71321]: # END RECORD
Apr 12 12:58:10 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7716ce98-2738-4885-b53f-71d52c2dd7ff]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[923e4b4d-86df-4430-ba51-cbe59616dd60]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VtOdZwTM {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VtOdZwTM" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac9b72b-583c-400c-9f86-d85c47b9042b]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VtOdZwTM'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dd696a-055f-4edc-a713-45e1bc39d3dc]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f13b5c-fe84-447d-80fa-1b3111e3c6d5]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 12:58:10 user nova-compute[71321]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)
Apr 12 12:58:10 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 12:58:10 user nova-compute[71321]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)
Apr 12 12:58:10 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.149s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] HCTL ('33', '0', '0', 0) found on session 47 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef99047-fb27-4305-9f22-90b8466cb18c]: (4, ('0 0 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Searching for a device in session 47 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:58:10 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VtOdZwTM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:58:11 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.172s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:58:11 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] <== connect_volume: return (174ms) {'type': 'block', 'scsi_wwn': '23166633766306438', 'path': '/dev/sdb'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:58:11 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166633766306438', 'path': '/dev/sdb'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:58:11 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:56:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1998019959',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1998019959',id=40,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:56:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f20ad21427a04683b9b102d2ff0290a5',ramdisk_id='',reservation_id='r-dgt4i0o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-636247513',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T12:56:34Z,user_data=None,user_id='435e0d6fd2b3437f837e82730b4d955f',uuid=38198e86-bd23-4196-98a0-79455206305f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5621687b-5d0b-47f7-b11c-a24c403a590a", "address": "fa:16:3e:0e:91:7d", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "vif_mac": "fa:16:3e:0e:91:7d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621687b-5d", "ovs_interfaceid": "5621687b-5d0b-47f7-b11c-a24c403a590a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 12:58:11 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Converting VIF {"id": "5621687b-5d0b-47f7-b11c-a24c403a590a", "address": "fa:16:3e:0e:91:7d", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "vif_mac": "fa:16:3e:0e:91:7d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621687b-5d", "ovs_interfaceid": "5621687b-5d0b-47f7-b11c-a24c403a590a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:58:11 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:91:7d,bridge_name='br-int',has_traffic_filtering=True,id=5621687b-5d0b-47f7-b11c-a24c403a590a,network=Network(bb52f82e-56ca-41f7-b171-a3cacb549ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5621687b-5d') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:58:11 user nova-compute[71321]: DEBUG nova.objects.instance [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lazy-loading 'pci_devices' on Instance uuid 38198e86-bd23-4196-98a0-79455206305f {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:58:11 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] End _get_guest_xml xml=<domain type="kvm">
Apr 12 12:58:11 user nova-compute[71321]:   <uuid>38198e86-bd23-4196-98a0-79455206305f</uuid>
Apr 12 12:58:11 user nova-compute[71321]:   <name>instance-00000028</name>
Apr 12 12:58:11 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 12:58:11 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 12:58:11 user nova-compute[71321]:   <metadata>
Apr 12 12:58:11 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 12:58:11 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 12:58:11 user nova-compute[71321]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1998019959</nova:name>
Apr 12 12:58:11 user nova-compute[71321]:       <nova:creationTime>2023-04-12 12:58:10</nova:creationTime>
Apr 12 12:58:11 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 12:58:11 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 12:58:11 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 12:58:11 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 12:58:11 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 12:58:11 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 12:58:11 user nova-compute[71321]:       </nova:flavor>
Apr 12 12:58:11 user nova-compute[71321]:       <nova:owner>
Apr 12 12:58:11 user nova-compute[71321]:         <nova:user uuid="435e0d6fd2b3437f837e82730b4d955f">tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member</nova:user>
Apr 12 12:58:11 user nova-compute[71321]:         <nova:project uuid="f20ad21427a04683b9b102d2ff0290a5">tempest-ServerBootFromVolumeStableRescueTest-636247513</nova:project>
Apr 12 12:58:11 user nova-compute[71321]:       </nova:owner>
Apr 12 12:58:11 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 12:58:11 user nova-compute[71321]:       <nova:ports>
Apr 12 12:58:11 user nova-compute[71321]:         <nova:port uuid="5621687b-5d0b-47f7-b11c-a24c403a590a">
Apr 12 12:58:11 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 12:58:11 user nova-compute[71321]:         </nova:port>
Apr 12 12:58:11 user nova-compute[71321]:       </nova:ports>
Apr 12 12:58:11 user nova-compute[71321]:     </nova:instance>
Apr 12 12:58:11 user nova-compute[71321]:   </metadata>
Apr 12 12:58:11 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 12:58:11 user nova-compute[71321]:     <system>
Apr 12 12:58:11 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 12:58:11 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 12:58:11 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 12:58:11 user nova-compute[71321]:       <entry name="serial">38198e86-bd23-4196-98a0-79455206305f</entry>
Apr 12 12:58:11 user nova-compute[71321]:       <entry name="uuid">38198e86-bd23-4196-98a0-79455206305f</entry>
Apr 12 12:58:11 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 12:58:11 user nova-compute[71321]:     </system>
Apr 12 12:58:11 user nova-compute[71321]:   </sysinfo>
Apr 12 12:58:11 user nova-compute[71321]:   <os>
Apr 12 12:58:11 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 12:58:11 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 12:58:11 user nova-compute[71321]:   </os>
Apr 12 12:58:11 user nova-compute[71321]:   <features>
Apr 12 12:58:11 user nova-compute[71321]:     <acpi/>
Apr 12 12:58:11 user nova-compute[71321]:     <apic/>
Apr 12 12:58:11 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 12:58:11 user nova-compute[71321]:   </features>
Apr 12 12:58:11 user nova-compute[71321]:   <clock offset="utc">
Apr 12 12:58:11 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 12:58:11 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 12:58:11 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 12:58:11 user nova-compute[71321]:   </clock>
Apr 12 12:58:11 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 12:58:11 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 12:58:11 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 12:58:11 user nova-compute[71321]:   </cpu>
Apr 12 12:58:11 user nova-compute[71321]:   <devices>
Apr 12 12:58:11 user nova-compute[71321]:     <disk type="block" device="disk">
Apr 12 12:58:11 user nova-compute[71321]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:58:11 user nova-compute[71321]:       <source dev="/dev/sdb"/>
Apr 12 12:58:11 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 12:58:11 user nova-compute[71321]:       <serial>667b3302-208b-42d6-8f06-0baa6b9482b2</serial>
Apr 12 12:58:11 user nova-compute[71321]:     </disk>
Apr 12 12:58:11 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 12:58:11 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 12:58:11 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/38198e86-bd23-4196-98a0-79455206305f/disk.rescue"/>
Apr 12 12:58:11 user nova-compute[71321]:       <target dev="vdb" bus="virtio"/>
Apr 12 12:58:11 user nova-compute[71321]:       <boot order="1"/>
Apr 12 12:58:11 user nova-compute[71321]:     </disk>
Apr 12 12:58:11 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 12:58:11 user nova-compute[71321]:       <mac address="fa:16:3e:0e:91:7d"/>
Apr 12 12:58:11 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:58:11 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 12:58:11 user nova-compute[71321]:       <target dev="tap5621687b-5d"/>
Apr 12 12:58:11 user nova-compute[71321]:     </interface>
Apr 12 12:58:11 user nova-compute[71321]:     <serial type="pty">
Apr 12 12:58:11 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/38198e86-bd23-4196-98a0-79455206305f/console.log" append="off"/>
Apr 12 12:58:11 user nova-compute[71321]:     </serial>
Apr 12 12:58:11 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 12:58:11 user nova-compute[71321]:     <video>
Apr 12 12:58:11 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 12:58:11 user nova-compute[71321]:     </video>
Apr 12 12:58:11 user nova-compute[71321]:     <rng model="virtio">
Apr 12 12:58:11 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 12:58:11 user nova-compute[71321]:     </rng>
Apr 12 12:58:11 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 12:58:11 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 12:58:11 user nova-compute[71321]:       <stats period="10"/>
Apr 12 12:58:11 user nova-compute[71321]:     </memballoon>
Apr 12 12:58:11 user nova-compute[71321]:   </devices>
Apr 12 12:58:11 user nova-compute[71321]: </domain>
Apr 12 12:58:11 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 12:58:11 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 38198e86-bd23-4196-98a0-79455206305f] Instance destroyed successfully.
Apr 12 12:58:11 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:58:11 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:58:11 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] No VIF found with MAC fa:16:3e:0e:91:7d, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:58:12 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:58:12 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:58:12 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:58:12 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:58:12 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:58:12 user nova-compute[71321]: DEBUG nova.compute.manager [req-c6c5c653-0ec3-4459-823b-371a35f203fc req-d623b5d4-1342-487f-a207-31361382d969 service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] Received event network-vif-plugged-5621687b-5d0b-47f7-b11c-a24c403a590a {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:58:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c6c5c653-0ec3-4459-823b-371a35f203fc req-d623b5d4-1342-487f-a207-31361382d969 service nova] Acquiring lock "38198e86-bd23-4196-98a0-79455206305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:58:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c6c5c653-0ec3-4459-823b-371a35f203fc req-d623b5d4-1342-487f-a207-31361382d969 service nova] Lock "38198e86-bd23-4196-98a0-79455206305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:58:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c6c5c653-0ec3-4459-823b-371a35f203fc req-d623b5d4-1342-487f-a207-31361382d969 service nova] Lock "38198e86-bd23-4196-98a0-79455206305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:58:12 user nova-compute[71321]: DEBUG nova.compute.manager [req-c6c5c653-0ec3-4459-823b-371a35f203fc req-d623b5d4-1342-487f-a207-31361382d969 service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] No waiting events found dispatching network-vif-plugged-5621687b-5d0b-47f7-b11c-a24c403a590a {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:58:12 user nova-compute[71321]: WARNING nova.compute.manager [req-c6c5c653-0ec3-4459-823b-371a35f203fc req-d623b5d4-1342-487f-a207-31361382d969 service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] Received unexpected event network-vif-plugged-5621687b-5d0b-47f7-b11c-a24c403a590a for instance with vm_state active and task_state rescuing.
Apr 12 12:58:14 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Removed pending event for 38198e86-bd23-4196-98a0-79455206305f due to event {{(pid=71321) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 12:58:14 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681304294.8478856, 38198e86-bd23-4196-98a0-79455206305f => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:58:14 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] VM Resumed (Lifecycle Event)
Apr 12 12:58:14 user nova-compute[71321]: DEBUG nova.compute.manager [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:58:14 user nova-compute[71321]: DEBUG nova.compute.manager [req-23589361-1f23-462a-a381-5d9836fd3947 req-ad236c70-d295-4c42-b9f1-df099a50f39d service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] Received event network-vif-plugged-5621687b-5d0b-47f7-b11c-a24c403a590a {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:58:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-23589361-1f23-462a-a381-5d9836fd3947 req-ad236c70-d295-4c42-b9f1-df099a50f39d service nova] Acquiring lock "38198e86-bd23-4196-98a0-79455206305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:58:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-23589361-1f23-462a-a381-5d9836fd3947 req-ad236c70-d295-4c42-b9f1-df099a50f39d service nova] Lock "38198e86-bd23-4196-98a0-79455206305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:58:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-23589361-1f23-462a-a381-5d9836fd3947 req-ad236c70-d295-4c42-b9f1-df099a50f39d service nova] Lock "38198e86-bd23-4196-98a0-79455206305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:58:14 user nova-compute[71321]: DEBUG nova.compute.manager [req-23589361-1f23-462a-a381-5d9836fd3947 req-ad236c70-d295-4c42-b9f1-df099a50f39d service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] No waiting events found dispatching network-vif-plugged-5621687b-5d0b-47f7-b11c-a24c403a590a {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:58:14 user nova-compute[71321]: WARNING nova.compute.manager [req-23589361-1f23-462a-a381-5d9836fd3947 req-ad236c70-d295-4c42-b9f1-df099a50f39d service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] Received unexpected event network-vif-plugged-5621687b-5d0b-47f7-b11c-a24c403a590a for instance with vm_state active and task_state rescuing.
Apr 12 12:58:14 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:58:14 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:58:14 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 12:58:14 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681304294.8496408, 38198e86-bd23-4196-98a0-79455206305f => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:58:14 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] VM Started (Lifecycle Event)
Apr 12 12:58:14 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:58:14 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 12:58:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:58:16 user nova-compute[71321]: DEBUG nova.compute.manager [req-44a77223-42c0-4034-85ff-9ab9dc6a4ea6 req-dc10c2a0-a513-401a-88b7-5a7a8fdccb62 service nova] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Received event network-changed-9b06c0b4-3cd0-4352-958a-1a39e37e7925 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:58:16 user nova-compute[71321]: DEBUG nova.compute.manager [req-44a77223-42c0-4034-85ff-9ab9dc6a4ea6 req-dc10c2a0-a513-401a-88b7-5a7a8fdccb62 service nova] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Refreshing instance network info cache due to event network-changed-9b06c0b4-3cd0-4352-958a-1a39e37e7925. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:58:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-44a77223-42c0-4034-85ff-9ab9dc6a4ea6 req-dc10c2a0-a513-401a-88b7-5a7a8fdccb62 service nova] Acquiring lock "refresh_cache-88c7dd97-0390-4b2b-b803-7ab023366fd4" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:58:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-44a77223-42c0-4034-85ff-9ab9dc6a4ea6 req-dc10c2a0-a513-401a-88b7-5a7a8fdccb62 service nova] Acquired lock "refresh_cache-88c7dd97-0390-4b2b-b803-7ab023366fd4" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:58:16 user nova-compute[71321]: DEBUG nova.network.neutron [req-44a77223-42c0-4034-85ff-9ab9dc6a4ea6 req-dc10c2a0-a513-401a-88b7-5a7a8fdccb62 service nova] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Refreshing network info cache for port 9b06c0b4-3cd0-4352-958a-1a39e37e7925 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:58:16 user nova-compute[71321]: DEBUG nova.network.neutron [req-44a77223-42c0-4034-85ff-9ab9dc6a4ea6 req-dc10c2a0-a513-401a-88b7-5a7a8fdccb62 service nova] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Updated VIF entry in instance network info cache for port 9b06c0b4-3cd0-4352-958a-1a39e37e7925. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:58:16 user nova-compute[71321]: DEBUG nova.network.neutron [req-44a77223-42c0-4034-85ff-9ab9dc6a4ea6 req-dc10c2a0-a513-401a-88b7-5a7a8fdccb62 service nova] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Updating instance_info_cache with network_info: [{"id": "9b06c0b4-3cd0-4352-958a-1a39e37e7925", "address": "fa:16:3e:8f:3f:14", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b06c0b4-3c", "ovs_interfaceid": "9b06c0b4-3cd0-4352-958a-1a39e37e7925", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:58:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-44a77223-42c0-4034-85ff-9ab9dc6a4ea6 req-dc10c2a0-a513-401a-88b7-5a7a8fdccb62 service nova] Releasing lock "refresh_cache-88c7dd97-0390-4b2b-b803-7ab023366fd4" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:58:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:58:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "88c7dd97-0390-4b2b-b803-7ab023366fd4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:58:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "88c7dd97-0390-4b2b-b803-7ab023366fd4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:58:17 user nova-compute[71321]: DEBUG nova.objects.instance [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lazy-loading 'flavor' on Instance uuid 88c7dd97-0390-4b2b-b803-7ab023366fd4 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:58:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "88c7dd97-0390-4b2b-b803-7ab023366fd4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:58:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "88c7dd97-0390-4b2b-b803-7ab023366fd4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:58:18 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "88c7dd97-0390-4b2b-b803-7ab023366fd4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:58:18 user nova-compute[71321]: INFO nova.compute.manager [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Attaching volume e75cd8ab-b2ce-40b3-886b-1853d6f49278 to /dev/vdb
Apr 12 12:58:18 user nova-compute[71321]: DEBUG os_brick.utils [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:58:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:18 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a379baa-6bcf-4830-b1a9-8abff822a901]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:58:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:18 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5f1019-12c6-4ace-9877-af5b2b10116f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:58:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:18 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f071e1f-87e4-47de-82a5-e2ce6f817d1d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:58:18 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7a4346-bd9b-4d31-9ff7-9956bd67a63f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:58:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:58:18 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:58:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:18 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:58:18 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:58:18 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9b6fec-2703-4baa-ae11-ff1686adc861]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:58:18 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:58:18 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:58:18 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:58:18 user nova-compute[71321]: DEBUG os_brick.utils [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:58:18 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Updating existing volume attachment record: ebb184ef-45d7-4daa-9a39-2442b8b4df61 {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:58:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:58:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:58:23 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:58:23 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IvGqeEjf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:58:23 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:58:23 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:58:23 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:58:23 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:58:23 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:58:23 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:58:23 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:58:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:23 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d85aa35-0f6d-4ef8-aba7-0ff7ca0af378]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:58:23 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:58:23 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:58:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:23 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2421e35b-68e2-4098-92b1-d7ef28c0fafb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:58:23 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278] added
Apr 12 12:58:23 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:58:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:23 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[deaac460-fb98-4669-9e3e-9f50ce6ce461]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:58:23 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:58:23 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aef6181-5c2c-4508-821f-60cd5211bc62]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IvGqeEjf {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IvGqeEjf" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b599682-0db1-4b4a-bf26-8261fcbaf6de]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IvGqeEjf'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbed7080-7f96-41e9-80dc-670f14a6ebc2]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e358010-b25d-43fd-8daf-1600be400d57]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 12:58:24 user nova-compute[71321]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)
Apr 12 12:58:24 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 12:58:24 user nova-compute[71321]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)
Apr 12 12:58:24 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae93b61-09ec-4530-9e12-d308022093c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278, portal: 172.16.0.220,3260]
Apr 12 12:58:24 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278, portal: 172.16.0.220,3260] successful.
Apr 12 12:58:24 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2374ed61-4d6e-46cf-851c-b1f801c14a43]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd105473-a888-40dd-88e5-8f7914c448c8]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 12:58:24 user nova-compute[71321]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)
Apr 12 12:58:24 user nova-compute[71321]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278 (non-flash)
Apr 12 12:58:24 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 12:58:24 user nova-compute[71321]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)
Apr 12 12:58:24 user nova-compute[71321]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278 (non-flash)
Apr 12 12:58:24 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41f1712-3ffa-4202-931f-ffbba542df96]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:58:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IvGqeEjf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:58:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:58:25 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26162343836363939', 'path': '/dev/sdd'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:58:25 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162343836363939', 'path': '/dev/sdd'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:58:25 user nova-compute[71321]: DEBUG nova.objects.instance [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lazy-loading 'flavor' on Instance uuid 88c7dd97-0390-4b2b-b803-7ab023366fd4 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:58:25 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 12:58:25 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:58:25 user nova-compute[71321]:   <source dev="/dev/sdd"/>
Apr 12 12:58:25 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:58:25 user nova-compute[71321]:   <serial>e75cd8ab-b2ce-40b3-886b-1853d6f49278</serial>
Apr 12 12:58:25 user nova-compute[71321]: </disk>
Apr 12 12:58:25 user nova-compute[71321]:  {{(pid=71321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 12:58:25 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:58:25 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:58:25 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] No VIF found with MAC fa:16:3e:8f:3f:14, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:58:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:58:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "88c7dd97-0390-4b2b-b803-7ab023366fd4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.949s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "88c7dd97-0390-4b2b-b803-7ab023366fd4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "88c7dd97-0390-4b2b-b803-7ab023366fd4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:58:27 user nova-compute[71321]: INFO nova.compute.manager [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Detaching volume e75cd8ab-b2ce-40b3-886b-1853d6f49278
Apr 12 12:58:27 user nova-compute[71321]: INFO nova.virt.block_device [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Attempting to driver detach volume e75cd8ab-b2ce-40b3-886b-1853d6f49278 from mountpoint /dev/vdb
Apr 12 12:58:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Attempting to detach device vdb from instance 88c7dd97-0390-4b2b-b803-7ab023366fd4 from the persistent domain config. {{(pid=71321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:58:27 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:58:27 user nova-compute[71321]:   <source dev="/dev/sdd"/>
Apr 12 12:58:27 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:58:27 user nova-compute[71321]:   <serial>e75cd8ab-b2ce-40b3-886b-1853d6f49278</serial>
Apr 12 12:58:27 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 12:58:27 user nova-compute[71321]: </disk>
Apr 12 12:58:27 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:58:27 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Successfully detached device vdb from instance 88c7dd97-0390-4b2b-b803-7ab023366fd4 from the persistent domain config.
Apr 12 12:58:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 88c7dd97-0390-4b2b-b803-7ab023366fd4 from the live domain config. {{(pid=71321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:58:27 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:58:27 user nova-compute[71321]:   <source dev="/dev/sdd"/>
Apr 12 12:58:27 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:58:27 user nova-compute[71321]:   <serial>e75cd8ab-b2ce-40b3-886b-1853d6f49278</serial>
Apr 12 12:58:27 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 12:58:27 user nova-compute[71321]: </disk>
Apr 12 12:58:27 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Received event <DeviceRemovedEvent: 1681304307.749954, 88c7dd97-0390-4b2b-b803-7ab023366fd4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 88c7dd97-0390-4b2b-b803-7ab023366fd4 {{(pid=71321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 12:58:27 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Successfully detached device vdb from instance 88c7dd97-0390-4b2b-b803-7ab023366fd4 from the live domain config.
Apr 12 12:58:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IvGqeEjf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:58:27 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:58:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed884104-ad49-4e8d-b2d2-98b999b9a136]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:58:27 user nova-compute[71321]: No targets found.
Apr 12 12:58:27 user nova-compute[71321]: iSNS:
Apr 12 12:58:27 user nova-compute[71321]: No targets found.
Apr 12 12:58:27 user nova-compute[71321]: STATIC:
Apr 12 12:58:27 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278
Apr 12 12:58:27 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:58:27 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:58:27 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463
Apr 12 12:58:27 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:58:27 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:58:27 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2
Apr 12 12:58:27 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:58:27 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:58:27 user nova-compute[71321]: FIRMWARE:
Apr 12 12:58:27 user nova-compute[71321]: No targets found.
Apr 12 12:58:27 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:58:27 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:58:27 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be92185-b21a-45ea-ac18-99c9f62a52ad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17b76c5-9684-44c2-bec1-41a1261f5b27]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 12:58:27 user nova-compute[71321]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)
Apr 12 12:58:27 user nova-compute[71321]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278 (non-flash)
Apr 12 12:58:27 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 12:58:27 user nova-compute[71321]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)
Apr 12 12:58:27 user nova-compute[71321]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278 (non-flash)
Apr 12 12:58:27 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef442652d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278'): ({'sdd'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Removing single pathed devices sdd {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e30d3f-e1e3-42d8-8225-fd61864ebb70]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0964d29e-cc98-4d67-a178-ffb5fe514f38]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Flushing IO for device /dev/sdd {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6815f5-11b0-4de2-8a2b-54d025ff1090]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa32f5a-19e7-4a27-872e-e1add3282b8e]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] SCSI volumes sdd have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad74d2c-203e-41a5-9c34-aec192f2cc6a]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:58:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:28 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c306d7bd-877d-4967-9c5f-b4a6ec3fed73]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:58:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278, portal: 172.16.0.220,3260]
Apr 12 12:58:28 user nova-compute[71321]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278, portal: 172.16.0.220,3260] successful.
Apr 12 12:58:28 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:58:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:28 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e75cd8ab-b2ce-40b3-886b-1853d6f49278 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:28 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f203b0f3-a7cf-4265-952d-98a6322985ea]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:58:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:58:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:58:28 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] <== disconnect_volume: return (316ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:58:28 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:58:28 user nova-compute[71321]: DEBUG nova.objects.instance [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lazy-loading 'flavor' on Instance uuid 88c7dd97-0390-4b2b-b803-7ab023366fd4 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:58:28 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "88c7dd97-0390-4b2b-b803-7ab023366fd4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.706s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:58:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:58:32 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:58:34 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:58:34 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:58:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:58:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:58:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:58:34 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:58:34 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ebf6f6b-3940-40fa-9a20-a28a957961e2/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:34 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ebf6f6b-3940-40fa-9a20-a28a957961e2/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:34 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ebf6f6b-3940-40fa-9a20-a28a957961e2/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:34 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ebf6f6b-3940-40fa-9a20-a28a957961e2/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:34 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:58:34 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38198e86-bd23-4196-98a0-79455206305f/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:34 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38198e86-bd23-4196-98a0-79455206305f/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:34 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38198e86-bd23-4196-98a0-79455206305f/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:35 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38198e86-bd23-4196-98a0-79455206305f/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:35 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:35 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:35 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:35 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:35 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:58:35 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88c7dd97-0390-4b2b-b803-7ab023366fd4/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:35 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88c7dd97-0390-4b2b-b803-7ab023366fd4/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:35 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88c7dd97-0390-4b2b-b803-7ab023366fd4/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:35 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88c7dd97-0390-4b2b-b803-7ab023366fd4/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:35 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:35 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:35 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:58:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:58:35 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:58:36 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:58:36 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:58:36 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8206MB free_disk=26.174373626708984GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:58:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:58:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:58:36 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:58:36 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:58:36 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 38198e86-bd23-4196-98a0-79455206305f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:58:36 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 88c7dd97-0390-4b2b-b803-7ab023366fd4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:58:36 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:58:36 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:58:36 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:58:36 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:58:36 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:58:36 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:58:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.303s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:58:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:58:39 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:58:39 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:58:40 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:58:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:58:42 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:58:43 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:58:44 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:58:44 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:58:44 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:58:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-38198e86-bd23-4196-98a0-79455206305f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:58:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-38198e86-bd23-4196-98a0-79455206305f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:58:44 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 12:58:44 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] Updating instance_info_cache with network_info: [{"id": "5621687b-5d0b-47f7-b11c-a24c403a590a", "address": "fa:16:3e:0e:91:7d", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621687b-5d", "ovs_interfaceid": "5621687b-5d0b-47f7-b11c-a24c403a590a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:58:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-38198e86-bd23-4196-98a0-79455206305f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:58:45 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 12:58:45 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:58:45 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:58:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:58:47 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:58:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:58:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:58:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:58:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:58:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:58:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 12:58:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 12:58:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 12:58:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:06 user nova-compute[71321]: DEBUG nova.compute.manager [req-b2d55008-3eea-496b-b90f-242478ae39d9 req-a8c792f7-d649-4005-a37b-c23390724360 service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Received event network-changed-82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:59:06 user nova-compute[71321]: DEBUG nova.compute.manager [req-b2d55008-3eea-496b-b90f-242478ae39d9 req-a8c792f7-d649-4005-a37b-c23390724360 service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Refreshing instance network info cache due to event network-changed-82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:59:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b2d55008-3eea-496b-b90f-242478ae39d9 req-a8c792f7-d649-4005-a37b-c23390724360 service nova] Acquiring lock "refresh_cache-9ebf6f6b-3940-40fa-9a20-a28a957961e2" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:59:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b2d55008-3eea-496b-b90f-242478ae39d9 req-a8c792f7-d649-4005-a37b-c23390724360 service nova] Acquired lock "refresh_cache-9ebf6f6b-3940-40fa-9a20-a28a957961e2" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:59:06 user nova-compute[71321]: DEBUG nova.network.neutron [req-b2d55008-3eea-496b-b90f-242478ae39d9 req-a8c792f7-d649-4005-a37b-c23390724360 service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Refreshing network info cache for port 82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:59:06 user nova-compute[71321]: DEBUG nova.network.neutron [req-b2d55008-3eea-496b-b90f-242478ae39d9 req-a8c792f7-d649-4005-a37b-c23390724360 service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Updated VIF entry in instance network info cache for port 82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:59:06 user nova-compute[71321]: DEBUG nova.network.neutron [req-b2d55008-3eea-496b-b90f-242478ae39d9 req-a8c792f7-d649-4005-a37b-c23390724360 service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Updating instance_info_cache with network_info: [{"id": "82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf", "address": "fa:16:3e:4d:b8:a2", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82eff0a4-60", "ovs_interfaceid": "82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:59:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b2d55008-3eea-496b-b90f-242478ae39d9 req-a8c792f7-d649-4005-a37b-c23390724360 service nova] Releasing lock "refresh_cache-9ebf6f6b-3940-40fa-9a20-a28a957961e2" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:59:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:59:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:59:07 user nova-compute[71321]: DEBUG nova.objects.instance [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'flavor' on Instance uuid 9ebf6f6b-3940-40fa-9a20-a28a957961e2 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:59:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:59:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:59:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:59:07 user nova-compute[71321]: INFO nova.compute.manager [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Attaching volume 872ce488-65b3-4306-9435-9ba79ed5df15 to /dev/vdb
Apr 12 12:59:07 user nova-compute[71321]: DEBUG os_brick.utils [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:59:07 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:08 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[502c4d23-907a-4baa-9d2b-9d6f2454a68e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:08 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf0fed0-93be-4f6c-b473-9753000e4ab2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:08 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b1bc3c-47df-4934-83ac-04ecb685464b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:08 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0144179-5f76-4627-afeb-7fcef1d27599]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:59:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:59:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:59:08 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:59:08 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c156963b-edb4-4833-bd81-1442b4f9e20f]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:59:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:59:08 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:59:08 user nova-compute[71321]: DEBUG os_brick.utils [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:59:08 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Updating existing volume attachment record: f4157952-880a-48e6-9d3b-290ebada5996 {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:59:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'elXZPkyN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:59:12 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:59:12 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:59:12 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:59:12 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:59:12 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:59:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c4d617-89d7-4e9a-b2f8-8feaf0e60678]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:59:12 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.078s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad75169d-2638-4cbe-9821-54295a9a5489]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15] added
Apr 12 12:59:12 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[667a348b-59f1-4754-9dd7-8146ca87ff13]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bb8e74-585a-4b0d-afa9-4f6a9cabf98c]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v elXZPkyN {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v elXZPkyN" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea5f043-cd29-42aa-a1e9-40107e636113]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'elXZPkyN'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[29010957-3833-40fa-b26f-582a48fe92a2]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[756d37d9-ea59-4c66-a584-fd3b7a5a5f14]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 12:59:12 user nova-compute[71321]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)
Apr 12 12:59:12 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 12:59:12 user nova-compute[71321]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)
Apr 12 12:59:12 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a2f94e-fb3c-4e72-ada1-7e5143ad379f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15, portal: 172.16.0.220,3260]
Apr 12 12:59:12 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15, portal: 172.16.0.220,3260] successful.
Apr 12 12:59:12 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02b57d1-302a-4dc1-bf52-ccecfc65f651]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9efa89-5c37-4706-bbad-5ac4dc51971c]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 12:59:12 user nova-compute[71321]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)
Apr 12 12:59:12 user nova-compute[71321]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15 (non-flash)
Apr 12 12:59:12 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 12:59:12 user nova-compute[71321]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)
Apr 12 12:59:12 user nova-compute[71321]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15 (non-flash)
Apr 12 12:59:12 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:59:12 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:13 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:13 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[90085ea6-1231-4a16-84a5-faeb0d358675]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:13 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:59:13 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'elXZPkyN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:59:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:59:14 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23032326131326434', 'path': '/dev/sdd'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:59:14 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032326131326434', 'path': '/dev/sdd'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:59:14 user nova-compute[71321]: DEBUG nova.objects.instance [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'flavor' on Instance uuid 9ebf6f6b-3940-40fa-9a20-a28a957961e2 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:59:14 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 12:59:14 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:59:14 user nova-compute[71321]:   <source dev="/dev/sdd"/>
Apr 12 12:59:14 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:59:14 user nova-compute[71321]:   <serial>872ce488-65b3-4306-9435-9ba79ed5df15</serial>
Apr 12 12:59:14 user nova-compute[71321]: </disk>
Apr 12 12:59:14 user nova-compute[71321]:  {{(pid=71321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 12:59:14 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:59:14 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:59:14 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] No VIF found with MAC fa:16:3e:4d:b8:a2, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:59:14 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.740s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:59:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:59:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:59:16 user nova-compute[71321]: DEBUG nova.objects.instance [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'flavor' on Instance uuid 9ebf6f6b-3940-40fa-9a20-a28a957961e2 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:59:16 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:59:17 user nova-compute[71321]: INFO nova.compute.manager [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Attaching volume 2dbb7a14-a626-492d-b50e-f44ae00c03d0 to /dev/vdc
Apr 12 12:59:17 user nova-compute[71321]: DEBUG os_brick.utils [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7030b02-7f53-4bb8-9760-8b2609a65d54]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[be07bf69-ba45-403d-b8c3-a46c6d4ba5c2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce643eff-d71d-4896-b93b-e399f1135f4e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[af92e3a6-8f8f-4040-9842-5ed0a64b932b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 12:59:17 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 12:59:17 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7b93e2-ee9e-4b8f-a98c-fb76f68d7764]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG os_brick.utils [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Updating existing volume attachment record: 861fdd6e-2ff7-422e-aaab-ecf19a22e30b {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5bfe919d-71bc-42a5-9c67-7fc0af2e286b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "88c7dd97-0390-4b2b-b803-7ab023366fd4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5bfe919d-71bc-42a5-9c67-7fc0af2e286b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "88c7dd97-0390-4b2b-b803-7ab023366fd4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5bfe919d-71bc-42a5-9c67-7fc0af2e286b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "88c7dd97-0390-4b2b-b803-7ab023366fd4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5bfe919d-71bc-42a5-9c67-7fc0af2e286b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "88c7dd97-0390-4b2b-b803-7ab023366fd4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5bfe919d-71bc-42a5-9c67-7fc0af2e286b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "88c7dd97-0390-4b2b-b803-7ab023366fd4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:59:17 user nova-compute[71321]: INFO nova.compute.manager [None req-5bfe919d-71bc-42a5-9c67-7fc0af2e286b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Terminating instance
Apr 12 12:59:17 user nova-compute[71321]: DEBUG nova.compute.manager [None req-5bfe919d-71bc-42a5-9c67-7fc0af2e286b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG nova.compute.manager [req-38a310b4-81a2-47c2-b443-9375545443c6 req-12f0ef2e-5481-47d9-a2d9-8c8792b0cdef service nova] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Received event network-vif-unplugged-9b06c0b4-3cd0-4352-958a-1a39e37e7925 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-38a310b4-81a2-47c2-b443-9375545443c6 req-12f0ef2e-5481-47d9-a2d9-8c8792b0cdef service nova] Acquiring lock "88c7dd97-0390-4b2b-b803-7ab023366fd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-38a310b4-81a2-47c2-b443-9375545443c6 req-12f0ef2e-5481-47d9-a2d9-8c8792b0cdef service nova] Lock "88c7dd97-0390-4b2b-b803-7ab023366fd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-38a310b4-81a2-47c2-b443-9375545443c6 req-12f0ef2e-5481-47d9-a2d9-8c8792b0cdef service nova] Lock "88c7dd97-0390-4b2b-b803-7ab023366fd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG nova.compute.manager [req-38a310b4-81a2-47c2-b443-9375545443c6 req-12f0ef2e-5481-47d9-a2d9-8c8792b0cdef service nova] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] No waiting events found dispatching network-vif-unplugged-9b06c0b4-3cd0-4352-958a-1a39e37e7925 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:59:17 user nova-compute[71321]: DEBUG nova.compute.manager [req-38a310b4-81a2-47c2-b443-9375545443c6 req-12f0ef2e-5481-47d9-a2d9-8c8792b0cdef service nova] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Received event network-vif-unplugged-9b06c0b4-3cd0-4352-958a-1a39e37e7925 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:59:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:18 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Instance destroyed successfully.
Apr 12 12:59:18 user nova-compute[71321]: DEBUG nova.objects.instance [None req-5bfe919d-71bc-42a5-9c67-7fc0af2e286b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lazy-loading 'resources' on Instance uuid 88c7dd97-0390-4b2b-b803-7ab023366fd4 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:59:18 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-5bfe919d-71bc-42a5-9c67-7fc0af2e286b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:56:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2056889362',display_name='tempest-AttachVolumeNegativeTest-server-2056889362',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2056889362',id=41,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZmFPVnE4tAmO1yvRexE4d4I4G/HJpMr2SSk8OHxjALBh+f9CTblVVcbe0HlQ0Ch4FIcsGZHFLQnnDkwtJS/ZH/cxRy05QKijU/FHTuCeYRAgiZ/fISBnryI0uJ+P1pLA==',key_name='tempest-keypair-1304891791',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:56:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e61975273ccb41229e0138b96eb7f5e9',ramdisk_id='',reservation_id='r-b34rbxyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-941338837',owner_user_name='tempest-AttachVolumeNegativeTest-941338837-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:56:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3d9f4516bee4f8d9af7a40ed1298f03',uuid=88c7dd97-0390-4b2b-b803-7ab023366fd4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b06c0b4-3cd0-4352-958a-1a39e37e7925", "address": "fa:16:3e:8f:3f:14", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b06c0b4-3c", "ovs_interfaceid": "9b06c0b4-3cd0-4352-958a-1a39e37e7925", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:59:18 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-5bfe919d-71bc-42a5-9c67-7fc0af2e286b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Converting VIF {"id": "9b06c0b4-3cd0-4352-958a-1a39e37e7925", "address": "fa:16:3e:8f:3f:14", "network": {"id": "e211a286-ade0-4930-a327-4c6a41785094", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1283179710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e61975273ccb41229e0138b96eb7f5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b06c0b4-3c", "ovs_interfaceid": "9b06c0b4-3cd0-4352-958a-1a39e37e7925", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:59:18 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-5bfe919d-71bc-42a5-9c67-7fc0af2e286b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:3f:14,bridge_name='br-int',has_traffic_filtering=True,id=9b06c0b4-3cd0-4352-958a-1a39e37e7925,network=Network(e211a286-ade0-4930-a327-4c6a41785094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b06c0b4-3c') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:59:18 user nova-compute[71321]: DEBUG os_vif [None req-5bfe919d-71bc-42a5-9c67-7fc0af2e286b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:3f:14,bridge_name='br-int',has_traffic_filtering=True,id=9b06c0b4-3cd0-4352-958a-1a39e37e7925,network=Network(e211a286-ade0-4930-a327-4c6a41785094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b06c0b4-3c') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:59:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b06c0b4-3c, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:59:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:59:18 user nova-compute[71321]: INFO os_vif [None req-5bfe919d-71bc-42a5-9c67-7fc0af2e286b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:3f:14,bridge_name='br-int',has_traffic_filtering=True,id=9b06c0b4-3cd0-4352-958a-1a39e37e7925,network=Network(e211a286-ade0-4930-a327-4c6a41785094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b06c0b4-3c')
Apr 12 12:59:18 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-5bfe919d-71bc-42a5-9c67-7fc0af2e286b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Deleting instance files /opt/stack/data/nova/instances/88c7dd97-0390-4b2b-b803-7ab023366fd4_del
Apr 12 12:59:18 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-5bfe919d-71bc-42a5-9c67-7fc0af2e286b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Deletion of /opt/stack/data/nova/instances/88c7dd97-0390-4b2b-b803-7ab023366fd4_del complete
Apr 12 12:59:18 user nova-compute[71321]: INFO nova.compute.manager [None req-5bfe919d-71bc-42a5-9c67-7fc0af2e286b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 12 12:59:18 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-5bfe919d-71bc-42a5-9c67-7fc0af2e286b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:59:18 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:59:18 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:59:19 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:59:19 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Took 0.73 seconds to deallocate network for instance.
Apr 12 12:59:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5bfe919d-71bc-42a5-9c67-7fc0af2e286b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:59:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5bfe919d-71bc-42a5-9c67-7fc0af2e286b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:59:19 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-5bfe919d-71bc-42a5-9c67-7fc0af2e286b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:59:19 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-5bfe919d-71bc-42a5-9c67-7fc0af2e286b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:59:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5bfe919d-71bc-42a5-9c67-7fc0af2e286b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.206s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:59:19 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-5bfe919d-71bc-42a5-9c67-7fc0af2e286b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Deleted allocations for instance 88c7dd97-0390-4b2b-b803-7ab023366fd4
Apr 12 12:59:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5bfe919d-71bc-42a5-9c67-7fc0af2e286b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "88c7dd97-0390-4b2b-b803-7ab023366fd4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.055s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:59:19 user nova-compute[71321]: DEBUG nova.compute.manager [req-5ce69637-8fe7-4219-8e3c-0848d887c8b6 req-406753ee-5316-43ef-8bcd-448aa8fe4a6e service nova] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Received event network-vif-plugged-9b06c0b4-3cd0-4352-958a-1a39e37e7925 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:59:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-5ce69637-8fe7-4219-8e3c-0848d887c8b6 req-406753ee-5316-43ef-8bcd-448aa8fe4a6e service nova] Acquiring lock "88c7dd97-0390-4b2b-b803-7ab023366fd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:59:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-5ce69637-8fe7-4219-8e3c-0848d887c8b6 req-406753ee-5316-43ef-8bcd-448aa8fe4a6e service nova] Lock "88c7dd97-0390-4b2b-b803-7ab023366fd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:59:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-5ce69637-8fe7-4219-8e3c-0848d887c8b6 req-406753ee-5316-43ef-8bcd-448aa8fe4a6e service nova] Lock "88c7dd97-0390-4b2b-b803-7ab023366fd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:59:19 user nova-compute[71321]: DEBUG nova.compute.manager [req-5ce69637-8fe7-4219-8e3c-0848d887c8b6 req-406753ee-5316-43ef-8bcd-448aa8fe4a6e service nova] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] No waiting events found dispatching network-vif-plugged-9b06c0b4-3cd0-4352-958a-1a39e37e7925 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:59:19 user nova-compute[71321]: WARNING nova.compute.manager [req-5ce69637-8fe7-4219-8e3c-0848d887c8b6 req-406753ee-5316-43ef-8bcd-448aa8fe4a6e service nova] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Received unexpected event network-vif-plugged-9b06c0b4-3cd0-4352-958a-1a39e37e7925 for instance with vm_state deleted and task_state None.
Apr 12 12:59:19 user nova-compute[71321]: DEBUG nova.compute.manager [req-5ce69637-8fe7-4219-8e3c-0848d887c8b6 req-406753ee-5316-43ef-8bcd-448aa8fe4a6e service nova] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Received event network-vif-deleted-9b06c0b4-3cd0-4352-958a-1a39e37e7925 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:59:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWVOqguk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:59:21 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:59:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:59:21 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:59:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:59:21 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 12:59:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeaaefb0-6e63-4589-b267-76bcb4176acf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 12:59:21 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05e825a-a1f5-463f-aa01-ba65f60544ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0] added
Apr 12 12:59:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[51021627-e977-4e0e-9204-64881faf2071]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f937b837-e0fc-42bc-9388-728d5f7d27aa]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PWVOqguk {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PWVOqguk" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[871d40da-b969-461a-8545-7f39584f138a]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PWVOqguk'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c502f057-4a96-467f-8f6c-0bf38591bbf7]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab970dff-03a6-49b1-bf86-6385e5e4e4da]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 12:59:21 user nova-compute[71321]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)
Apr 12 12:59:21 user nova-compute[71321]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15 (non-flash)
Apr 12 12:59:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 12:59:21 user nova-compute[71321]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)
Apr 12 12:59:21 user nova-compute[71321]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15 (non-flash)
Apr 12 12:59:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[483f3847-a1d0-4e50-8193-87d7d1c71459]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0, portal: 172.16.0.220,3260]
Apr 12 12:59:21 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0, portal: 172.16.0.220,3260] successful.
Apr 12 12:59:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa239be-dfeb-4cf2-a491-f02981a47f19]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[da61ea78-f722-4375-afff-71ce0b67b305]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 12:59:21 user nova-compute[71321]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)
Apr 12 12:59:21 user nova-compute[71321]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15 (non-flash)
Apr 12 12:59:21 user nova-compute[71321]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0 (non-flash)
Apr 12 12:59:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 12:59:21 user nova-compute[71321]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)
Apr 12 12:59:21 user nova-compute[71321]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15 (non-flash)
Apr 12 12:59:21 user nova-compute[71321]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0 (non-flash)
Apr 12 12:59:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] HCTL ('36', '-', '-', 0) found on session 51 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8dd32d-9f51-4ae9-ad93-a082f400818f]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Searching for a device in session 51 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 12:59:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWVOqguk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 12:59:22 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:59:22 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23166633937653937', 'path': '/dev/sde'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:59:22 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166633937653937', 'path': '/dev/sde'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 12:59:22 user nova-compute[71321]: DEBUG nova.objects.instance [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'flavor' on Instance uuid 9ebf6f6b-3940-40fa-9a20-a28a957961e2 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:59:22 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 12:59:22 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:59:22 user nova-compute[71321]:   <source dev="/dev/sde"/>
Apr 12 12:59:22 user nova-compute[71321]:   <target dev="vdc" bus="virtio"/>
Apr 12 12:59:22 user nova-compute[71321]:   <serial>2dbb7a14-a626-492d-b50e-f44ae00c03d0</serial>
Apr 12 12:59:22 user nova-compute[71321]: </disk>
Apr 12 12:59:22 user nova-compute[71321]:  {{(pid=71321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 12:59:23 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:23 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:59:23 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:59:23 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 12:59:23 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] No VIF found with MAC fa:16:3e:4d:b8:a2, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 12:59:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.332s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:59:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:59:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:59:23 user nova-compute[71321]: INFO nova.compute.manager [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Detaching volume 872ce488-65b3-4306-9435-9ba79ed5df15
Apr 12 12:59:24 user nova-compute[71321]: INFO nova.virt.block_device [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Attempting to driver detach volume 872ce488-65b3-4306-9435-9ba79ed5df15 from mountpoint /dev/vdb
Apr 12 12:59:24 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Attempting to detach device vdb from instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 from the persistent domain config. {{(pid=71321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:59:24 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:59:24 user nova-compute[71321]:   <source dev="/dev/sdd"/>
Apr 12 12:59:24 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:59:24 user nova-compute[71321]:   <serial>872ce488-65b3-4306-9435-9ba79ed5df15</serial>
Apr 12 12:59:24 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 12:59:24 user nova-compute[71321]: </disk>
Apr 12 12:59:24 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:59:24 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Successfully detached device vdb from instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 from the persistent domain config.
Apr 12 12:59:24 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 from the live domain config. {{(pid=71321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:59:24 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:59:24 user nova-compute[71321]:   <source dev="/dev/sdd"/>
Apr 12 12:59:24 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:59:24 user nova-compute[71321]:   <serial>872ce488-65b3-4306-9435-9ba79ed5df15</serial>
Apr 12 12:59:24 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 12:59:24 user nova-compute[71321]: </disk>
Apr 12 12:59:24 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Received event <DeviceRemovedEvent: 1681304364.5149367, 9ebf6f6b-3940-40fa-9a20-a28a957961e2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 {{(pid=71321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 12:59:24 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Successfully detached device vdb from instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 from the live domain config.
Apr 12 12:59:24 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'elXZPkyN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:59:24 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:59:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea68601-afe2-4025-9d93-9180e9663a9d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:59:24 user nova-compute[71321]: No targets found.
Apr 12 12:59:24 user nova-compute[71321]: iSNS:
Apr 12 12:59:24 user nova-compute[71321]: No targets found.
Apr 12 12:59:24 user nova-compute[71321]: STATIC:
Apr 12 12:59:24 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15
Apr 12 12:59:24 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:59:24 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:59:24 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0
Apr 12 12:59:24 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:59:24 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:59:24 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463
Apr 12 12:59:24 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:59:24 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:59:24 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2
Apr 12 12:59:24 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:59:24 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:59:24 user nova-compute[71321]: FIRMWARE:
Apr 12 12:59:24 user nova-compute[71321]: No targets found.
Apr 12 12:59:24 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:59:24 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:59:24 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[def31098-1fa4-4c27-889c-ea2807d3efbc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[33564be5-e3b9-4f65-9741-307bc74c7a09]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 12:59:24 user nova-compute[71321]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)
Apr 12 12:59:24 user nova-compute[71321]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15 (non-flash)
Apr 12 12:59:24 user nova-compute[71321]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0 (non-flash)
Apr 12 12:59:24 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 12:59:24 user nova-compute[71321]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)
Apr 12 12:59:24 user nova-compute[71321]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15 (non-flash)
Apr 12 12:59:24 user nova-compute[71321]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0 (non-flash)
Apr 12 12:59:24 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef442cf250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15'): ({'sdd'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Removing single pathed devices sdd {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f862665b-b147-46c9-83c1-ae7d19aad950]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c01d247-3cd0-4098-b35a-baddd9a0965b]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Flushing IO for device /dev/sdd {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdea253-093e-40cc-a1bd-43075f03cf3a]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc722d9-65f6-4848-ab3a-ca2ddbb01307]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] SCSI volumes sdd have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b740f80-2e9c-49da-83b5-1ed9b4e09dcc]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a153de-68cb-4be1-b7c1-0f53dce20ce1]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15, portal: 172.16.0.220,3260]
Apr 12 12:59:24 user nova-compute[71321]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15, portal: 172.16.0.220,3260] successful.
Apr 12 12:59:24 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:872ce488-65b3-4306-9435-9ba79ed5df15 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[492ef641-1b25-43bc-abf7-0e3a8060c0c7]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] <== disconnect_volume: return (322ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:59:24 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:59:25 user nova-compute[71321]: DEBUG nova.objects.instance [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'flavor' on Instance uuid 9ebf6f6b-3940-40fa-9a20-a28a957961e2 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:59:25 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.711s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:59:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:59:26 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:59:26 user nova-compute[71321]: INFO nova.compute.manager [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Detaching volume 2dbb7a14-a626-492d-b50e-f44ae00c03d0
Apr 12 12:59:26 user nova-compute[71321]: INFO nova.virt.block_device [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Attempting to driver detach volume 2dbb7a14-a626-492d-b50e-f44ae00c03d0 from mountpoint /dev/vdc
Apr 12 12:59:26 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Attempting to detach device vdc from instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 from the persistent domain config. {{(pid=71321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 12:59:26 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:59:26 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:59:26 user nova-compute[71321]:   <source dev="/dev/sde"/>
Apr 12 12:59:26 user nova-compute[71321]:   <target dev="vdc" bus="virtio"/>
Apr 12 12:59:26 user nova-compute[71321]:   <serial>2dbb7a14-a626-492d-b50e-f44ae00c03d0</serial>
Apr 12 12:59:26 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 12 12:59:26 user nova-compute[71321]: </disk>
Apr 12 12:59:26 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:59:26 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Successfully detached device vdc from instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 from the persistent domain config.
Apr 12 12:59:26 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 from the live domain config. {{(pid=71321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 12:59:26 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:59:26 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:59:26 user nova-compute[71321]:   <source dev="/dev/sde"/>
Apr 12 12:59:26 user nova-compute[71321]:   <target dev="vdc" bus="virtio"/>
Apr 12 12:59:26 user nova-compute[71321]:   <serial>2dbb7a14-a626-492d-b50e-f44ae00c03d0</serial>
Apr 12 12:59:26 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 12 12:59:26 user nova-compute[71321]: </disk>
Apr 12 12:59:26 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Received event <DeviceRemovedEvent: 1681304367.276835, 9ebf6f6b-3940-40fa-9a20-a28a957961e2 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 {{(pid=71321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 12:59:27 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Successfully detached device vdc from instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 from the live domain config.
Apr 12 12:59:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWVOqguk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:59:27 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:59:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a997fc7b-8ac3-40c5-8307-918ddb13e16b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:59:27 user nova-compute[71321]: No targets found.
Apr 12 12:59:27 user nova-compute[71321]: iSNS:
Apr 12 12:59:27 user nova-compute[71321]: No targets found.
Apr 12 12:59:27 user nova-compute[71321]: STATIC:
Apr 12 12:59:27 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0
Apr 12 12:59:27 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:59:27 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:59:27 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463
Apr 12 12:59:27 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:59:27 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:59:27 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2
Apr 12 12:59:27 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:59:27 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:59:27 user nova-compute[71321]: FIRMWARE:
Apr 12 12:59:27 user nova-compute[71321]: No targets found.
Apr 12 12:59:27 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:59:27 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:59:27 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb03864-a1e7-4649-8e89-0f8269db46f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4881cd8-8ca0-4a27-a14d-60173d3bffdc]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 12:59:27 user nova-compute[71321]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)
Apr 12 12:59:27 user nova-compute[71321]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0 (non-flash)
Apr 12 12:59:27 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 12:59:27 user nova-compute[71321]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)
Apr 12 12:59:27 user nova-compute[71321]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0 (non-flash)
Apr 12 12:59:27 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef8a1d8820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0'): ({'sde'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Removing single pathed devices sde {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5bb949-1175-4c8e-8f51-384843908e00]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a3ede8-cf3b-443e-ac5f-56a0fa535a6b]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Flushing IO for device /dev/sde {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9306a0-2b96-48e8-9e0d-4e668c634e91]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c338a7e3-7e97-4d8b-a69a-3239bf058060]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] SCSI volumes sde have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a627c3d6-8a50-49b7-b5e1-e22642f3c7c6]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98066f6-bb74-4c0c-aaa2-a5de67574c29]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0, portal: 172.16.0.220,3260]
Apr 12 12:59:27 user nova-compute[71321]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0, portal: 172.16.0.220,3260] successful.
Apr 12 12:59:27 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb7a14-a626-492d-b50e-f44ae00c03d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[45963dba-7a40-4524-a26f-38d1d1487b15]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] <== disconnect_volume: return (299ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:59:27 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:59:28 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:28 user nova-compute[71321]: DEBUG nova.objects.instance [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'flavor' on Instance uuid 9ebf6f6b-3940-40fa-9a20-a28a957961e2 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:59:28 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.830s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:59:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-6c229c8d-76bd-4433-95e7-b2cec87c9b22 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:59:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-6c229c8d-76bd-4433-95e7-b2cec87c9b22 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:59:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-6c229c8d-76bd-4433-95e7-b2cec87c9b22 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:59:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-6c229c8d-76bd-4433-95e7-b2cec87c9b22 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:59:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-6c229c8d-76bd-4433-95e7-b2cec87c9b22 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:59:29 user nova-compute[71321]: INFO nova.compute.manager [None req-6c229c8d-76bd-4433-95e7-b2cec87c9b22 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Terminating instance
Apr 12 12:59:29 user nova-compute[71321]: DEBUG nova.compute.manager [None req-6c229c8d-76bd-4433-95e7-b2cec87c9b22 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 12:59:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:29 user nova-compute[71321]: DEBUG nova.compute.manager [req-d684b352-f345-4690-8d1f-e55aea578de2 req-b78b9f38-6ef4-44a6-a011-3fec56db65e0 service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Received event network-vif-unplugged-82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:59:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d684b352-f345-4690-8d1f-e55aea578de2 req-b78b9f38-6ef4-44a6-a011-3fec56db65e0 service nova] Acquiring lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:59:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d684b352-f345-4690-8d1f-e55aea578de2 req-b78b9f38-6ef4-44a6-a011-3fec56db65e0 service nova] Lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:59:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d684b352-f345-4690-8d1f-e55aea578de2 req-b78b9f38-6ef4-44a6-a011-3fec56db65e0 service nova] Lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:59:29 user nova-compute[71321]: DEBUG nova.compute.manager [req-d684b352-f345-4690-8d1f-e55aea578de2 req-b78b9f38-6ef4-44a6-a011-3fec56db65e0 service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] No waiting events found dispatching network-vif-unplugged-82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:59:29 user nova-compute[71321]: DEBUG nova.compute.manager [req-d684b352-f345-4690-8d1f-e55aea578de2 req-b78b9f38-6ef4-44a6-a011-3fec56db65e0 service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Received event network-vif-unplugged-82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 12:59:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:30 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Instance destroyed successfully.
Apr 12 12:59:30 user nova-compute[71321]: DEBUG nova.objects.instance [None req-6c229c8d-76bd-4433-95e7-b2cec87c9b22 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'resources' on Instance uuid 9ebf6f6b-3940-40fa-9a20-a28a957961e2 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:59:30 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-6c229c8d-76bd-4433-95e7-b2cec87c9b22 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:57:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-65757566',display_name='tempest-AttachVolumeTestJSON-server-65757566',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-65757566',id=42,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+VqciJ+AVvCe/N0xwWOn/nJY1e4lfokIJeJ1FKR2w8X6Y9f/4CVW/1X9EydJvxQYb4/9jutiZdSGF9cw4hZDSkkxaTg/Y/3AIuAySVrBR5vodpwIgm/ehG2VQ4V0w+AQ==',key_name='tempest-keypair-990566308',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:57:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0e6aaaa9a634f349d371f7c6c15eca2',ramdisk_id='',reservation_id='r-u9ahjxxj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-905742219',owner_user_name='tempest-AttachVolumeTestJSON-905742219-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:57:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a9c54033c7547c2bae91e6c1dba0976',uuid=9ebf6f6b-3940-40fa-9a20-a28a957961e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf", "address": "fa:16:3e:4d:b8:a2", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82eff0a4-60", "ovs_interfaceid": "82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 12:59:30 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-6c229c8d-76bd-4433-95e7-b2cec87c9b22 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Converting VIF {"id": "82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf", "address": "fa:16:3e:4d:b8:a2", "network": {"id": "e1afe3b3-a919-4800-9f1c-c8e602defd4f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1206552887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0e6aaaa9a634f349d371f7c6c15eca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82eff0a4-60", "ovs_interfaceid": "82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 12:59:30 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-6c229c8d-76bd-4433-95e7-b2cec87c9b22 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:b8:a2,bridge_name='br-int',has_traffic_filtering=True,id=82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf,network=Network(e1afe3b3-a919-4800-9f1c-c8e602defd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82eff0a4-60') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 12:59:30 user nova-compute[71321]: DEBUG os_vif [None req-6c229c8d-76bd-4433-95e7-b2cec87c9b22 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:b8:a2,bridge_name='br-int',has_traffic_filtering=True,id=82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf,network=Network(e1afe3b3-a919-4800-9f1c-c8e602defd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82eff0a4-60') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 12:59:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82eff0a4-60, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 12:59:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:59:30 user nova-compute[71321]: INFO os_vif [None req-6c229c8d-76bd-4433-95e7-b2cec87c9b22 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:b8:a2,bridge_name='br-int',has_traffic_filtering=True,id=82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf,network=Network(e1afe3b3-a919-4800-9f1c-c8e602defd4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82eff0a4-60')
Apr 12 12:59:30 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-6c229c8d-76bd-4433-95e7-b2cec87c9b22 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Deleting instance files /opt/stack/data/nova/instances/9ebf6f6b-3940-40fa-9a20-a28a957961e2_del
Apr 12 12:59:30 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-6c229c8d-76bd-4433-95e7-b2cec87c9b22 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Deletion of /opt/stack/data/nova/instances/9ebf6f6b-3940-40fa-9a20-a28a957961e2_del complete
Apr 12 12:59:30 user nova-compute[71321]: INFO nova.compute.manager [None req-6c229c8d-76bd-4433-95e7-b2cec87c9b22 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 12 12:59:30 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-6c229c8d-76bd-4433-95e7-b2cec87c9b22 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 12:59:30 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 12:59:30 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 12:59:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:30 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:59:30 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Took 0.78 seconds to deallocate network for instance.
Apr 12 12:59:31 user nova-compute[71321]: DEBUG nova.compute.manager [req-1163c2ca-f479-4bf8-854b-437d5c62e650 req-ef9ff857-91ba-4860-9ad5-72ebb555dc4f service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Received event network-vif-deleted-82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:59:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-6c229c8d-76bd-4433-95e7-b2cec87c9b22 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:59:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-6c229c8d-76bd-4433-95e7-b2cec87c9b22 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:59:31 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-6c229c8d-76bd-4433-95e7-b2cec87c9b22 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:59:31 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-6c229c8d-76bd-4433-95e7-b2cec87c9b22 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:59:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-6c229c8d-76bd-4433-95e7-b2cec87c9b22 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.191s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:59:31 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-6c229c8d-76bd-4433-95e7-b2cec87c9b22 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Deleted allocations for instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2
Apr 12 12:59:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-6c229c8d-76bd-4433-95e7-b2cec87c9b22 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.057s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:59:31 user nova-compute[71321]: DEBUG nova.compute.manager [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Received event network-vif-plugged-82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:59:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] Acquiring lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:59:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] Lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:59:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] Lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:59:31 user nova-compute[71321]: DEBUG nova.compute.manager [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] No waiting events found dispatching network-vif-plugged-82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:59:31 user nova-compute[71321]: WARNING nova.compute.manager [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Received unexpected event network-vif-plugged-82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf for instance with vm_state deleted and task_state None.
Apr 12 12:59:31 user nova-compute[71321]: DEBUG nova.compute.manager [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Received event network-vif-plugged-82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:59:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] Acquiring lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:59:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] Lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:59:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] Lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:59:31 user nova-compute[71321]: DEBUG nova.compute.manager [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] No waiting events found dispatching network-vif-plugged-82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:59:31 user nova-compute[71321]: WARNING nova.compute.manager [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Received unexpected event network-vif-plugged-82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf for instance with vm_state deleted and task_state None.
Apr 12 12:59:31 user nova-compute[71321]: DEBUG nova.compute.manager [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Received event network-vif-plugged-82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:59:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] Acquiring lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:59:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] Lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:59:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] Lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:59:31 user nova-compute[71321]: DEBUG nova.compute.manager [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] No waiting events found dispatching network-vif-plugged-82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:59:31 user nova-compute[71321]: WARNING nova.compute.manager [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Received unexpected event network-vif-plugged-82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf for instance with vm_state deleted and task_state None.
Apr 12 12:59:31 user nova-compute[71321]: DEBUG nova.compute.manager [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Received event network-vif-unplugged-82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:59:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] Acquiring lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:59:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] Lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:59:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] Lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:59:31 user nova-compute[71321]: DEBUG nova.compute.manager [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] No waiting events found dispatching network-vif-unplugged-82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:59:31 user nova-compute[71321]: WARNING nova.compute.manager [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Received unexpected event network-vif-unplugged-82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf for instance with vm_state deleted and task_state None.
Apr 12 12:59:31 user nova-compute[71321]: DEBUG nova.compute.manager [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Received event network-vif-plugged-82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:59:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] Acquiring lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:59:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] Lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:59:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] Lock "9ebf6f6b-3940-40fa-9a20-a28a957961e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:59:31 user nova-compute[71321]: DEBUG nova.compute.manager [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] No waiting events found dispatching network-vif-plugged-82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:59:31 user nova-compute[71321]: WARNING nova.compute.manager [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Received unexpected event network-vif-plugged-82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf for instance with vm_state deleted and task_state None.
Apr 12 12:59:33 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681304358.2752793, 88c7dd97-0390-4b2b-b803-7ab023366fd4 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:59:33 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] VM Stopped (Lifecycle Event)
Apr 12 12:59:33 user nova-compute[71321]: DEBUG nova.compute.manager [None req-73245e95-9088-47da-81ea-ad8c72749b12 None None] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:59:34 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:59:34 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:59:34 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71321) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 12:59:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:35 user nova-compute[71321]: DEBUG nova.compute.manager [req-cee72fbc-345d-40d3-a961-cbd449e8cb59 req-0f0160fd-d5c7-4db4-8f1f-8888da22f0a0 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Received event network-changed-7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:59:35 user nova-compute[71321]: DEBUG nova.compute.manager [req-cee72fbc-345d-40d3-a961-cbd449e8cb59 req-0f0160fd-d5c7-4db4-8f1f-8888da22f0a0 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Refreshing instance network info cache due to event network-changed-7103abd2-88c5-437a-9661-64ca6379a130. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:59:35 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-cee72fbc-345d-40d3-a961-cbd449e8cb59 req-0f0160fd-d5c7-4db4-8f1f-8888da22f0a0 service nova] Acquiring lock "refresh_cache-a73a4b87-a9a8-4b01-af1f-4b2a64554b54" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:59:35 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-cee72fbc-345d-40d3-a961-cbd449e8cb59 req-0f0160fd-d5c7-4db4-8f1f-8888da22f0a0 service nova] Acquired lock "refresh_cache-a73a4b87-a9a8-4b01-af1f-4b2a64554b54" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:59:35 user nova-compute[71321]: DEBUG nova.network.neutron [req-cee72fbc-345d-40d3-a961-cbd449e8cb59 req-0f0160fd-d5c7-4db4-8f1f-8888da22f0a0 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Refreshing network info cache for port 7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:59:35 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:59:35 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:59:35 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:59:35 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:59:35 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 12:59:35 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:59:35 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38198e86-bd23-4196-98a0-79455206305f/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:35 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38198e86-bd23-4196-98a0-79455206305f/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:35 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38198e86-bd23-4196-98a0-79455206305f/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:35 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38198e86-bd23-4196-98a0-79455206305f/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:35 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG nova.compute.manager [req-db5b6430-efec-413c-a988-b1e7197703ad req-2735dc04-8082-4982-b5f1-10e9589ad6c4 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Received event network-changed-7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG nova.compute.manager [req-db5b6430-efec-413c-a988-b1e7197703ad req-2735dc04-8082-4982-b5f1-10e9589ad6c4 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Refreshing instance network info cache due to event network-changed-7103abd2-88c5-437a-9661-64ca6379a130. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-db5b6430-efec-413c-a988-b1e7197703ad req-2735dc04-8082-4982-b5f1-10e9589ad6c4 service nova] Acquiring lock "refresh_cache-a73a4b87-a9a8-4b01-af1f-4b2a64554b54" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:59:36 user nova-compute[71321]: INFO nova.compute.manager [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Detaching volume 5d5655e9-ab41-4361-a57b-817e42037463
Apr 12 12:59:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG nova.network.neutron [req-cee72fbc-345d-40d3-a961-cbd449e8cb59 req-0f0160fd-d5c7-4db4-8f1f-8888da22f0a0 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Updated VIF entry in instance network info cache for port 7103abd2-88c5-437a-9661-64ca6379a130. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG nova.network.neutron [req-cee72fbc-345d-40d3-a961-cbd449e8cb59 req-0f0160fd-d5c7-4db4-8f1f-8888da22f0a0 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Updating instance_info_cache with network_info: [{"id": "7103abd2-88c5-437a-9661-64ca6379a130", "address": "fa:16:3e:48:0a:10", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7103abd2-88", "ovs_interfaceid": "7103abd2-88c5-437a-9661-64ca6379a130", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:59:36 user nova-compute[71321]: INFO nova.virt.block_device [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Attempting to driver detach volume 5d5655e9-ab41-4361-a57b-817e42037463 from mountpoint /dev/vdb
Apr 12 12:59:36 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Attempting to detach device vdb from instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 from the persistent domain config. {{(pid=71321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:59:36 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:59:36 user nova-compute[71321]:   <source dev="/dev/sdc"/>
Apr 12 12:59:36 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:59:36 user nova-compute[71321]:   <serial>5d5655e9-ab41-4361-a57b-817e42037463</serial>
Apr 12 12:59:36 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 12:59:36 user nova-compute[71321]: </disk>
Apr 12 12:59:36 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-cee72fbc-345d-40d3-a961-cbd449e8cb59 req-0f0160fd-d5c7-4db4-8f1f-8888da22f0a0 service nova] Releasing lock "refresh_cache-a73a4b87-a9a8-4b01-af1f-4b2a64554b54" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-db5b6430-efec-413c-a988-b1e7197703ad req-2735dc04-8082-4982-b5f1-10e9589ad6c4 service nova] Acquired lock "refresh_cache-a73a4b87-a9a8-4b01-af1f-4b2a64554b54" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG nova.network.neutron [req-db5b6430-efec-413c-a988-b1e7197703ad req-2735dc04-8082-4982-b5f1-10e9589ad6c4 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Refreshing network info cache for port 7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 12:59:36 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Successfully detached device vdb from instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 from the persistent domain config.
Apr 12 12:59:36 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 from the live domain config. {{(pid=71321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 12:59:36 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 12:59:36 user nova-compute[71321]:   <source dev="/dev/sdc"/>
Apr 12 12:59:36 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 12:59:36 user nova-compute[71321]:   <serial>5d5655e9-ab41-4361-a57b-817e42037463</serial>
Apr 12 12:59:36 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 12:59:36 user nova-compute[71321]: </disk>
Apr 12 12:59:36 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:36 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:59:36 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 12:59:36 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8454MB free_disk=26.211788177490234GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Received event <DeviceRemovedEvent: 1681304376.8896067, a73a4b87-a9a8-4b01-af1f-4b2a64554b54 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 {{(pid=71321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 12:59:36 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Successfully detached device vdb from instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 from the live domain config.
Apr 12 12:59:36 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJoAIzpk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 12:59:36 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 12:59:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[584720b4-3e73-4557-8a9d-33d8fd39635a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 12:59:36 user nova-compute[71321]: No targets found.
Apr 12 12:59:36 user nova-compute[71321]: iSNS:
Apr 12 12:59:36 user nova-compute[71321]: No targets found.
Apr 12 12:59:36 user nova-compute[71321]: STATIC:
Apr 12 12:59:36 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463
Apr 12 12:59:36 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:59:36 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:59:36 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2
Apr 12 12:59:36 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 12:59:36 user nova-compute[71321]:                 Iface Name: default
Apr 12 12:59:36 user nova-compute[71321]: FIRMWARE:
Apr 12 12:59:36 user nova-compute[71321]: No targets found.
Apr 12 12:59:36 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 12:59:36 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 12:59:36 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb918530-827d-47e5-b77a-385050ee7d10]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 38198e86-bd23-4196-98a0-79455206305f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fbed47-3595-4be3-b52f-740d74c890a5]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 12:59:36 user nova-compute[71321]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)
Apr 12 12:59:36 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 12:59:36 user nova-compute[71321]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 (non-flash)
Apr 12 12:59:36 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef442e05e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463'): ({'sdc'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Removing single pathed devices sdc {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 12:59:36 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[777c16be-3898-439b-b2af-09bba58bd848]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[665c3f89-02be-4f4e-9d74-118b644a7b74]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Flushing IO for device /dev/sdc {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c48a1d-152c-44da-8769-c991b067dad9]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[273c016d-246d-4af5-8da4-59410979ebc3]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] SCSI volumes sdc have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0997a6c-87fb-445f-85fd-5c574fcef690]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bfa2a7-6276-4616-8beb-9d623abc085d]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463, portal: 172.16.0.220,3260]
Apr 12 12:59:37 user nova-compute[71321]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463, portal: 172.16.0.220,3260] successful.
Apr 12 12:59:37 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d5655e9-ab41-4361-a57b-817e42037463 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2665aa78-1efb-4bfa-b6ac-b67b4d8050a5]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] <== disconnect_volume: return (310ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG nova.network.neutron [req-db5b6430-efec-413c-a988-b1e7197703ad req-2735dc04-8082-4982-b5f1-10e9589ad6c4 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Updated VIF entry in instance network info cache for port 7103abd2-88c5-437a-9661-64ca6379a130. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG nova.network.neutron [req-db5b6430-efec-413c-a988-b1e7197703ad req-2735dc04-8082-4982-b5f1-10e9589ad6c4 service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Updating instance_info_cache with network_info: [{"id": "7103abd2-88c5-437a-9661-64ca6379a130", "address": "fa:16:3e:48:0a:10", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7103abd2-88", "ovs_interfaceid": "7103abd2-88c5-437a-9661-64ca6379a130", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-db5b6430-efec-413c-a988-b1e7197703ad req-2735dc04-8082-4982-b5f1-10e9589ad6c4 service nova] Releasing lock "refresh_cache-a73a4b87-a9a8-4b01-af1f-4b2a64554b54" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:59:37 user nova-compute[71321]: DEBUG nova.objects.instance [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lazy-loading 'flavor' on Instance uuid a73a4b87-a9a8-4b01-af1f-4b2a64554b54 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:59:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.788s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:59:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:41 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:59:41 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 12:59:41 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:59:44 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:59:44 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:59:44 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 12:59:44 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Didn't find any instances for network info cache update. {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 12:59:44 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:59:45 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681304370.077444, 9ebf6f6b-3940-40fa-9a20-a28a957961e2 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 12:59:45 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] VM Stopped (Lifecycle Event)
Apr 12 12:59:45 user nova-compute[71321]: DEBUG nova.compute.manager [None req-5cd6eb06-4e9f-4f11-9e2e-0699f72a22bf None None] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 12:59:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:46 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:59:48 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:59:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 12:59:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 12:59:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 12:59:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 12:59:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:55 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:59:55 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Cleaning up deleted instances {{(pid=71321) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 12:59:55 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] There are 0 instances to clean {{(pid=71321) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 12:59:56 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 12:59:58 user nova-compute[71321]: INFO nova.compute.manager [None req-cb1a8d58-04c3-46fb-857f-5503f045bf64 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Unrescuing
Apr 12 12:59:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-cb1a8d58-04c3-46fb-857f-5503f045bf64 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "refresh_cache-38198e86-bd23-4196-98a0-79455206305f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 12:59:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-cb1a8d58-04c3-46fb-857f-5503f045bf64 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquired lock "refresh_cache-38198e86-bd23-4196-98a0-79455206305f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 12:59:58 user nova-compute[71321]: DEBUG nova.network.neutron [None req-cb1a8d58-04c3-46fb-857f-5503f045bf64 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 12:59:59 user nova-compute[71321]: DEBUG nova.network.neutron [None req-cb1a8d58-04c3-46fb-857f-5503f045bf64 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Updating instance_info_cache with network_info: [{"id": "5621687b-5d0b-47f7-b11c-a24c403a590a", "address": "fa:16:3e:0e:91:7d", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621687b-5d", "ovs_interfaceid": "5621687b-5d0b-47f7-b11c-a24c403a590a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 12:59:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-cb1a8d58-04c3-46fb-857f-5503f045bf64 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Releasing lock "refresh_cache-38198e86-bd23-4196-98a0-79455206305f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 12:59:59 user nova-compute[71321]: DEBUG nova.objects.instance [None req-cb1a8d58-04c3-46fb-857f-5503f045bf64 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lazy-loading 'flavor' on Instance uuid 38198e86-bd23-4196-98a0-79455206305f {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 12:59:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:59 user nova-compute[71321]: DEBUG nova.compute.manager [req-9e0f056b-bf03-40c4-a1c0-c02e05ef99c0 req-51dcfe4b-737f-4504-a757-5762466db247 service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] Received event network-vif-unplugged-5621687b-5d0b-47f7-b11c-a24c403a590a {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 12:59:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9e0f056b-bf03-40c4-a1c0-c02e05ef99c0 req-51dcfe4b-737f-4504-a757-5762466db247 service nova] Acquiring lock "38198e86-bd23-4196-98a0-79455206305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 12:59:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9e0f056b-bf03-40c4-a1c0-c02e05ef99c0 req-51dcfe4b-737f-4504-a757-5762466db247 service nova] Lock "38198e86-bd23-4196-98a0-79455206305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 12:59:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9e0f056b-bf03-40c4-a1c0-c02e05ef99c0 req-51dcfe4b-737f-4504-a757-5762466db247 service nova] Lock "38198e86-bd23-4196-98a0-79455206305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 12:59:59 user nova-compute[71321]: DEBUG nova.compute.manager [req-9e0f056b-bf03-40c4-a1c0-c02e05ef99c0 req-51dcfe4b-737f-4504-a757-5762466db247 service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] No waiting events found dispatching network-vif-unplugged-5621687b-5d0b-47f7-b11c-a24c403a590a {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 12:59:59 user nova-compute[71321]: WARNING nova.compute.manager [req-9e0f056b-bf03-40c4-a1c0-c02e05ef99c0 req-51dcfe4b-737f-4504-a757-5762466db247 service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] Received unexpected event network-vif-unplugged-5621687b-5d0b-47f7-b11c-a24c403a590a for instance with vm_state rescued and task_state unrescuing.
Apr 12 12:59:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 12:59:59 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 38198e86-bd23-4196-98a0-79455206305f] Instance destroyed successfully.
Apr 12 13:00:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:00:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:00:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:00:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:00:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:00:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:00:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:00:01 user nova-compute[71321]: DEBUG nova.compute.manager [req-d91aa903-5183-4383-8d4e-dd386c93e75a req-3424ce6d-8c2f-47cf-a395-771421c44eac service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] Received event network-vif-plugged-5621687b-5d0b-47f7-b11c-a24c403a590a {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:00:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d91aa903-5183-4383-8d4e-dd386c93e75a req-3424ce6d-8c2f-47cf-a395-771421c44eac service nova] Acquiring lock "38198e86-bd23-4196-98a0-79455206305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:00:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d91aa903-5183-4383-8d4e-dd386c93e75a req-3424ce6d-8c2f-47cf-a395-771421c44eac service nova] Lock "38198e86-bd23-4196-98a0-79455206305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:00:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d91aa903-5183-4383-8d4e-dd386c93e75a req-3424ce6d-8c2f-47cf-a395-771421c44eac service nova] Lock "38198e86-bd23-4196-98a0-79455206305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:00:01 user nova-compute[71321]: DEBUG nova.compute.manager [req-d91aa903-5183-4383-8d4e-dd386c93e75a req-3424ce6d-8c2f-47cf-a395-771421c44eac service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] No waiting events found dispatching network-vif-plugged-5621687b-5d0b-47f7-b11c-a24c403a590a {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:00:01 user nova-compute[71321]: WARNING nova.compute.manager [req-d91aa903-5183-4383-8d4e-dd386c93e75a req-3424ce6d-8c2f-47cf-a395-771421c44eac service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] Received unexpected event network-vif-plugged-5621687b-5d0b-47f7-b11c-a24c403a590a for instance with vm_state rescued and task_state unrescuing.
Apr 12 13:00:01 user nova-compute[71321]: DEBUG nova.compute.manager [req-d91aa903-5183-4383-8d4e-dd386c93e75a req-3424ce6d-8c2f-47cf-a395-771421c44eac service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] Received event network-vif-plugged-5621687b-5d0b-47f7-b11c-a24c403a590a {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:00:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d91aa903-5183-4383-8d4e-dd386c93e75a req-3424ce6d-8c2f-47cf-a395-771421c44eac service nova] Acquiring lock "38198e86-bd23-4196-98a0-79455206305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:00:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d91aa903-5183-4383-8d4e-dd386c93e75a req-3424ce6d-8c2f-47cf-a395-771421c44eac service nova] Lock "38198e86-bd23-4196-98a0-79455206305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:00:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d91aa903-5183-4383-8d4e-dd386c93e75a req-3424ce6d-8c2f-47cf-a395-771421c44eac service nova] Lock "38198e86-bd23-4196-98a0-79455206305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:00:01 user nova-compute[71321]: DEBUG nova.compute.manager [req-d91aa903-5183-4383-8d4e-dd386c93e75a req-3424ce6d-8c2f-47cf-a395-771421c44eac service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] No waiting events found dispatching network-vif-plugged-5621687b-5d0b-47f7-b11c-a24c403a590a {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:00:01 user nova-compute[71321]: WARNING nova.compute.manager [req-d91aa903-5183-4383-8d4e-dd386c93e75a req-3424ce6d-8c2f-47cf-a395-771421c44eac service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] Received unexpected event network-vif-plugged-5621687b-5d0b-47f7-b11c-a24c403a590a for instance with vm_state rescued and task_state unrescuing.
Apr 12 13:00:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Removed pending event for 38198e86-bd23-4196-98a0-79455206305f due to event {{(pid=71321) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 13:00:03 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681304403.296244, 38198e86-bd23-4196-98a0-79455206305f => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 13:00:03 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] VM Resumed (Lifecycle Event)
Apr 12 13:00:03 user nova-compute[71321]: DEBUG nova.compute.manager [None req-cb1a8d58-04c3-46fb-857f-5503f045bf64 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 13:00:03 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 13:00:03 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 13:00:03 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 13:00:03 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681304403.2977605, 38198e86-bd23-4196-98a0-79455206305f => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 13:00:03 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] VM Started (Lifecycle Event)
Apr 12 13:00:03 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 13:00:03 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 13:00:03 user nova-compute[71321]: DEBUG nova.compute.manager [req-b481a3af-810d-4778-84ee-f4cf5c1e0a4e req-25dc917d-4683-4fbd-bee1-7eb1dc147174 service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] Received event network-vif-plugged-5621687b-5d0b-47f7-b11c-a24c403a590a {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:00:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b481a3af-810d-4778-84ee-f4cf5c1e0a4e req-25dc917d-4683-4fbd-bee1-7eb1dc147174 service nova] Acquiring lock "38198e86-bd23-4196-98a0-79455206305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:00:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b481a3af-810d-4778-84ee-f4cf5c1e0a4e req-25dc917d-4683-4fbd-bee1-7eb1dc147174 service nova] Lock "38198e86-bd23-4196-98a0-79455206305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:00:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b481a3af-810d-4778-84ee-f4cf5c1e0a4e req-25dc917d-4683-4fbd-bee1-7eb1dc147174 service nova] Lock "38198e86-bd23-4196-98a0-79455206305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:00:03 user nova-compute[71321]: DEBUG nova.compute.manager [req-b481a3af-810d-4778-84ee-f4cf5c1e0a4e req-25dc917d-4683-4fbd-bee1-7eb1dc147174 service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] No waiting events found dispatching network-vif-plugged-5621687b-5d0b-47f7-b11c-a24c403a590a {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:00:03 user nova-compute[71321]: WARNING nova.compute.manager [req-b481a3af-810d-4778-84ee-f4cf5c1e0a4e req-25dc917d-4683-4fbd-bee1-7eb1dc147174 service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] Received unexpected event network-vif-plugged-5621687b-5d0b-47f7-b11c-a24c403a590a for instance with vm_state active and task_state None.
Apr 12 13:00:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:00:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:00:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:00:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:00:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:00:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:00:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:00:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:00:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:00:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:00:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:00:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:00:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:00:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:00:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:00:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:00:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-1ad415e2-4c83-4278-9676-18d76d1622f4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:00:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-1ad415e2-4c83-4278-9676-18d76d1622f4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:00:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-1ad415e2-4c83-4278-9676-18d76d1622f4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:00:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-1ad415e2-4c83-4278-9676-18d76d1622f4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:00:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-1ad415e2-4c83-4278-9676-18d76d1622f4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:00:31 user nova-compute[71321]: INFO nova.compute.manager [None req-1ad415e2-4c83-4278-9676-18d76d1622f4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Terminating instance
Apr 12 13:00:31 user nova-compute[71321]: DEBUG nova.compute.manager [None req-1ad415e2-4c83-4278-9676-18d76d1622f4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 13:00:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:00:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:00:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:00:31 user nova-compute[71321]: DEBUG nova.compute.manager [req-e9747f61-0c0f-4e51-8ad6-0c8f6927127a req-2d62c821-f115-4f05-8465-4a137fe89bfe service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Received event network-vif-unplugged-7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:00:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e9747f61-0c0f-4e51-8ad6-0c8f6927127a req-2d62c821-f115-4f05-8465-4a137fe89bfe service nova] Acquiring lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:00:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e9747f61-0c0f-4e51-8ad6-0c8f6927127a req-2d62c821-f115-4f05-8465-4a137fe89bfe service nova] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:00:31 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-e9747f61-0c0f-4e51-8ad6-0c8f6927127a req-2d62c821-f115-4f05-8465-4a137fe89bfe service nova] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:00:31 user nova-compute[71321]: DEBUG nova.compute.manager [req-e9747f61-0c0f-4e51-8ad6-0c8f6927127a req-2d62c821-f115-4f05-8465-4a137fe89bfe service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] No waiting events found dispatching network-vif-unplugged-7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:00:31 user nova-compute[71321]: DEBUG nova.compute.manager [req-e9747f61-0c0f-4e51-8ad6-0c8f6927127a req-2d62c821-f115-4f05-8465-4a137fe89bfe service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Received event network-vif-unplugged-7103abd2-88c5-437a-9661-64ca6379a130 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 13:00:31 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Instance destroyed successfully.
Apr 12 13:00:31 user nova-compute[71321]: DEBUG nova.objects.instance [None req-1ad415e2-4c83-4278-9676-18d76d1622f4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lazy-loading 'resources' on Instance uuid a73a4b87-a9a8-4b01-af1f-4b2a64554b54 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:00:31 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-1ad415e2-4c83-4278-9676-18d76d1622f4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:55:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-976781852',display_name='tempest-TestMinimumBasicScenario-server-976781852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-976781852',id=39,image_ref='f4fa635a-1809-4235-81a6-a8a97e8cf13c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYCqWk/TodEqXsFi9a7cw3/KtXFhdAQR1LawDDCKO0HiyA4rhVlzn+IXohB9sc83lFxQA8eJtIOy2mHpy8PwlgJxikvBMjWpAvkMzRpwgQMaxEEQSVlwbt2ix9mDjAByw==',key_name='tempest-TestMinimumBasicScenario-1710707159',keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:55:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f411f36f23e464fa4a395ad6b2b4472',ramdisk_id='',reservation_id='r-3wtg7ztk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f4fa635a-1809-4235-81a6-a8a97e8cf13c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-381334085',owner_user_name='tempest-TestMinimumBasicScenario-381334085-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:57:51Z,user_data=None,user_id='924c3a968d734a1c9ddfc5a44d8f6352',uuid=a73a4b87-a9a8-4b01-af1f-4b2a64554b54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7103abd2-88c5-437a-9661-64ca6379a130", "address": "fa:16:3e:48:0a:10", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7103abd2-88", "ovs_interfaceid": "7103abd2-88c5-437a-9661-64ca6379a130", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 13:00:31 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-1ad415e2-4c83-4278-9676-18d76d1622f4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Converting VIF {"id": "7103abd2-88c5-437a-9661-64ca6379a130", "address": "fa:16:3e:48:0a:10", "network": {"id": "76f8fc2b-41cf-4efd-9820-c4d4056deaca", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1215860089-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f411f36f23e464fa4a395ad6b2b4472", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7103abd2-88", "ovs_interfaceid": "7103abd2-88c5-437a-9661-64ca6379a130", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 13:00:31 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-1ad415e2-4c83-4278-9676-18d76d1622f4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:0a:10,bridge_name='br-int',has_traffic_filtering=True,id=7103abd2-88c5-437a-9661-64ca6379a130,network=Network(76f8fc2b-41cf-4efd-9820-c4d4056deaca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7103abd2-88') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 13:00:31 user nova-compute[71321]: DEBUG os_vif [None req-1ad415e2-4c83-4278-9676-18d76d1622f4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:0a:10,bridge_name='br-int',has_traffic_filtering=True,id=7103abd2-88c5-437a-9661-64ca6379a130,network=Network(76f8fc2b-41cf-4efd-9820-c4d4056deaca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7103abd2-88') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 13:00:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:00:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7103abd2-88, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 13:00:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:00:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:00:31 user nova-compute[71321]: INFO os_vif [None req-1ad415e2-4c83-4278-9676-18d76d1622f4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:0a:10,bridge_name='br-int',has_traffic_filtering=True,id=7103abd2-88c5-437a-9661-64ca6379a130,network=Network(76f8fc2b-41cf-4efd-9820-c4d4056deaca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7103abd2-88')
Apr 12 13:00:31 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-1ad415e2-4c83-4278-9676-18d76d1622f4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Deleting instance files /opt/stack/data/nova/instances/a73a4b87-a9a8-4b01-af1f-4b2a64554b54_del
Apr 12 13:00:31 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-1ad415e2-4c83-4278-9676-18d76d1622f4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Deletion of /opt/stack/data/nova/instances/a73a4b87-a9a8-4b01-af1f-4b2a64554b54_del complete
Apr 12 13:00:32 user nova-compute[71321]: INFO nova.compute.manager [None req-1ad415e2-4c83-4278-9676-18d76d1622f4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 12 13:00:32 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-1ad415e2-4c83-4278-9676-18d76d1622f4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 13:00:32 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 13:00:32 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 13:00:32 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:00:32 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Took 0.47 seconds to deallocate network for instance.
Apr 12 13:00:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-1ad415e2-4c83-4278-9676-18d76d1622f4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:00:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-1ad415e2-4c83-4278-9676-18d76d1622f4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:00:32 user nova-compute[71321]: DEBUG nova.compute.manager [req-4839fd6e-dbc1-4972-a826-977423808e60 req-b08f41ba-90ca-4baa-a302-0b012415da5b service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Received event network-vif-deleted-7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:00:32 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-1ad415e2-4c83-4278-9676-18d76d1622f4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 13:00:32 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-1ad415e2-4c83-4278-9676-18d76d1622f4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 13:00:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-1ad415e2-4c83-4278-9676-18d76d1622f4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:00:32 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-1ad415e2-4c83-4278-9676-18d76d1622f4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Deleted allocations for instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54
Apr 12 13:00:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-1ad415e2-4c83-4278-9676-18d76d1622f4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.954s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:00:33 user nova-compute[71321]: DEBUG nova.compute.manager [req-da89f338-e904-49a5-a52e-2a9c48f301ec req-5e73fc5a-e93a-4770-941e-80d2e978836e service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Received event network-vif-plugged-7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:00:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-da89f338-e904-49a5-a52e-2a9c48f301ec req-5e73fc5a-e93a-4770-941e-80d2e978836e service nova] Acquiring lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:00:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-da89f338-e904-49a5-a52e-2a9c48f301ec req-5e73fc5a-e93a-4770-941e-80d2e978836e service nova] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:00:33 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-da89f338-e904-49a5-a52e-2a9c48f301ec req-5e73fc5a-e93a-4770-941e-80d2e978836e service nova] Lock "a73a4b87-a9a8-4b01-af1f-4b2a64554b54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:00:33 user nova-compute[71321]: DEBUG nova.compute.manager [req-da89f338-e904-49a5-a52e-2a9c48f301ec req-5e73fc5a-e93a-4770-941e-80d2e978836e service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] No waiting events found dispatching network-vif-plugged-7103abd2-88c5-437a-9661-64ca6379a130 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:00:33 user nova-compute[71321]: WARNING nova.compute.manager [req-da89f338-e904-49a5-a52e-2a9c48f301ec req-5e73fc5a-e93a-4770-941e-80d2e978836e service nova] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Received unexpected event network-vif-plugged-7103abd2-88c5-437a-9661-64ca6379a130 for instance with vm_state deleted and task_state None.
Apr 12 13:00:34 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:00:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:00:37 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:00:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:00:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:00:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:00:37 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 13:00:37 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 13:00:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:00:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:00:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:00:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:00:38 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:00:38 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:00:38 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8613MB free_disk=26.220767974853516GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 13:00:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:00:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:00:38 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:00:38 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 38198e86-bd23-4196-98a0-79455206305f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:00:38 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 13:00:38 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 13:00:38 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Refreshing inventories for resource provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 13:00:38 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Updating ProviderTree inventory for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 13:00:38 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Updating inventory in ProviderTree for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 13:00:38 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Refreshing aggregate associations for resource provider 7ca624fd-d5cc-42af-93e3-9d62256fa231, aggregates: None {{(pid=71321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 13:00:38 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Refreshing trait associations for resource provider 7ca624fd-d5cc-42af-93e3-9d62256fa231, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=71321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 13:00:38 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 13:00:38 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 13:00:38 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 13:00:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.351s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:00:41 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:00:42 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:00:42 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:00:42 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 13:00:44 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:00:44 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:00:45 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:00:45 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:00:45 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 13:00:45 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Rebuilding the list of instances to heal {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 13:00:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 13:00:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 13:00:45 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 13:00:45 user nova-compute[71321]: DEBUG nova.objects.instance [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lazy-loading 'info_cache' on Instance uuid e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:00:46 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Updating instance_info_cache with network_info: [{"id": "9f228391-1910-4bd3-b317-f1afa3e98a0f", "address": "fa:16:3e:bf:a8:a8", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f228391-19", "ovs_interfaceid": "9f228391-1910-4bd3-b317-f1afa3e98a0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:00:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 13:00:46 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 13:00:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:00:46 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681304431.882903, a73a4b87-a9a8-4b01-af1f-4b2a64554b54 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 13:00:46 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] VM Stopped (Lifecycle Event)
Apr 12 13:00:46 user nova-compute[71321]: DEBUG nova.compute.manager [None req-210129c7-c86b-4c31-8634-3f3391648c4d None None] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 13:00:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:00:47 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:00:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:00:49 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:00:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:00:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:00:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:00:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:00:56 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:00:56 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "e47cf07b-9759-4350-9e10-bd5bb15678f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:01:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "e47cf07b-9759-4350-9e10-bd5bb15678f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:01:00 user nova-compute[71321]: DEBUG nova.compute.manager [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 13:01:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:01:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:01:00 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 13:01:00 user nova-compute[71321]: INFO nova.compute.claims [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Claim successful on node user
Apr 12 13:01:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:00 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 13:01:00 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 13:01:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.243s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:01:01 user nova-compute[71321]: DEBUG nova.compute.manager [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 13:01:01 user nova-compute[71321]: DEBUG nova.compute.manager [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 13:01:01 user nova-compute[71321]: DEBUG nova.network.neutron [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 13:01:01 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 13:01:01 user nova-compute[71321]: DEBUG nova.compute.manager [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 13:01:01 user nova-compute[71321]: DEBUG nova.policy [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc5b75e437444fe4a54c1516964f0cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51e624010914d7680080956cbb0c720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 13:01:01 user nova-compute[71321]: DEBUG nova.compute.manager [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 13:01:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 13:01:01 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Creating image(s)
Apr 12 13:01:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "/opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:01:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "/opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:01:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "/opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.031s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:01:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:01:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.151s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:01:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:01:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:01:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:01:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.142s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:01:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:01:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk 1073741824" returned: 0 in 0.068s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:01:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:01:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:01:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.141s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:01:01 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 13:01:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:01:01 user nova-compute[71321]: DEBUG nova.network.neutron [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Successfully created port: 2f2f437b-b72e-4842-9047-36ee6e17bf9b {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 13:01:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:01 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:01:01 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Cannot resize image /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 13:01:01 user nova-compute[71321]: DEBUG nova.objects.instance [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lazy-loading 'migration_context' on Instance uuid e47cf07b-9759-4350-9e10-bd5bb15678f3 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:01:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 13:01:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Ensure instance console log exists: /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 13:01:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:01:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:01:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG nova.network.neutron [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Successfully updated port: 2f2f437b-b72e-4842-9047-36ee6e17bf9b {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "refresh_cache-e47cf07b-9759-4350-9e10-bd5bb15678f3" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquired lock "refresh_cache-e47cf07b-9759-4350-9e10-bd5bb15678f3" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG nova.network.neutron [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG nova.compute.manager [req-d9a35ceb-d029-475f-9cc9-77371acad84a req-16528f63-3c0d-4050-8a72-91c3a9d595c6 service nova] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Received event network-changed-2f2f437b-b72e-4842-9047-36ee6e17bf9b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG nova.compute.manager [req-d9a35ceb-d029-475f-9cc9-77371acad84a req-16528f63-3c0d-4050-8a72-91c3a9d595c6 service nova] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Refreshing instance network info cache due to event network-changed-2f2f437b-b72e-4842-9047-36ee6e17bf9b. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d9a35ceb-d029-475f-9cc9-77371acad84a req-16528f63-3c0d-4050-8a72-91c3a9d595c6 service nova] Acquiring lock "refresh_cache-e47cf07b-9759-4350-9e10-bd5bb15678f3" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG nova.network.neutron [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG nova.network.neutron [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Updating instance_info_cache with network_info: [{"id": "2f2f437b-b72e-4842-9047-36ee6e17bf9b", "address": "fa:16:3e:15:a4:ec", "network": {"id": "f7ac30df-76aa-400e-868d-9ad902bd9446", "bridge": "br-int", "label": "tempest-TestStampPattern-423905686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51e624010914d7680080956cbb0c720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2f437b-b7", "ovs_interfaceid": "2f2f437b-b72e-4842-9047-36ee6e17bf9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Releasing lock "refresh_cache-e47cf07b-9759-4350-9e10-bd5bb15678f3" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG nova.compute.manager [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Instance network_info: |[{"id": "2f2f437b-b72e-4842-9047-36ee6e17bf9b", "address": "fa:16:3e:15:a4:ec", "network": {"id": "f7ac30df-76aa-400e-868d-9ad902bd9446", "bridge": "br-int", "label": "tempest-TestStampPattern-423905686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51e624010914d7680080956cbb0c720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2f437b-b7", "ovs_interfaceid": "2f2f437b-b72e-4842-9047-36ee6e17bf9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d9a35ceb-d029-475f-9cc9-77371acad84a req-16528f63-3c0d-4050-8a72-91c3a9d595c6 service nova] Acquired lock "refresh_cache-e47cf07b-9759-4350-9e10-bd5bb15678f3" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG nova.network.neutron [req-d9a35ceb-d029-475f-9cc9-77371acad84a req-16528f63-3c0d-4050-8a72-91c3a9d595c6 service nova] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Refreshing network info cache for port 2f2f437b-b72e-4842-9047-36ee6e17bf9b {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Start _get_guest_xml network_info=[{"id": "2f2f437b-b72e-4842-9047-36ee6e17bf9b", "address": "fa:16:3e:15:a4:ec", "network": {"id": "f7ac30df-76aa-400e-868d-9ad902bd9446", "bridge": "br-int", "label": "tempest-TestStampPattern-423905686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51e624010914d7680080956cbb0c720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2f437b-b7", "ovs_interfaceid": "2f2f437b-b72e-4842-9047-36ee6e17bf9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 13:01:03 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:01:03 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:01:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T13:01:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-335893625',display_name='tempest-TestStampPattern-server-335893625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-335893625',id=43,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4/5v3eCbyqn1cBjTbTlpYaNU+pu9bnoXsJrgMiEn/z8xxIi9MkvXpvfk3KhnFx+XRfpoIpI1zKXf4THCFNpnfEDB0Wv8SQLcFxbpIn7/+LQHs5b/5vFRKuB/DiXoVA+A==',key_name='tempest-TestStampPattern-193639278',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f51e624010914d7680080956cbb0c720',ramdisk_id='',reservation_id='r-e90ihgwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1801373189',owner_user_name='tempest-TestStampPattern-1801373189-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T13:01:01Z,user_data=None,user_id='bc5b75e437444fe4a54c1516964f0cfa',uuid=e47cf07b-9759-4350-9e10-bd5bb15678f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f2f437b-b72e-4842-9047-36ee6e17bf9b", "address": "fa:16:3e:15:a4:ec", "network": {"id": "f7ac30df-76aa-400e-868d-9ad902bd9446", "bridge": "br-int", "label": "tempest-TestStampPattern-423905686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51e624010914d7680080956cbb0c720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2f437b-b7", "ovs_interfaceid": "2f2f437b-b72e-4842-9047-36ee6e17bf9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Converting VIF {"id": "2f2f437b-b72e-4842-9047-36ee6e17bf9b", "address": "fa:16:3e:15:a4:ec", "network": {"id": "f7ac30df-76aa-400e-868d-9ad902bd9446", "bridge": "br-int", "label": "tempest-TestStampPattern-423905686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51e624010914d7680080956cbb0c720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2f437b-b7", "ovs_interfaceid": "2f2f437b-b72e-4842-9047-36ee6e17bf9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:a4:ec,bridge_name='br-int',has_traffic_filtering=True,id=2f2f437b-b72e-4842-9047-36ee6e17bf9b,network=Network(f7ac30df-76aa-400e-868d-9ad902bd9446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2f437b-b7') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG nova.objects.instance [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lazy-loading 'pci_devices' on Instance uuid e47cf07b-9759-4350-9e10-bd5bb15678f3 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] End _get_guest_xml xml=<domain type="kvm">
Apr 12 13:01:03 user nova-compute[71321]:   <uuid>e47cf07b-9759-4350-9e10-bd5bb15678f3</uuid>
Apr 12 13:01:03 user nova-compute[71321]:   <name>instance-0000002b</name>
Apr 12 13:01:03 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 13:01:03 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 13:01:03 user nova-compute[71321]:   <metadata>
Apr 12 13:01:03 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 13:01:03 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 13:01:03 user nova-compute[71321]:       <nova:name>tempest-TestStampPattern-server-335893625</nova:name>
Apr 12 13:01:03 user nova-compute[71321]:       <nova:creationTime>2023-04-12 13:01:03</nova:creationTime>
Apr 12 13:01:03 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 13:01:03 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 13:01:03 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 13:01:03 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 13:01:03 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 13:01:03 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 13:01:03 user nova-compute[71321]:       </nova:flavor>
Apr 12 13:01:03 user nova-compute[71321]:       <nova:owner>
Apr 12 13:01:03 user nova-compute[71321]:         <nova:user uuid="bc5b75e437444fe4a54c1516964f0cfa">tempest-TestStampPattern-1801373189-project-member</nova:user>
Apr 12 13:01:03 user nova-compute[71321]:         <nova:project uuid="f51e624010914d7680080956cbb0c720">tempest-TestStampPattern-1801373189</nova:project>
Apr 12 13:01:03 user nova-compute[71321]:       </nova:owner>
Apr 12 13:01:03 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 13:01:03 user nova-compute[71321]:       <nova:ports>
Apr 12 13:01:03 user nova-compute[71321]:         <nova:port uuid="2f2f437b-b72e-4842-9047-36ee6e17bf9b">
Apr 12 13:01:03 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 13:01:03 user nova-compute[71321]:         </nova:port>
Apr 12 13:01:03 user nova-compute[71321]:       </nova:ports>
Apr 12 13:01:03 user nova-compute[71321]:     </nova:instance>
Apr 12 13:01:03 user nova-compute[71321]:   </metadata>
Apr 12 13:01:03 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 13:01:03 user nova-compute[71321]:     <system>
Apr 12 13:01:03 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 13:01:03 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 13:01:03 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 13:01:03 user nova-compute[71321]:       <entry name="serial">e47cf07b-9759-4350-9e10-bd5bb15678f3</entry>
Apr 12 13:01:03 user nova-compute[71321]:       <entry name="uuid">e47cf07b-9759-4350-9e10-bd5bb15678f3</entry>
Apr 12 13:01:03 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 13:01:03 user nova-compute[71321]:     </system>
Apr 12 13:01:03 user nova-compute[71321]:   </sysinfo>
Apr 12 13:01:03 user nova-compute[71321]:   <os>
Apr 12 13:01:03 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 13:01:03 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 13:01:03 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 13:01:03 user nova-compute[71321]:   </os>
Apr 12 13:01:03 user nova-compute[71321]:   <features>
Apr 12 13:01:03 user nova-compute[71321]:     <acpi/>
Apr 12 13:01:03 user nova-compute[71321]:     <apic/>
Apr 12 13:01:03 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 13:01:03 user nova-compute[71321]:   </features>
Apr 12 13:01:03 user nova-compute[71321]:   <clock offset="utc">
Apr 12 13:01:03 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 13:01:03 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 13:01:03 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 13:01:03 user nova-compute[71321]:   </clock>
Apr 12 13:01:03 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 13:01:03 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 13:01:03 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 13:01:03 user nova-compute[71321]:   </cpu>
Apr 12 13:01:03 user nova-compute[71321]:   <devices>
Apr 12 13:01:03 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 13:01:03 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 13:01:03 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk"/>
Apr 12 13:01:03 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 13:01:03 user nova-compute[71321]:     </disk>
Apr 12 13:01:03 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 13:01:03 user nova-compute[71321]:       <mac address="fa:16:3e:15:a4:ec"/>
Apr 12 13:01:03 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 13:01:03 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 13:01:03 user nova-compute[71321]:       <target dev="tap2f2f437b-b7"/>
Apr 12 13:01:03 user nova-compute[71321]:     </interface>
Apr 12 13:01:03 user nova-compute[71321]:     <serial type="pty">
Apr 12 13:01:03 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/console.log" append="off"/>
Apr 12 13:01:03 user nova-compute[71321]:     </serial>
Apr 12 13:01:03 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 13:01:03 user nova-compute[71321]:     <video>
Apr 12 13:01:03 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 13:01:03 user nova-compute[71321]:     </video>
Apr 12 13:01:03 user nova-compute[71321]:     <rng model="virtio">
Apr 12 13:01:03 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 13:01:03 user nova-compute[71321]:     </rng>
Apr 12 13:01:03 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 13:01:03 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 13:01:03 user nova-compute[71321]:       <stats period="10"/>
Apr 12 13:01:03 user nova-compute[71321]:     </memballoon>
Apr 12 13:01:03 user nova-compute[71321]:   </devices>
Apr 12 13:01:03 user nova-compute[71321]: </domain>
Apr 12 13:01:03 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T13:01:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-335893625',display_name='tempest-TestStampPattern-server-335893625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-335893625',id=43,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4/5v3eCbyqn1cBjTbTlpYaNU+pu9bnoXsJrgMiEn/z8xxIi9MkvXpvfk3KhnFx+XRfpoIpI1zKXf4THCFNpnfEDB0Wv8SQLcFxbpIn7/+LQHs5b/5vFRKuB/DiXoVA+A==',key_name='tempest-TestStampPattern-193639278',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f51e624010914d7680080956cbb0c720',ramdisk_id='',reservation_id='r-e90ihgwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1801373189',owner_user_name='tempest-TestStampPattern-1801373189-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T13:01:01Z,user_data=None,user_id='bc5b75e437444fe4a54c1516964f0cfa',uuid=e47cf07b-9759-4350-9e10-bd5bb15678f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f2f437b-b72e-4842-9047-36ee6e17bf9b", "address": "fa:16:3e:15:a4:ec", "network": {"id": "f7ac30df-76aa-400e-868d-9ad902bd9446", "bridge": "br-int", "label": "tempest-TestStampPattern-423905686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51e624010914d7680080956cbb0c720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2f437b-b7", "ovs_interfaceid": "2f2f437b-b72e-4842-9047-36ee6e17bf9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Converting VIF {"id": "2f2f437b-b72e-4842-9047-36ee6e17bf9b", "address": "fa:16:3e:15:a4:ec", "network": {"id": "f7ac30df-76aa-400e-868d-9ad902bd9446", "bridge": "br-int", "label": "tempest-TestStampPattern-423905686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51e624010914d7680080956cbb0c720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2f437b-b7", "ovs_interfaceid": "2f2f437b-b72e-4842-9047-36ee6e17bf9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:a4:ec,bridge_name='br-int',has_traffic_filtering=True,id=2f2f437b-b72e-4842-9047-36ee6e17bf9b,network=Network(f7ac30df-76aa-400e-868d-9ad902bd9446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2f437b-b7') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG os_vif [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:a4:ec,bridge_name='br-int',has_traffic_filtering=True,id=2f2f437b-b72e-4842-9047-36ee6e17bf9b,network=Network(f7ac30df-76aa-400e-868d-9ad902bd9446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2f437b-b7') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f2f437b-b7, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2f2f437b-b7, col_values=(('external_ids', {'iface-id': '2f2f437b-b72e-4842-9047-36ee6e17bf9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:a4:ec', 'vm-uuid': 'e47cf07b-9759-4350-9e10-bd5bb15678f3'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:03 user nova-compute[71321]: INFO os_vif [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:a4:ec,bridge_name='br-int',has_traffic_filtering=True,id=2f2f437b-b72e-4842-9047-36ee6e17bf9b,network=Network(f7ac30df-76aa-400e-868d-9ad902bd9446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2f437b-b7')
Apr 12 13:01:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] No VIF found with MAC fa:16:3e:15:a4:ec, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG nova.network.neutron [req-d9a35ceb-d029-475f-9cc9-77371acad84a req-16528f63-3c0d-4050-8a72-91c3a9d595c6 service nova] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Updated VIF entry in instance network info cache for port 2f2f437b-b72e-4842-9047-36ee6e17bf9b. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG nova.network.neutron [req-d9a35ceb-d029-475f-9cc9-77371acad84a req-16528f63-3c0d-4050-8a72-91c3a9d595c6 service nova] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Updating instance_info_cache with network_info: [{"id": "2f2f437b-b72e-4842-9047-36ee6e17bf9b", "address": "fa:16:3e:15:a4:ec", "network": {"id": "f7ac30df-76aa-400e-868d-9ad902bd9446", "bridge": "br-int", "label": "tempest-TestStampPattern-423905686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51e624010914d7680080956cbb0c720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2f437b-b7", "ovs_interfaceid": "2f2f437b-b72e-4842-9047-36ee6e17bf9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:01:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d9a35ceb-d029-475f-9cc9-77371acad84a req-16528f63-3c0d-4050-8a72-91c3a9d595c6 service nova] Releasing lock "refresh_cache-e47cf07b-9759-4350-9e10-bd5bb15678f3" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 13:01:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:05 user nova-compute[71321]: DEBUG nova.compute.manager [req-dfe94422-ac2e-49d7-8280-028d0017ff25 req-9f717bc2-57bc-4d95-b6d8-17931d786518 service nova] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Received event network-vif-plugged-2f2f437b-b72e-4842-9047-36ee6e17bf9b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:01:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-dfe94422-ac2e-49d7-8280-028d0017ff25 req-9f717bc2-57bc-4d95-b6d8-17931d786518 service nova] Acquiring lock "e47cf07b-9759-4350-9e10-bd5bb15678f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:01:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-dfe94422-ac2e-49d7-8280-028d0017ff25 req-9f717bc2-57bc-4d95-b6d8-17931d786518 service nova] Lock "e47cf07b-9759-4350-9e10-bd5bb15678f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:01:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-dfe94422-ac2e-49d7-8280-028d0017ff25 req-9f717bc2-57bc-4d95-b6d8-17931d786518 service nova] Lock "e47cf07b-9759-4350-9e10-bd5bb15678f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:01:05 user nova-compute[71321]: DEBUG nova.compute.manager [req-dfe94422-ac2e-49d7-8280-028d0017ff25 req-9f717bc2-57bc-4d95-b6d8-17931d786518 service nova] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] No waiting events found dispatching network-vif-plugged-2f2f437b-b72e-4842-9047-36ee6e17bf9b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:01:05 user nova-compute[71321]: WARNING nova.compute.manager [req-dfe94422-ac2e-49d7-8280-028d0017ff25 req-9f717bc2-57bc-4d95-b6d8-17931d786518 service nova] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Received unexpected event network-vif-plugged-2f2f437b-b72e-4842-9047-36ee6e17bf9b for instance with vm_state building and task_state spawning.
Apr 12 13:01:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:06 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681304466.8924131, e47cf07b-9759-4350-9e10-bd5bb15678f3 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 13:01:06 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] VM Resumed (Lifecycle Event)
Apr 12 13:01:06 user nova-compute[71321]: DEBUG nova.compute.manager [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 13:01:06 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 13:01:06 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Instance spawned successfully.
Apr 12 13:01:06 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 13:01:06 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 13:01:06 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 13:01:06 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 13:01:06 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 13:01:06 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 13:01:06 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 13:01:06 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 13:01:06 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 13:01:06 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 13:01:06 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681304466.8937304, e47cf07b-9759-4350-9e10-bd5bb15678f3 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 13:01:06 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] VM Started (Lifecycle Event)
Apr 12 13:01:06 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 13:01:06 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 13:01:06 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 13:01:06 user nova-compute[71321]: INFO nova.compute.manager [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Took 5.77 seconds to spawn the instance on the hypervisor.
Apr 12 13:01:06 user nova-compute[71321]: DEBUG nova.compute.manager [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 13:01:07 user nova-compute[71321]: INFO nova.compute.manager [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Took 6.35 seconds to build instance.
Apr 12 13:01:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "e47cf07b-9759-4350-9e10-bd5bb15678f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.443s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:01:07 user nova-compute[71321]: DEBUG nova.compute.manager [req-3402a939-9ccb-4aca-a01a-b0f3028d84ed req-9c1f4452-bd74-431c-9a3a-1f87e0f14c6c service nova] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Received event network-vif-plugged-2f2f437b-b72e-4842-9047-36ee6e17bf9b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:01:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3402a939-9ccb-4aca-a01a-b0f3028d84ed req-9c1f4452-bd74-431c-9a3a-1f87e0f14c6c service nova] Acquiring lock "e47cf07b-9759-4350-9e10-bd5bb15678f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:01:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3402a939-9ccb-4aca-a01a-b0f3028d84ed req-9c1f4452-bd74-431c-9a3a-1f87e0f14c6c service nova] Lock "e47cf07b-9759-4350-9e10-bd5bb15678f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:01:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3402a939-9ccb-4aca-a01a-b0f3028d84ed req-9c1f4452-bd74-431c-9a3a-1f87e0f14c6c service nova] Lock "e47cf07b-9759-4350-9e10-bd5bb15678f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:01:07 user nova-compute[71321]: DEBUG nova.compute.manager [req-3402a939-9ccb-4aca-a01a-b0f3028d84ed req-9c1f4452-bd74-431c-9a3a-1f87e0f14c6c service nova] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] No waiting events found dispatching network-vif-plugged-2f2f437b-b72e-4842-9047-36ee6e17bf9b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:01:07 user nova-compute[71321]: WARNING nova.compute.manager [req-3402a939-9ccb-4aca-a01a-b0f3028d84ed req-9c1f4452-bd74-431c-9a3a-1f87e0f14c6c service nova] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Received unexpected event network-vif-plugged-2f2f437b-b72e-4842-9047-36ee6e17bf9b for instance with vm_state active and task_state None.
Apr 12 13:01:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:13 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:01:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:23 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:24 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:27 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:28 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:28 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:33 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:01:33 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:01:33 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:01:33 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:01:33 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:01:33 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:35 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:01:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:37 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:01:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:01:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:01:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:01:37 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 13:01:37 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 13:01:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:01:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:01:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:01:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:01:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:01:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:01:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:01:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:01:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:38 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:01:38 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:01:38 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8541MB free_disk=26.21087646484375GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 13:01:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:01:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:01:38 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:01:38 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 38198e86-bd23-4196-98a0-79455206305f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:01:38 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance e47cf07b-9759-4350-9e10-bd5bb15678f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:01:38 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 13:01:38 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 13:01:38 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 13:01:38 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 13:01:39 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 13:01:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.474s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:01:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:01:45 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:01:45 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:01:45 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:01:45 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 13:01:45 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:01:46 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:01:46 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 13:01:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-38198e86-bd23-4196-98a0-79455206305f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 13:01:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-38198e86-bd23-4196-98a0-79455206305f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 13:01:46 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 13:01:46 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] Updating instance_info_cache with network_info: [{"id": "5621687b-5d0b-47f7-b11c-a24c403a590a", "address": "fa:16:3e:0e:91:7d", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621687b-5d", "ovs_interfaceid": "5621687b-5d0b-47f7-b11c-a24c403a590a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:01:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-38198e86-bd23-4196-98a0-79455206305f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 13:01:47 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 13:01:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:49 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:01:49 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:01:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "acd99758-64c1-4852-b906-e5f941868a8e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:01:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "acd99758-64c1-4852-b906-e5f941868a8e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:01:50 user nova-compute[71321]: DEBUG nova.compute.manager [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 13:01:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:01:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:01:50 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 13:01:50 user nova-compute[71321]: INFO nova.compute.claims [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Claim successful on node user
Apr 12 13:01:50 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 13:01:50 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 13:01:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.262s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:01:50 user nova-compute[71321]: DEBUG nova.compute.manager [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 13:01:50 user nova-compute[71321]: DEBUG nova.compute.manager [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 13:01:50 user nova-compute[71321]: DEBUG nova.network.neutron [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 13:01:50 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 13:01:50 user nova-compute[71321]: DEBUG nova.compute.manager [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 13:01:50 user nova-compute[71321]: DEBUG nova.policy [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 13:01:50 user nova-compute[71321]: DEBUG nova.compute.manager [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 13:01:50 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 13:01:50 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Creating image(s)
Apr 12 13:01:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "/opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:01:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "/opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:01:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "/opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:01:50 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:01:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.138s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:01:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:01:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:01:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:01:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.139s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:01:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:01:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk 1073741824" returned: 0 in 0.053s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:01:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:01:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:01:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.140s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:01:51 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Checking if we can resize image /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 13:01:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:01:51 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:01:51 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Cannot resize image /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 13:01:51 user nova-compute[71321]: DEBUG nova.objects.instance [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lazy-loading 'migration_context' on Instance uuid acd99758-64c1-4852-b906-e5f941868a8e {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:01:51 user nova-compute[71321]: DEBUG nova.network.neutron [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Successfully created port: 6afd3a74-bd8e-488e-be66-9f25ef4dce8d {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 13:01:51 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 13:01:51 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Ensure instance console log exists: /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 13:01:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:01:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:01:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG nova.network.neutron [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Successfully updated port: 6afd3a74-bd8e-488e-be66-9f25ef4dce8d {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "refresh_cache-acd99758-64c1-4852-b906-e5f941868a8e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquired lock "refresh_cache-acd99758-64c1-4852-b906-e5f941868a8e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG nova.network.neutron [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG nova.compute.manager [req-a15fc3ea-8c77-4117-983f-bcefe9a7aa88 req-c5b6b8d7-e0c5-4125-92d6-1144bdec4ef3 service nova] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Received event network-changed-6afd3a74-bd8e-488e-be66-9f25ef4dce8d {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG nova.compute.manager [req-a15fc3ea-8c77-4117-983f-bcefe9a7aa88 req-c5b6b8d7-e0c5-4125-92d6-1144bdec4ef3 service nova] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Refreshing instance network info cache due to event network-changed-6afd3a74-bd8e-488e-be66-9f25ef4dce8d. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a15fc3ea-8c77-4117-983f-bcefe9a7aa88 req-c5b6b8d7-e0c5-4125-92d6-1144bdec4ef3 service nova] Acquiring lock "refresh_cache-acd99758-64c1-4852-b906-e5f941868a8e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG nova.network.neutron [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG nova.network.neutron [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Updating instance_info_cache with network_info: [{"id": "6afd3a74-bd8e-488e-be66-9f25ef4dce8d", "address": "fa:16:3e:f3:14:cc", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afd3a74-bd", "ovs_interfaceid": "6afd3a74-bd8e-488e-be66-9f25ef4dce8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Releasing lock "refresh_cache-acd99758-64c1-4852-b906-e5f941868a8e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG nova.compute.manager [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Instance network_info: |[{"id": "6afd3a74-bd8e-488e-be66-9f25ef4dce8d", "address": "fa:16:3e:f3:14:cc", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afd3a74-bd", "ovs_interfaceid": "6afd3a74-bd8e-488e-be66-9f25ef4dce8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a15fc3ea-8c77-4117-983f-bcefe9a7aa88 req-c5b6b8d7-e0c5-4125-92d6-1144bdec4ef3 service nova] Acquired lock "refresh_cache-acd99758-64c1-4852-b906-e5f941868a8e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG nova.network.neutron [req-a15fc3ea-8c77-4117-983f-bcefe9a7aa88 req-c5b6b8d7-e0c5-4125-92d6-1144bdec4ef3 service nova] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Refreshing network info cache for port 6afd3a74-bd8e-488e-be66-9f25ef4dce8d {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Start _get_guest_xml network_info=[{"id": "6afd3a74-bd8e-488e-be66-9f25ef4dce8d", "address": "fa:16:3e:f3:14:cc", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afd3a74-bd", "ovs_interfaceid": "6afd3a74-bd8e-488e-be66-9f25ef4dce8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 13:01:52 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:01:52 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:01:52 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T13:01:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-339222954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-339222954',id=44,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f20ad21427a04683b9b102d2ff0290a5',ramdisk_id='',reservation_id='r-ez458jpy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-636247513',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T13:01:51Z,user_data=None,user_id='435e0d6fd2b3437f837e82730b4d955f',uuid=acd99758-64c1-4852-b906-e5f941868a8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6afd3a74-bd8e-488e-be66-9f25ef4dce8d", "address": "fa:16:3e:f3:14:cc", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afd3a74-bd", "ovs_interfaceid": "6afd3a74-bd8e-488e-be66-9f25ef4dce8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Converting VIF {"id": "6afd3a74-bd8e-488e-be66-9f25ef4dce8d", "address": "fa:16:3e:f3:14:cc", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afd3a74-bd", "ovs_interfaceid": "6afd3a74-bd8e-488e-be66-9f25ef4dce8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:14:cc,bridge_name='br-int',has_traffic_filtering=True,id=6afd3a74-bd8e-488e-be66-9f25ef4dce8d,network=Network(bb52f82e-56ca-41f7-b171-a3cacb549ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afd3a74-bd') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG nova.objects.instance [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lazy-loading 'pci_devices' on Instance uuid acd99758-64c1-4852-b906-e5f941868a8e {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] End _get_guest_xml xml=<domain type="kvm">
Apr 12 13:01:52 user nova-compute[71321]:   <uuid>acd99758-64c1-4852-b906-e5f941868a8e</uuid>
Apr 12 13:01:52 user nova-compute[71321]:   <name>instance-0000002c</name>
Apr 12 13:01:52 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 13:01:52 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 13:01:52 user nova-compute[71321]:   <metadata>
Apr 12 13:01:52 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 13:01:52 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 13:01:52 user nova-compute[71321]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-339222954</nova:name>
Apr 12 13:01:52 user nova-compute[71321]:       <nova:creationTime>2023-04-12 13:01:52</nova:creationTime>
Apr 12 13:01:52 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 13:01:52 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 13:01:52 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 13:01:52 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 13:01:52 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 13:01:52 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 13:01:52 user nova-compute[71321]:       </nova:flavor>
Apr 12 13:01:52 user nova-compute[71321]:       <nova:owner>
Apr 12 13:01:52 user nova-compute[71321]:         <nova:user uuid="435e0d6fd2b3437f837e82730b4d955f">tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member</nova:user>
Apr 12 13:01:52 user nova-compute[71321]:         <nova:project uuid="f20ad21427a04683b9b102d2ff0290a5">tempest-ServerBootFromVolumeStableRescueTest-636247513</nova:project>
Apr 12 13:01:52 user nova-compute[71321]:       </nova:owner>
Apr 12 13:01:52 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 13:01:52 user nova-compute[71321]:       <nova:ports>
Apr 12 13:01:52 user nova-compute[71321]:         <nova:port uuid="6afd3a74-bd8e-488e-be66-9f25ef4dce8d">
Apr 12 13:01:52 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 13:01:52 user nova-compute[71321]:         </nova:port>
Apr 12 13:01:52 user nova-compute[71321]:       </nova:ports>
Apr 12 13:01:52 user nova-compute[71321]:     </nova:instance>
Apr 12 13:01:52 user nova-compute[71321]:   </metadata>
Apr 12 13:01:52 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 13:01:52 user nova-compute[71321]:     <system>
Apr 12 13:01:52 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 13:01:52 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 13:01:52 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 13:01:52 user nova-compute[71321]:       <entry name="serial">acd99758-64c1-4852-b906-e5f941868a8e</entry>
Apr 12 13:01:52 user nova-compute[71321]:       <entry name="uuid">acd99758-64c1-4852-b906-e5f941868a8e</entry>
Apr 12 13:01:52 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 13:01:52 user nova-compute[71321]:     </system>
Apr 12 13:01:52 user nova-compute[71321]:   </sysinfo>
Apr 12 13:01:52 user nova-compute[71321]:   <os>
Apr 12 13:01:52 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 13:01:52 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 13:01:52 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 13:01:52 user nova-compute[71321]:   </os>
Apr 12 13:01:52 user nova-compute[71321]:   <features>
Apr 12 13:01:52 user nova-compute[71321]:     <acpi/>
Apr 12 13:01:52 user nova-compute[71321]:     <apic/>
Apr 12 13:01:52 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 13:01:52 user nova-compute[71321]:   </features>
Apr 12 13:01:52 user nova-compute[71321]:   <clock offset="utc">
Apr 12 13:01:52 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 13:01:52 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 13:01:52 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 13:01:52 user nova-compute[71321]:   </clock>
Apr 12 13:01:52 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 13:01:52 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 13:01:52 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 13:01:52 user nova-compute[71321]:   </cpu>
Apr 12 13:01:52 user nova-compute[71321]:   <devices>
Apr 12 13:01:52 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 13:01:52 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 13:01:52 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk"/>
Apr 12 13:01:52 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 13:01:52 user nova-compute[71321]:     </disk>
Apr 12 13:01:52 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 13:01:52 user nova-compute[71321]:       <mac address="fa:16:3e:f3:14:cc"/>
Apr 12 13:01:52 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 13:01:52 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 13:01:52 user nova-compute[71321]:       <target dev="tap6afd3a74-bd"/>
Apr 12 13:01:52 user nova-compute[71321]:     </interface>
Apr 12 13:01:52 user nova-compute[71321]:     <serial type="pty">
Apr 12 13:01:52 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/console.log" append="off"/>
Apr 12 13:01:52 user nova-compute[71321]:     </serial>
Apr 12 13:01:52 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 13:01:52 user nova-compute[71321]:     <video>
Apr 12 13:01:52 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 13:01:52 user nova-compute[71321]:     </video>
Apr 12 13:01:52 user nova-compute[71321]:     <rng model="virtio">
Apr 12 13:01:52 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 13:01:52 user nova-compute[71321]:     </rng>
Apr 12 13:01:52 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 13:01:52 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 13:01:52 user nova-compute[71321]:       <stats period="10"/>
Apr 12 13:01:52 user nova-compute[71321]:     </memballoon>
Apr 12 13:01:52 user nova-compute[71321]:   </devices>
Apr 12 13:01:52 user nova-compute[71321]: </domain>
Apr 12 13:01:52 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T13:01:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-339222954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-339222954',id=44,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f20ad21427a04683b9b102d2ff0290a5',ramdisk_id='',reservation_id='r-ez458jpy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-636247513',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T13:01:51Z,user_data=None,user_id='435e0d6fd2b3437f837e82730b4d955f',uuid=acd99758-64c1-4852-b906-e5f941868a8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6afd3a74-bd8e-488e-be66-9f25ef4dce8d", "address": "fa:16:3e:f3:14:cc", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afd3a74-bd", "ovs_interfaceid": "6afd3a74-bd8e-488e-be66-9f25ef4dce8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Converting VIF {"id": "6afd3a74-bd8e-488e-be66-9f25ef4dce8d", "address": "fa:16:3e:f3:14:cc", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afd3a74-bd", "ovs_interfaceid": "6afd3a74-bd8e-488e-be66-9f25ef4dce8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:14:cc,bridge_name='br-int',has_traffic_filtering=True,id=6afd3a74-bd8e-488e-be66-9f25ef4dce8d,network=Network(bb52f82e-56ca-41f7-b171-a3cacb549ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afd3a74-bd') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG os_vif [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:14:cc,bridge_name='br-int',has_traffic_filtering=True,id=6afd3a74-bd8e-488e-be66-9f25ef4dce8d,network=Network(bb52f82e-56ca-41f7-b171-a3cacb549ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afd3a74-bd') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6afd3a74-bd, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6afd3a74-bd, col_values=(('external_ids', {'iface-id': '6afd3a74-bd8e-488e-be66-9f25ef4dce8d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:14:cc', 'vm-uuid': 'acd99758-64c1-4852-b906-e5f941868a8e'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:52 user nova-compute[71321]: INFO os_vif [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:14:cc,bridge_name='br-int',has_traffic_filtering=True,id=6afd3a74-bd8e-488e-be66-9f25ef4dce8d,network=Network(bb52f82e-56ca-41f7-b171-a3cacb549ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afd3a74-bd')
Apr 12 13:01:52 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 13:01:52 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] No VIF found with MAC fa:16:3e:f3:14:cc, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 13:01:53 user nova-compute[71321]: DEBUG nova.network.neutron [req-a15fc3ea-8c77-4117-983f-bcefe9a7aa88 req-c5b6b8d7-e0c5-4125-92d6-1144bdec4ef3 service nova] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Updated VIF entry in instance network info cache for port 6afd3a74-bd8e-488e-be66-9f25ef4dce8d. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 13:01:53 user nova-compute[71321]: DEBUG nova.network.neutron [req-a15fc3ea-8c77-4117-983f-bcefe9a7aa88 req-c5b6b8d7-e0c5-4125-92d6-1144bdec4ef3 service nova] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Updating instance_info_cache with network_info: [{"id": "6afd3a74-bd8e-488e-be66-9f25ef4dce8d", "address": "fa:16:3e:f3:14:cc", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afd3a74-bd", "ovs_interfaceid": "6afd3a74-bd8e-488e-be66-9f25ef4dce8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:01:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a15fc3ea-8c77-4117-983f-bcefe9a7aa88 req-c5b6b8d7-e0c5-4125-92d6-1144bdec4ef3 service nova] Releasing lock "refresh_cache-acd99758-64c1-4852-b906-e5f941868a8e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 13:01:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:54 user nova-compute[71321]: DEBUG nova.compute.manager [req-d317d8bd-1cfb-4694-9a1e-abb48875383d req-eccc1fc5-6292-4728-981c-9054d1d1fb05 service nova] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Received event network-vif-plugged-6afd3a74-bd8e-488e-be66-9f25ef4dce8d {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:01:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d317d8bd-1cfb-4694-9a1e-abb48875383d req-eccc1fc5-6292-4728-981c-9054d1d1fb05 service nova] Acquiring lock "acd99758-64c1-4852-b906-e5f941868a8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:01:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d317d8bd-1cfb-4694-9a1e-abb48875383d req-eccc1fc5-6292-4728-981c-9054d1d1fb05 service nova] Lock "acd99758-64c1-4852-b906-e5f941868a8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:01:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d317d8bd-1cfb-4694-9a1e-abb48875383d req-eccc1fc5-6292-4728-981c-9054d1d1fb05 service nova] Lock "acd99758-64c1-4852-b906-e5f941868a8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:01:54 user nova-compute[71321]: DEBUG nova.compute.manager [req-d317d8bd-1cfb-4694-9a1e-abb48875383d req-eccc1fc5-6292-4728-981c-9054d1d1fb05 service nova] [instance: acd99758-64c1-4852-b906-e5f941868a8e] No waiting events found dispatching network-vif-plugged-6afd3a74-bd8e-488e-be66-9f25ef4dce8d {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:01:54 user nova-compute[71321]: WARNING nova.compute.manager [req-d317d8bd-1cfb-4694-9a1e-abb48875383d req-eccc1fc5-6292-4728-981c-9054d1d1fb05 service nova] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Received unexpected event network-vif-plugged-6afd3a74-bd8e-488e-be66-9f25ef4dce8d for instance with vm_state building and task_state spawning.
Apr 12 13:01:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:01:56 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681304516.1753848, acd99758-64c1-4852-b906-e5f941868a8e => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 13:01:56 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: acd99758-64c1-4852-b906-e5f941868a8e] VM Resumed (Lifecycle Event)
Apr 12 13:01:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 13:01:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 13:01:56 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Instance spawned successfully.
Apr 12 13:01:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 13:01:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 13:01:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 13:01:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 13:01:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 13:01:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 13:01:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 13:01:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 13:01:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 13:01:56 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: acd99758-64c1-4852-b906-e5f941868a8e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 13:01:56 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681304516.1771336, acd99758-64c1-4852-b906-e5f941868a8e => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 13:01:56 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: acd99758-64c1-4852-b906-e5f941868a8e] VM Started (Lifecycle Event)
Apr 12 13:01:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 13:01:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 13:01:56 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: acd99758-64c1-4852-b906-e5f941868a8e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 13:01:56 user nova-compute[71321]: INFO nova.compute.manager [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Took 5.38 seconds to spawn the instance on the hypervisor.
Apr 12 13:01:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 13:01:56 user nova-compute[71321]: INFO nova.compute.manager [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Took 5.94 seconds to build instance.
Apr 12 13:01:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "acd99758-64c1-4852-b906-e5f941868a8e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.037s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:01:56 user nova-compute[71321]: DEBUG nova.compute.manager [req-24d23e44-95e6-4392-82ab-b8f1e6cf6d30 req-ff6d8ac3-7921-42c5-b8b8-b3dc0300a152 service nova] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Received event network-vif-plugged-6afd3a74-bd8e-488e-be66-9f25ef4dce8d {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:01:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-24d23e44-95e6-4392-82ab-b8f1e6cf6d30 req-ff6d8ac3-7921-42c5-b8b8-b3dc0300a152 service nova] Acquiring lock "acd99758-64c1-4852-b906-e5f941868a8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:01:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-24d23e44-95e6-4392-82ab-b8f1e6cf6d30 req-ff6d8ac3-7921-42c5-b8b8-b3dc0300a152 service nova] Lock "acd99758-64c1-4852-b906-e5f941868a8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:01:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-24d23e44-95e6-4392-82ab-b8f1e6cf6d30 req-ff6d8ac3-7921-42c5-b8b8-b3dc0300a152 service nova] Lock "acd99758-64c1-4852-b906-e5f941868a8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:01:56 user nova-compute[71321]: DEBUG nova.compute.manager [req-24d23e44-95e6-4392-82ab-b8f1e6cf6d30 req-ff6d8ac3-7921-42c5-b8b8-b3dc0300a152 service nova] [instance: acd99758-64c1-4852-b906-e5f941868a8e] No waiting events found dispatching network-vif-plugged-6afd3a74-bd8e-488e-be66-9f25ef4dce8d {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:01:56 user nova-compute[71321]: WARNING nova.compute.manager [req-24d23e44-95e6-4392-82ab-b8f1e6cf6d30 req-ff6d8ac3-7921-42c5-b8b8-b3dc0300a152 service nova] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Received unexpected event network-vif-plugged-6afd3a74-bd8e-488e-be66-9f25ef4dce8d for instance with vm_state active and task_state None.
Apr 12 13:01:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:02:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:02:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:02:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:02:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:02:12 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:02:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:02:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:02:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:02:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:02:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:02:27 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:02:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:02:32 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:02:35 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:02:37 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:02:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:02:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:02:37 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:02:37 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 13:02:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:02:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:02:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:02:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:02:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:02:37 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 13:02:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:02:37 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:02:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:02:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:02:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:02:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:02:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:02:38 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:02:38 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:02:38 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:02:38 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8580MB free_disk=26.18932342529297GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 13:02:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:02:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:02:38 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:02:38 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 38198e86-bd23-4196-98a0-79455206305f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:02:38 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance e47cf07b-9759-4350-9e10-bd5bb15678f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:02:38 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance acd99758-64c1-4852-b906-e5f941868a8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:02:38 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 13:02:38 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 13:02:39 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 13:02:39 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 13:02:39 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 13:02:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.308s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:02:42 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:02:45 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:02:45 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 13:02:45 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:02:45 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:02:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:02:47 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:02:47 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:02:47 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 13:02:47 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Rebuilding the list of instances to heal {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 13:02:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 13:02:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 13:02:47 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 13:02:47 user nova-compute[71321]: DEBUG nova.objects.instance [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lazy-loading 'info_cache' on Instance uuid e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:02:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:02:47 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Updating instance_info_cache with network_info: [{"id": "9f228391-1910-4bd3-b317-f1afa3e98a0f", "address": "fa:16:3e:bf:a8:a8", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f228391-19", "ovs_interfaceid": "9f228391-1910-4bd3-b317-f1afa3e98a0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:02:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 13:02:48 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 13:02:49 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:02:49 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:02:49 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:02:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:02:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:02:52 user nova-compute[71321]: DEBUG nova.compute.manager [req-a2efd56b-87c9-4a05-ab9f-0d4f7b957ee8 req-1c23833f-5240-4c8f-820f-61dd1d9d583b service nova] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Received event network-changed-2f2f437b-b72e-4842-9047-36ee6e17bf9b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:02:52 user nova-compute[71321]: DEBUG nova.compute.manager [req-a2efd56b-87c9-4a05-ab9f-0d4f7b957ee8 req-1c23833f-5240-4c8f-820f-61dd1d9d583b service nova] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Refreshing instance network info cache due to event network-changed-2f2f437b-b72e-4842-9047-36ee6e17bf9b. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 13:02:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a2efd56b-87c9-4a05-ab9f-0d4f7b957ee8 req-1c23833f-5240-4c8f-820f-61dd1d9d583b service nova] Acquiring lock "refresh_cache-e47cf07b-9759-4350-9e10-bd5bb15678f3" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 13:02:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a2efd56b-87c9-4a05-ab9f-0d4f7b957ee8 req-1c23833f-5240-4c8f-820f-61dd1d9d583b service nova] Acquired lock "refresh_cache-e47cf07b-9759-4350-9e10-bd5bb15678f3" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 13:02:52 user nova-compute[71321]: DEBUG nova.network.neutron [req-a2efd56b-87c9-4a05-ab9f-0d4f7b957ee8 req-1c23833f-5240-4c8f-820f-61dd1d9d583b service nova] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Refreshing network info cache for port 2f2f437b-b72e-4842-9047-36ee6e17bf9b {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 13:02:53 user nova-compute[71321]: DEBUG nova.network.neutron [req-a2efd56b-87c9-4a05-ab9f-0d4f7b957ee8 req-1c23833f-5240-4c8f-820f-61dd1d9d583b service nova] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Updated VIF entry in instance network info cache for port 2f2f437b-b72e-4842-9047-36ee6e17bf9b. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 13:02:53 user nova-compute[71321]: DEBUG nova.network.neutron [req-a2efd56b-87c9-4a05-ab9f-0d4f7b957ee8 req-1c23833f-5240-4c8f-820f-61dd1d9d583b service nova] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Updating instance_info_cache with network_info: [{"id": "2f2f437b-b72e-4842-9047-36ee6e17bf9b", "address": "fa:16:3e:15:a4:ec", "network": {"id": "f7ac30df-76aa-400e-868d-9ad902bd9446", "bridge": "br-int", "label": "tempest-TestStampPattern-423905686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51e624010914d7680080956cbb0c720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2f437b-b7", "ovs_interfaceid": "2f2f437b-b72e-4842-9047-36ee6e17bf9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:02:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-a2efd56b-87c9-4a05-ab9f-0d4f7b957ee8 req-1c23833f-5240-4c8f-820f-61dd1d9d583b service nova] Releasing lock "refresh_cache-e47cf07b-9759-4350-9e10-bd5bb15678f3" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 13:02:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "e47cf07b-9759-4350-9e10-bd5bb15678f3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:02:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "e47cf07b-9759-4350-9e10-bd5bb15678f3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:02:53 user nova-compute[71321]: DEBUG nova.objects.instance [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lazy-loading 'flavor' on Instance uuid e47cf07b-9759-4350-9e10-bd5bb15678f3 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:02:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "e47cf07b-9759-4350-9e10-bd5bb15678f3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:02:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "e47cf07b-9759-4350-9e10-bd5bb15678f3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:02:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "e47cf07b-9759-4350-9e10-bd5bb15678f3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:02:54 user nova-compute[71321]: INFO nova.compute.manager [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Attaching volume 2c6757bb-c886-4df6-a70f-abdf3f611979 to /dev/vdb
Apr 12 13:02:54 user nova-compute[71321]: DEBUG os_brick.utils [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 13:02:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:02:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:02:54 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c5695b-193c-4154-988a-b42311ed6f6d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:02:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:02:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:02:54 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2c84f9-0b87-4360-904b-82fd8baecad3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:02:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:02:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:02:54 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cea0b03-ecea-45a0-a5c3-306012fe98a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:02:54 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79d4022-1eaa-4a91-9a64-8cf43e25fc55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:02:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:02:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 13:02:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 13:02:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:02:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 13:02:54 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 13:02:54 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[41211d37-6a8e-4570-85c5-2fab134206c6]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:02:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 13:02:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 13:02:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 13:02:54 user nova-compute[71321]: DEBUG os_brick.utils [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 13:02:54 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Updating existing volume attachment record: caaa84df-2b3b-4570-90ca-fa111aed0834 {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 13:02:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:02:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oHyPwenY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 13:02:58 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 13:02:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 13:02:58 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 13:02:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 13:02:58 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 13:02:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0520a34-4735-4f04-a1f5-b5166c4a2fd5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 13:02:58 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3eb037c-a0f8-47fe-8e47-909e4923570a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979] added
Apr 12 13:02:58 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f6450d-a42e-4c2e-b0d3-639c63916a4e]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6877620-2f11-4976-b7fe-e31e2f6ac61d]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oHyPwenY {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oHyPwenY" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6cf40b-aa89-4fe4-b60a-623aff67811c]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oHyPwenY'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7232b2c-6402-45fb-ae9c-85363791e3cf]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9c3e76-ce50-4b2a-8d51-4bbb4c5e62b5]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 13:02:58 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 13:02:58 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7cc892-6f48-448e-8d42-9e538d0577d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979, portal: 172.16.0.220,3260]
Apr 12 13:02:58 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979, portal: 172.16.0.220,3260] successful.
Apr 12 13:02:58 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e18d7d-6af1-44e2-ad19-98fd27dcc2c2]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b707825-1de3-42d6-addb-aa5ba3ee7c11]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 13:02:58 user nova-compute[71321]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979 (non-flash)
Apr 12 13:02:58 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 13:02:58 user nova-compute[71321]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979 (non-flash)
Apr 12 13:02:58 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b335b99-f7f6-4b22-b6a4-a2650ba13620]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 13:02:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oHyPwenY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 13:02:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 13:02:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23538363337653035', 'path': '/dev/sdc'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 13:02:59 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538363337653035', 'path': '/dev/sdc'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 13:02:59 user nova-compute[71321]: DEBUG nova.objects.instance [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lazy-loading 'flavor' on Instance uuid e47cf07b-9759-4350-9e10-bd5bb15678f3 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:02:59 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 13:02:59 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 13:02:59 user nova-compute[71321]:   <source dev="/dev/sdc"/>
Apr 12 13:02:59 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 13:02:59 user nova-compute[71321]:   <serial>2c6757bb-c886-4df6-a70f-abdf3f611979</serial>
Apr 12 13:02:59 user nova-compute[71321]: </disk>
Apr 12 13:02:59 user nova-compute[71321]:  {{(pid=71321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 13:03:00 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 13:03:00 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 13:03:00 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] No VIF found with MAC fa:16:3e:15:a4:ec, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 13:03:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "e47cf07b-9759-4350-9e10-bd5bb15678f3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.236s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:03:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:03:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "e47cf07b-9759-4350-9e10-bd5bb15678f3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:03:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "e47cf07b-9759-4350-9e10-bd5bb15678f3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:03:01 user nova-compute[71321]: INFO nova.compute.manager [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Detaching volume 2c6757bb-c886-4df6-a70f-abdf3f611979
Apr 12 13:03:01 user nova-compute[71321]: INFO nova.virt.block_device [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Attempting to driver detach volume 2c6757bb-c886-4df6-a70f-abdf3f611979 from mountpoint /dev/vdb
Apr 12 13:03:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Attempting to detach device vdb from instance e47cf07b-9759-4350-9e10-bd5bb15678f3 from the persistent domain config. {{(pid=71321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 13:03:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 13:03:01 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 13:03:01 user nova-compute[71321]:   <source dev="/dev/sdc"/>
Apr 12 13:03:01 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 13:03:01 user nova-compute[71321]:   <serial>2c6757bb-c886-4df6-a70f-abdf3f611979</serial>
Apr 12 13:03:01 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 13:03:01 user nova-compute[71321]: </disk>
Apr 12 13:03:01 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 13:03:01 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Successfully detached device vdb from instance e47cf07b-9759-4350-9e10-bd5bb15678f3 from the persistent domain config.
Apr 12 13:03:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e47cf07b-9759-4350-9e10-bd5bb15678f3 from the live domain config. {{(pid=71321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 13:03:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 13:03:01 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 13:03:01 user nova-compute[71321]:   <source dev="/dev/sdc"/>
Apr 12 13:03:01 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 13:03:01 user nova-compute[71321]:   <serial>2c6757bb-c886-4df6-a70f-abdf3f611979</serial>
Apr 12 13:03:01 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 13:03:01 user nova-compute[71321]: </disk>
Apr 12 13:03:01 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Received event <DeviceRemovedEvent: 1681304582.3606803, e47cf07b-9759-4350-9e10-bd5bb15678f3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e47cf07b-9759-4350-9e10-bd5bb15678f3 {{(pid=71321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 13:03:02 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Successfully detached device vdb from instance e47cf07b-9759-4350-9e10-bd5bb15678f3 from the live domain config.
Apr 12 13:03:02 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oHyPwenY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 13:03:02 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 13:03:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6a1810-6aae-475c-9a94-c82409821624]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 13:03:02 user nova-compute[71321]: No targets found.
Apr 12 13:03:02 user nova-compute[71321]: iSNS:
Apr 12 13:03:02 user nova-compute[71321]: No targets found.
Apr 12 13:03:02 user nova-compute[71321]: STATIC:
Apr 12 13:03:02 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979
Apr 12 13:03:02 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 13:03:02 user nova-compute[71321]:                 Iface Name: default
Apr 12 13:03:02 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2
Apr 12 13:03:02 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 13:03:02 user nova-compute[71321]:                 Iface Name: default
Apr 12 13:03:02 user nova-compute[71321]: FIRMWARE:
Apr 12 13:03:02 user nova-compute[71321]: No targets found.
Apr 12 13:03:02 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 13:03:02 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 13:03:02 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa5018c-e859-416a-bca1-ecd3b9874063]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2507a41e-0a52-4f5a-9c71-7e3021b9dc3d]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 13:03:02 user nova-compute[71321]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979 (non-flash)
Apr 12 13:03:02 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 13:03:02 user nova-compute[71321]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979 (non-flash)
Apr 12 13:03:02 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef4436acb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979'): ({'sdc'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Removing single pathed devices sdc {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c00733-9e09-4863-8d07-3e81b16bc5f9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a2639b-f9d9-44e3-931c-c085ddbc5462]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Flushing IO for device /dev/sdc {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[edab90bf-e551-422f-867c-b5e3367fbcd4]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6239c39b-73cf-4fdc-ae72-f9257cc78396]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] SCSI volumes sdc have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[068066dd-c7ca-4e68-a571-f939aedc1b06]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[05613812-ad6b-4d07-a4db-efa7e52d13ef]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979, portal: 172.16.0.220,3260]
Apr 12 13:03:02 user nova-compute[71321]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979, portal: 172.16.0.220,3260] successful.
Apr 12 13:03:02 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c6757bb-c886-4df6-a70f-abdf3f611979 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f968ab-b0e8-41c0-9203-d6f24784efa0]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] <== disconnect_volume: return (300ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 13:03:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:03:03 user nova-compute[71321]: DEBUG nova.objects.instance [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lazy-loading 'flavor' on Instance uuid e47cf07b-9759-4350-9e10-bd5bb15678f3 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:03:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "e47cf07b-9759-4350-9e10-bd5bb15678f3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.590s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:03:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:03:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:03:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:03:12 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:03:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:03:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:03:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:03:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:03:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:03:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:03:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:03:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:03:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:03:27 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:03:32 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:03:36 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:03:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:03:39 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:03:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:03:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:03:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:03:39 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 13:03:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:03:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:03:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:03:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:03:39 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 13:03:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:03:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:03:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:03:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:03:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:03:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:03:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:03:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:03:40 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:03:40 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:03:40 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8563MB free_disk=26.18820571899414GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 13:03:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:03:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:03:40 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:03:40 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 38198e86-bd23-4196-98a0-79455206305f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:03:40 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance e47cf07b-9759-4350-9e10-bd5bb15678f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:03:40 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance acd99758-64c1-4852-b906-e5f941868a8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:03:40 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 13:03:40 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 13:03:41 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 13:03:41 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 13:03:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 13:03:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:03:41 user nova-compute[71321]: DEBUG nova.compute.manager [None req-00a68046-7671-4168-b741-37d75ed4088a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 13:03:41 user nova-compute[71321]: INFO nova.compute.manager [None req-00a68046-7671-4168-b741-37d75ed4088a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] instance snapshotting
Apr 12 13:03:41 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-00a68046-7671-4168-b741-37d75ed4088a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Beginning live snapshot process
Apr 12 13:03:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-00a68046-7671-4168-b741-37d75ed4088a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json -f qcow2 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:03:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-00a68046-7671-4168-b741-37d75ed4088a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json -f qcow2" returned: 0 in 0.140s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:03:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-00a68046-7671-4168-b741-37d75ed4088a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json -f qcow2 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:03:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-00a68046-7671-4168-b741-37d75ed4088a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json -f qcow2" returned: 0 in 0.134s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:03:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-00a68046-7671-4168-b741-37d75ed4088a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:03:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-00a68046-7671-4168-b741-37d75ed4088a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.133s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:03:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-00a68046-7671-4168-b741-37d75ed4088a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkq2gg3i3/a44ec04d901241aba79d82743974e6a6.delta 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:03:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-00a68046-7671-4168-b741-37d75ed4088a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkq2gg3i3/a44ec04d901241aba79d82743974e6a6.delta 1073741824" returned: 0 in 0.070s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:03:42 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-00a68046-7671-4168-b741-37d75ed4088a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 12 13:03:42 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:03:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-00a68046-7671-4168-b741-37d75ed4088a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71321) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 13:03:43 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-00a68046-7671-4168-b741-37d75ed4088a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71321) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 13:03:43 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-00a68046-7671-4168-b741-37d75ed4088a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 12 13:03:43 user nova-compute[71321]: DEBUG nova.privsep.utils [None req-00a68046-7671-4168-b741-37d75ed4088a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 13:03:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-00a68046-7671-4168-b741-37d75ed4088a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkq2gg3i3/a44ec04d901241aba79d82743974e6a6.delta /opt/stack/data/nova/instances/snapshots/tmpkq2gg3i3/a44ec04d901241aba79d82743974e6a6 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:03:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-00a68046-7671-4168-b741-37d75ed4088a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkq2gg3i3/a44ec04d901241aba79d82743974e6a6.delta /opt/stack/data/nova/instances/snapshots/tmpkq2gg3i3/a44ec04d901241aba79d82743974e6a6" returned: 0 in 0.400s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:03:43 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-00a68046-7671-4168-b741-37d75ed4088a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Snapshot extracted, beginning image upload
Apr 12 13:03:45 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:03:45 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 13:03:45 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:03:45 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:03:45 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-00a68046-7671-4168-b741-37d75ed4088a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Snapshot image upload complete
Apr 12 13:03:45 user nova-compute[71321]: INFO nova.compute.manager [None req-00a68046-7671-4168-b741-37d75ed4088a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Took 4.49 seconds to snapshot the instance on the hypervisor.
Apr 12 13:03:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:03:47 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:03:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:03:49 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:03:49 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 13:03:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-38198e86-bd23-4196-98a0-79455206305f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 13:03:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-38198e86-bd23-4196-98a0-79455206305f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 13:03:49 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 13:03:49 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] Updating instance_info_cache with network_info: [{"id": "5621687b-5d0b-47f7-b11c-a24c403a590a", "address": "fa:16:3e:0e:91:7d", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621687b-5d", "ovs_interfaceid": "5621687b-5d0b-47f7-b11c-a24c403a590a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:03:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-38198e86-bd23-4196-98a0-79455206305f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 13:03:49 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 13:03:50 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:03:51 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:03:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:03:55 user nova-compute[71321]: DEBUG nova.compute.manager [None req-82e3e6ba-32ea-423a-b1d8-5d90520f445e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 13:03:55 user nova-compute[71321]: INFO nova.compute.manager [None req-82e3e6ba-32ea-423a-b1d8-5d90520f445e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] instance snapshotting
Apr 12 13:03:55 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-82e3e6ba-32ea-423a-b1d8-5d90520f445e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Beginning live snapshot process
Apr 12 13:03:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-82e3e6ba-32ea-423a-b1d8-5d90520f445e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json -f qcow2 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:03:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-82e3e6ba-32ea-423a-b1d8-5d90520f445e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json -f qcow2" returned: 0 in 0.134s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:03:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-82e3e6ba-32ea-423a-b1d8-5d90520f445e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json -f qcow2 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:03:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-82e3e6ba-32ea-423a-b1d8-5d90520f445e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json -f qcow2" returned: 0 in 0.137s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:03:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-82e3e6ba-32ea-423a-b1d8-5d90520f445e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:03:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-82e3e6ba-32ea-423a-b1d8-5d90520f445e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.129s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:03:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-82e3e6ba-32ea-423a-b1d8-5d90520f445e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvz474lqw/f3e76e9c21ae47209375bf9912a8ec10.delta 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:03:55 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-82e3e6ba-32ea-423a-b1d8-5d90520f445e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvz474lqw/f3e76e9c21ae47209375bf9912a8ec10.delta 1073741824" returned: 0 in 0.053s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:03:55 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-82e3e6ba-32ea-423a-b1d8-5d90520f445e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 12 13:03:56 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-82e3e6ba-32ea-423a-b1d8-5d90520f445e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] COPY block job progress, current cursor: 851968 final cursor: 43843584 {{(pid=71321) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 13:03:57 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-82e3e6ba-32ea-423a-b1d8-5d90520f445e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] COPY block job progress, current cursor: 43843584 final cursor: 43843584 {{(pid=71321) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 13:03:57 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-82e3e6ba-32ea-423a-b1d8-5d90520f445e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 12 13:03:57 user nova-compute[71321]: DEBUG nova.privsep.utils [None req-82e3e6ba-32ea-423a-b1d8-5d90520f445e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 13:03:57 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-82e3e6ba-32ea-423a-b1d8-5d90520f445e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvz474lqw/f3e76e9c21ae47209375bf9912a8ec10.delta /opt/stack/data/nova/instances/snapshots/tmpvz474lqw/f3e76e9c21ae47209375bf9912a8ec10 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:03:57 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-82e3e6ba-32ea-423a-b1d8-5d90520f445e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvz474lqw/f3e76e9c21ae47209375bf9912a8ec10.delta /opt/stack/data/nova/instances/snapshots/tmpvz474lqw/f3e76e9c21ae47209375bf9912a8ec10" returned: 0 in 0.450s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:03:57 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-82e3e6ba-32ea-423a-b1d8-5d90520f445e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Snapshot extracted, beginning image upload
Apr 12 13:03:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:03:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:03:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:03:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:03:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:03:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:03:59 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-82e3e6ba-32ea-423a-b1d8-5d90520f445e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Snapshot image upload complete
Apr 12 13:03:59 user nova-compute[71321]: INFO nova.compute.manager [None req-82e3e6ba-32ea-423a-b1d8-5d90520f445e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Took 4.57 seconds to snapshot the instance on the hypervisor.
Apr 12 13:04:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:04:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:04:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:04:04 user nova-compute[71321]: DEBUG nova.compute.manager [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 13:04:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:04:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:04:04 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 13:04:04 user nova-compute[71321]: INFO nova.compute.claims [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Claim successful on node user
Apr 12 13:04:04 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 13:04:04 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 13:04:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.282s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:04:04 user nova-compute[71321]: DEBUG nova.compute.manager [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 13:04:04 user nova-compute[71321]: DEBUG nova.compute.manager [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 13:04:04 user nova-compute[71321]: DEBUG nova.network.neutron [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 13:04:04 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 13:04:04 user nova-compute[71321]: DEBUG nova.compute.manager [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 13:04:04 user nova-compute[71321]: DEBUG nova.policy [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc5b75e437444fe4a54c1516964f0cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51e624010914d7680080956cbb0c720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 13:04:04 user nova-compute[71321]: DEBUG nova.compute.manager [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 13:04:04 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 13:04:04 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Creating image(s)
Apr 12 13:04:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "/opt/stack/data/nova/instances/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:04:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "/opt/stack/data/nova/instances/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:04:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "/opt/stack/data/nova/instances/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:04:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "ec79dbda12872b8e291480f9de9b45536679ad79" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:04:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "ec79dbda12872b8e291480f9de9b45536679ad79" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:04:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec79dbda12872b8e291480f9de9b45536679ad79.part --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:05 user nova-compute[71321]: DEBUG nova.network.neutron [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Successfully created port: f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 13:04:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:04:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec79dbda12872b8e291480f9de9b45536679ad79.part --force-share --output=json" returned: 0 in 0.142s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:04:05 user nova-compute[71321]: DEBUG nova.virt.images [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] f809e75f-4f4b-4f31-abc7-1036ed53155c was qcow2, converting to raw {{(pid=71321) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 13:04:05 user nova-compute[71321]: DEBUG nova.privsep.utils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 13:04:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ec79dbda12872b8e291480f9de9b45536679ad79.part /opt/stack/data/nova/instances/_base/ec79dbda12872b8e291480f9de9b45536679ad79.converted {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ec79dbda12872b8e291480f9de9b45536679ad79.part /opt/stack/data/nova/instances/_base/ec79dbda12872b8e291480f9de9b45536679ad79.converted" returned: 0 in 0.228s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:04:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec79dbda12872b8e291480f9de9b45536679ad79.converted --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec79dbda12872b8e291480f9de9b45536679ad79.converted --force-share --output=json" returned: 0 in 0.141s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:04:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "ec79dbda12872b8e291480f9de9b45536679ad79" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.182s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:04:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec79dbda12872b8e291480f9de9b45536679ad79 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec79dbda12872b8e291480f9de9b45536679ad79 --force-share --output=json" returned: 0 in 0.145s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:04:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "ec79dbda12872b8e291480f9de9b45536679ad79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:04:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "ec79dbda12872b8e291480f9de9b45536679ad79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:04:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec79dbda12872b8e291480f9de9b45536679ad79 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.network.neutron [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Successfully updated port: f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "refresh_cache-2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquired lock "refresh_cache-2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.network.neutron [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.compute.manager [req-622810fd-f7cd-4ef3-9600-648299df4034 req-210516fd-c1b8-4526-ad26-ec08f4896a3b service nova] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Received event network-changed-f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.compute.manager [req-622810fd-f7cd-4ef3-9600-648299df4034 req-210516fd-c1b8-4526-ad26-ec08f4896a3b service nova] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Refreshing instance network info cache due to event network-changed-f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-622810fd-f7cd-4ef3-9600-648299df4034 req-210516fd-c1b8-4526-ad26-ec08f4896a3b service nova] Acquiring lock "refresh_cache-2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec79dbda12872b8e291480f9de9b45536679ad79 --force-share --output=json" returned: 0 in 0.134s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ec79dbda12872b8e291480f9de9b45536679ad79,backing_fmt=raw /opt/stack/data/nova/instances/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.network.neutron [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ec79dbda12872b8e291480f9de9b45536679ad79,backing_fmt=raw /opt/stack/data/nova/instances/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1/disk 1073741824" returned: 0 in 0.053s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "ec79dbda12872b8e291480f9de9b45536679ad79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec79dbda12872b8e291480f9de9b45536679ad79 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec79dbda12872b8e291480f9de9b45536679ad79 --force-share --output=json" returned: 0 in 0.132s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.objects.instance [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lazy-loading 'migration_context' on Instance uuid 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Ensure instance console log exists: /opt/stack/data/nova/instances/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.network.neutron [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Updating instance_info_cache with network_info: [{"id": "f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac", "address": "fa:16:3e:c9:39:a4", "network": {"id": "f7ac30df-76aa-400e-868d-9ad902bd9446", "bridge": "br-int", "label": "tempest-TestStampPattern-423905686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51e624010914d7680080956cbb0c720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b0ea0e-f3", "ovs_interfaceid": "f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Releasing lock "refresh_cache-2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.compute.manager [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Instance network_info: |[{"id": "f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac", "address": "fa:16:3e:c9:39:a4", "network": {"id": "f7ac30df-76aa-400e-868d-9ad902bd9446", "bridge": "br-int", "label": "tempest-TestStampPattern-423905686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51e624010914d7680080956cbb0c720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b0ea0e-f3", "ovs_interfaceid": "f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-622810fd-f7cd-4ef3-9600-648299df4034 req-210516fd-c1b8-4526-ad26-ec08f4896a3b service nova] Acquired lock "refresh_cache-2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.network.neutron [req-622810fd-f7cd-4ef3-9600-648299df4034 req-210516fd-c1b8-4526-ad26-ec08f4896a3b service nova] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Refreshing network info cache for port f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Start _get_guest_xml network_info=[{"id": "f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac", "address": "fa:16:3e:c9:39:a4", "network": {"id": "f7ac30df-76aa-400e-868d-9ad902bd9446", "bridge": "br-int", "label": "tempest-TestStampPattern-423905686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51e624010914d7680080956cbb0c720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b0ea0e-f3", "ovs_interfaceid": "f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='a471d23569eacb3c9b563c469168ebfb',container_format='bare',created_at=2023-04-12T13:03:55Z,direct_url=<?>,disk_format='qcow2',id=f809e75f-4f4b-4f31-abc7-1036ed53155c,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1782159827',owner='f51e624010914d7680080956cbb0c720',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-12T13:04:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'f809e75f-4f4b-4f31-abc7-1036ed53155c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 13:04:06 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:04:06 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='a471d23569eacb3c9b563c469168ebfb',container_format='bare',created_at=2023-04-12T13:03:55Z,direct_url=<?>,disk_format='qcow2',id=f809e75f-4f4b-4f31-abc7-1036ed53155c,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1782159827',owner='f51e624010914d7680080956cbb0c720',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-12T13:04:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T13:04:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-469200579',display_name='tempest-TestStampPattern-server-469200579',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-469200579',id=45,image_ref='f809e75f-4f4b-4f31-abc7-1036ed53155c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4/5v3eCbyqn1cBjTbTlpYaNU+pu9bnoXsJrgMiEn/z8xxIi9MkvXpvfk3KhnFx+XRfpoIpI1zKXf4THCFNpnfEDB0Wv8SQLcFxbpIn7/+LQHs5b/5vFRKuB/DiXoVA+A==',key_name='tempest-TestStampPattern-193639278',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f51e624010914d7680080956cbb0c720',ramdisk_id='',reservation_id='r-wvx6ykxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e47cf07b-9759-4350-9e10-bd5bb15678f3',image_min_disk='1',image_min_ram='0',image_owner_id='f51e624010914d7680080956cbb0c720',image_owner_project_name='tempest-TestStampPattern-1801373189',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1801373189-project-member',image_user_id='bc5b75e437444fe4a54c1516964f0cfa',network_allocated='True',owner_project_name='tempest-TestStampPattern-1801373189',owner_user_name='tempest-TestStampPattern-1801373189-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T13:04:05Z,user_data=None,user_id='bc5b75e437444fe4a54c1516964f0cfa',uuid=2888a6ec-4c3a-44ee-809b-c1ea4a560aa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac", "address": "fa:16:3e:c9:39:a4", "network": {"id": "f7ac30df-76aa-400e-868d-9ad902bd9446", "bridge": "br-int", "label": "tempest-TestStampPattern-423905686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51e624010914d7680080956cbb0c720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b0ea0e-f3", "ovs_interfaceid": "f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Converting VIF {"id": "f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac", "address": "fa:16:3e:c9:39:a4", "network": {"id": "f7ac30df-76aa-400e-868d-9ad902bd9446", "bridge": "br-int", "label": "tempest-TestStampPattern-423905686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51e624010914d7680080956cbb0c720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b0ea0e-f3", "ovs_interfaceid": "f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:39:a4,bridge_name='br-int',has_traffic_filtering=True,id=f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac,network=Network(f7ac30df-76aa-400e-868d-9ad902bd9446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1b0ea0e-f3') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.objects.instance [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lazy-loading 'pci_devices' on Instance uuid 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] End _get_guest_xml xml=<domain type="kvm">
Apr 12 13:04:06 user nova-compute[71321]:   <uuid>2888a6ec-4c3a-44ee-809b-c1ea4a560aa1</uuid>
Apr 12 13:04:06 user nova-compute[71321]:   <name>instance-0000002d</name>
Apr 12 13:04:06 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 13:04:06 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 13:04:06 user nova-compute[71321]:   <metadata>
Apr 12 13:04:06 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 13:04:06 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 13:04:06 user nova-compute[71321]:       <nova:name>tempest-TestStampPattern-server-469200579</nova:name>
Apr 12 13:04:06 user nova-compute[71321]:       <nova:creationTime>2023-04-12 13:04:06</nova:creationTime>
Apr 12 13:04:06 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 13:04:06 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 13:04:06 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 13:04:06 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 13:04:06 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 13:04:06 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 13:04:06 user nova-compute[71321]:       </nova:flavor>
Apr 12 13:04:06 user nova-compute[71321]:       <nova:owner>
Apr 12 13:04:06 user nova-compute[71321]:         <nova:user uuid="bc5b75e437444fe4a54c1516964f0cfa">tempest-TestStampPattern-1801373189-project-member</nova:user>
Apr 12 13:04:06 user nova-compute[71321]:         <nova:project uuid="f51e624010914d7680080956cbb0c720">tempest-TestStampPattern-1801373189</nova:project>
Apr 12 13:04:06 user nova-compute[71321]:       </nova:owner>
Apr 12 13:04:06 user nova-compute[71321]:       <nova:root type="image" uuid="f809e75f-4f4b-4f31-abc7-1036ed53155c"/>
Apr 12 13:04:06 user nova-compute[71321]:       <nova:ports>
Apr 12 13:04:06 user nova-compute[71321]:         <nova:port uuid="f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac">
Apr 12 13:04:06 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 13:04:06 user nova-compute[71321]:         </nova:port>
Apr 12 13:04:06 user nova-compute[71321]:       </nova:ports>
Apr 12 13:04:06 user nova-compute[71321]:     </nova:instance>
Apr 12 13:04:06 user nova-compute[71321]:   </metadata>
Apr 12 13:04:06 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 13:04:06 user nova-compute[71321]:     <system>
Apr 12 13:04:06 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 13:04:06 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 13:04:06 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 13:04:06 user nova-compute[71321]:       <entry name="serial">2888a6ec-4c3a-44ee-809b-c1ea4a560aa1</entry>
Apr 12 13:04:06 user nova-compute[71321]:       <entry name="uuid">2888a6ec-4c3a-44ee-809b-c1ea4a560aa1</entry>
Apr 12 13:04:06 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 13:04:06 user nova-compute[71321]:     </system>
Apr 12 13:04:06 user nova-compute[71321]:   </sysinfo>
Apr 12 13:04:06 user nova-compute[71321]:   <os>
Apr 12 13:04:06 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 13:04:06 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 13:04:06 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 13:04:06 user nova-compute[71321]:   </os>
Apr 12 13:04:06 user nova-compute[71321]:   <features>
Apr 12 13:04:06 user nova-compute[71321]:     <acpi/>
Apr 12 13:04:06 user nova-compute[71321]:     <apic/>
Apr 12 13:04:06 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 13:04:06 user nova-compute[71321]:   </features>
Apr 12 13:04:06 user nova-compute[71321]:   <clock offset="utc">
Apr 12 13:04:06 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 13:04:06 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 13:04:06 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 13:04:06 user nova-compute[71321]:   </clock>
Apr 12 13:04:06 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 13:04:06 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 13:04:06 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 13:04:06 user nova-compute[71321]:   </cpu>
Apr 12 13:04:06 user nova-compute[71321]:   <devices>
Apr 12 13:04:06 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 13:04:06 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 13:04:06 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1/disk"/>
Apr 12 13:04:06 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 13:04:06 user nova-compute[71321]:     </disk>
Apr 12 13:04:06 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 13:04:06 user nova-compute[71321]:       <mac address="fa:16:3e:c9:39:a4"/>
Apr 12 13:04:06 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 13:04:06 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 13:04:06 user nova-compute[71321]:       <target dev="tapf1b0ea0e-f3"/>
Apr 12 13:04:06 user nova-compute[71321]:     </interface>
Apr 12 13:04:06 user nova-compute[71321]:     <serial type="pty">
Apr 12 13:04:06 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1/console.log" append="off"/>
Apr 12 13:04:06 user nova-compute[71321]:     </serial>
Apr 12 13:04:06 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 13:04:06 user nova-compute[71321]:     <video>
Apr 12 13:04:06 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 13:04:06 user nova-compute[71321]:     </video>
Apr 12 13:04:06 user nova-compute[71321]:     <rng model="virtio">
Apr 12 13:04:06 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 13:04:06 user nova-compute[71321]:     </rng>
Apr 12 13:04:06 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 13:04:06 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 13:04:06 user nova-compute[71321]:       <stats period="10"/>
Apr 12 13:04:06 user nova-compute[71321]:     </memballoon>
Apr 12 13:04:06 user nova-compute[71321]:   </devices>
Apr 12 13:04:06 user nova-compute[71321]: </domain>
Apr 12 13:04:06 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T13:04:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-469200579',display_name='tempest-TestStampPattern-server-469200579',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-469200579',id=45,image_ref='f809e75f-4f4b-4f31-abc7-1036ed53155c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4/5v3eCbyqn1cBjTbTlpYaNU+pu9bnoXsJrgMiEn/z8xxIi9MkvXpvfk3KhnFx+XRfpoIpI1zKXf4THCFNpnfEDB0Wv8SQLcFxbpIn7/+LQHs5b/5vFRKuB/DiXoVA+A==',key_name='tempest-TestStampPattern-193639278',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f51e624010914d7680080956cbb0c720',ramdisk_id='',reservation_id='r-wvx6ykxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e47cf07b-9759-4350-9e10-bd5bb15678f3',image_min_disk='1',image_min_ram='0',image_owner_id='f51e624010914d7680080956cbb0c720',image_owner_project_name='tempest-TestStampPattern-1801373189',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1801373189-project-member',image_user_id='bc5b75e437444fe4a54c1516964f0cfa',network_allocated='True',owner_project_name='tempest-TestStampPattern-1801373189',owner_user_name='tempest-TestStampPattern-1801373189-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T13:04:05Z,user_data=None,user_id='bc5b75e437444fe4a54c1516964f0cfa',uuid=2888a6ec-4c3a-44ee-809b-c1ea4a560aa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac", "address": "fa:16:3e:c9:39:a4", "network": {"id": "f7ac30df-76aa-400e-868d-9ad902bd9446", "bridge": "br-int", "label": "tempest-TestStampPattern-423905686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51e624010914d7680080956cbb0c720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b0ea0e-f3", "ovs_interfaceid": "f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Converting VIF {"id": "f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac", "address": "fa:16:3e:c9:39:a4", "network": {"id": "f7ac30df-76aa-400e-868d-9ad902bd9446", "bridge": "br-int", "label": "tempest-TestStampPattern-423905686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51e624010914d7680080956cbb0c720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b0ea0e-f3", "ovs_interfaceid": "f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:39:a4,bridge_name='br-int',has_traffic_filtering=True,id=f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac,network=Network(f7ac30df-76aa-400e-868d-9ad902bd9446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1b0ea0e-f3') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG os_vif [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:39:a4,bridge_name='br-int',has_traffic_filtering=True,id=f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac,network=Network(f7ac30df-76aa-400e-868d-9ad902bd9446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1b0ea0e-f3') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1b0ea0e-f3, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf1b0ea0e-f3, col_values=(('external_ids', {'iface-id': 'f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:39:a4', 'vm-uuid': '2888a6ec-4c3a-44ee-809b-c1ea4a560aa1'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:04:06 user nova-compute[71321]: INFO os_vif [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:39:a4,bridge_name='br-int',has_traffic_filtering=True,id=f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac,network=Network(f7ac30df-76aa-400e-868d-9ad902bd9446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1b0ea0e-f3')
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] No VIF found with MAC fa:16:3e:c9:39:a4, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.network.neutron [req-622810fd-f7cd-4ef3-9600-648299df4034 req-210516fd-c1b8-4526-ad26-ec08f4896a3b service nova] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Updated VIF entry in instance network info cache for port f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG nova.network.neutron [req-622810fd-f7cd-4ef3-9600-648299df4034 req-210516fd-c1b8-4526-ad26-ec08f4896a3b service nova] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Updating instance_info_cache with network_info: [{"id": "f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac", "address": "fa:16:3e:c9:39:a4", "network": {"id": "f7ac30df-76aa-400e-868d-9ad902bd9446", "bridge": "br-int", "label": "tempest-TestStampPattern-423905686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51e624010914d7680080956cbb0c720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b0ea0e-f3", "ovs_interfaceid": "f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:04:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-622810fd-f7cd-4ef3-9600-648299df4034 req-210516fd-c1b8-4526-ad26-ec08f4896a3b service nova] Releasing lock "refresh_cache-2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 13:04:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:04:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:04:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG nova.compute.manager [req-266ed292-d0d3-4faf-a361-44835f4e6842 req-3f5e70c6-4642-4782-adf7-4c57a61befbc service nova] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Received event network-vif-plugged-f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-266ed292-d0d3-4faf-a361-44835f4e6842 req-3f5e70c6-4642-4782-adf7-4c57a61befbc service nova] Acquiring lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-266ed292-d0d3-4faf-a361-44835f4e6842 req-3f5e70c6-4642-4782-adf7-4c57a61befbc service nova] Lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-266ed292-d0d3-4faf-a361-44835f4e6842 req-3f5e70c6-4642-4782-adf7-4c57a61befbc service nova] Lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG nova.compute.manager [req-266ed292-d0d3-4faf-a361-44835f4e6842 req-3f5e70c6-4642-4782-adf7-4c57a61befbc service nova] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] No waiting events found dispatching network-vif-plugged-f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:04:08 user nova-compute[71321]: WARNING nova.compute.manager [req-266ed292-d0d3-4faf-a361-44835f4e6842 req-3f5e70c6-4642-4782-adf7-4c57a61befbc service nova] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Received unexpected event network-vif-plugged-f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac for instance with vm_state building and task_state spawning.
Apr 12 13:04:08 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Verify base images {{(pid=71321) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Image id f809e75f-4f4b-4f31-abc7-1036ed53155c yields fingerprint ec79dbda12872b8e291480f9de9b45536679ad79 {{(pid=71321) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 12 13:04:08 user nova-compute[71321]: INFO nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] image f809e75f-4f4b-4f31-abc7-1036ed53155c at (/opt/stack/data/nova/instances/_base/ec79dbda12872b8e291480f9de9b45536679ad79): checking
Apr 12 13:04:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] image f809e75f-4f4b-4f31-abc7-1036ed53155c at (/opt/stack/data/nova/instances/_base/ec79dbda12872b8e291480f9de9b45536679ad79): image is in use {{(pid=71321) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=71321) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Image id 10cdaa6e-1722-4d2a-835d-7b112d771c50 yields fingerprint 4d14e90ebd3ddf411ab96dc6086f9deba2622787 {{(pid=71321) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 12 13:04:08 user nova-compute[71321]: INFO nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] image 10cdaa6e-1722-4d2a-835d-7b112d771c50 at (/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787): checking
Apr 12 13:04:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] image 10cdaa6e-1722-4d2a-835d-7b112d771c50 at (/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787): image is in use {{(pid=71321) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] e47cf07b-9759-4350-9e10-bd5bb15678f3 is a valid instance name {{(pid=71321) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] e47cf07b-9759-4350-9e10-bd5bb15678f3 has a disk file {{(pid=71321) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance e47cf07b-9759-4350-9e10-bd5bb15678f3 is backed by 4d14e90ebd3ddf411ab96dc6086f9deba2622787 {{(pid=71321) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 is a valid instance name {{(pid=71321) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 has a disk file {{(pid=71321) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 is backed by ec79dbda12872b8e291480f9de9b45536679ad79 {{(pid=71321) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 is a valid instance name {{(pid=71321) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 has a disk file {{(pid=71321) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 is backed by 4d14e90ebd3ddf411ab96dc6086f9deba2622787 {{(pid=71321) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] 38198e86-bd23-4196-98a0-79455206305f is a valid instance name {{(pid=71321) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] acd99758-64c1-4852-b906-e5f941868a8e is a valid instance name {{(pid=71321) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] acd99758-64c1-4852-b906-e5f941868a8e has a disk file {{(pid=71321) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 12 13:04:08 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:09 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:04:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance acd99758-64c1-4852-b906-e5f941868a8e is backed by 4d14e90ebd3ddf411ab96dc6086f9deba2622787 {{(pid=71321) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 12 13:04:09 user nova-compute[71321]: WARNING nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a64a687b87678709f7c094c62955f5494b293537
Apr 12 13:04:09 user nova-compute[71321]: WARNING nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ef338b5476e03f8d83899b8e304a2ad808f2b08f
Apr 12 13:04:09 user nova-compute[71321]: WARNING nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ee6e4d62d017fb9117a2598777b359d378f7780b
Apr 12 13:04:09 user nova-compute[71321]: WARNING nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8ca9ae49b87a30deaf28664377c1bb558cbc59fa
Apr 12 13:04:09 user nova-compute[71321]: WARNING nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9cb950505b0632c66d01c462ac37fee3d8fbe1b9
Apr 12 13:04:09 user nova-compute[71321]: WARNING nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Unknown base file: /opt/stack/data/nova/instances/_base/95e5a173de441253522ddec92587198c5322ffdf
Apr 12 13:04:09 user nova-compute[71321]: WARNING nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Unknown base file: /opt/stack/data/nova/instances/_base/6fa36d22cdb299cfae747dc45e27a7d3e61b7611
Apr 12 13:04:09 user nova-compute[71321]: INFO nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Active base files: /opt/stack/data/nova/instances/_base/ec79dbda12872b8e291480f9de9b45536679ad79 /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787
Apr 12 13:04:09 user nova-compute[71321]: INFO nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Removable base files: /opt/stack/data/nova/instances/_base/a64a687b87678709f7c094c62955f5494b293537 /opt/stack/data/nova/instances/_base/ef338b5476e03f8d83899b8e304a2ad808f2b08f /opt/stack/data/nova/instances/_base/ee6e4d62d017fb9117a2598777b359d378f7780b /opt/stack/data/nova/instances/_base/8ca9ae49b87a30deaf28664377c1bb558cbc59fa /opt/stack/data/nova/instances/_base/9cb950505b0632c66d01c462ac37fee3d8fbe1b9 /opt/stack/data/nova/instances/_base/95e5a173de441253522ddec92587198c5322ffdf /opt/stack/data/nova/instances/_base/6fa36d22cdb299cfae747dc45e27a7d3e61b7611
Apr 12 13:04:09 user nova-compute[71321]: INFO nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a64a687b87678709f7c094c62955f5494b293537
Apr 12 13:04:09 user nova-compute[71321]: INFO nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ef338b5476e03f8d83899b8e304a2ad808f2b08f
Apr 12 13:04:09 user nova-compute[71321]: INFO nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ee6e4d62d017fb9117a2598777b359d378f7780b
Apr 12 13:04:09 user nova-compute[71321]: INFO nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8ca9ae49b87a30deaf28664377c1bb558cbc59fa
Apr 12 13:04:09 user nova-compute[71321]: INFO nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9cb950505b0632c66d01c462ac37fee3d8fbe1b9
Apr 12 13:04:09 user nova-compute[71321]: INFO nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/95e5a173de441253522ddec92587198c5322ffdf
Apr 12 13:04:09 user nova-compute[71321]: INFO nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6fa36d22cdb299cfae747dc45e27a7d3e61b7611
Apr 12 13:04:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Verification complete {{(pid=71321) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Apr 12 13:04:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Verify swap images {{(pid=71321) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Apr 12 13:04:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.imagecache [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Verify ephemeral images {{(pid=71321) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Apr 12 13:04:09 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681304649.9457324, 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 13:04:09 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] VM Resumed (Lifecycle Event)
Apr 12 13:04:09 user nova-compute[71321]: DEBUG nova.compute.manager [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 13:04:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 13:04:09 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Instance spawned successfully.
Apr 12 13:04:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 13:04:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 13:04:09 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 13:04:09 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 13:04:09 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 13:04:10 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 13:04:10 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681304649.9481037, 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 13:04:10 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] VM Started (Lifecycle Event)
Apr 12 13:04:10 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 13:04:10 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 13:04:10 user nova-compute[71321]: INFO nova.compute.manager [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Took 5.45 seconds to spawn the instance on the hypervisor.
Apr 12 13:04:10 user nova-compute[71321]: DEBUG nova.compute.manager [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 13:04:10 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 13:04:10 user nova-compute[71321]: DEBUG nova.compute.manager [req-5ad04bbb-44f8-413e-b267-e21a8299da6b req-e7178420-9b41-464a-a3fb-ea09b11e152b service nova] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Received event network-vif-plugged-f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:04:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-5ad04bbb-44f8-413e-b267-e21a8299da6b req-e7178420-9b41-464a-a3fb-ea09b11e152b service nova] Acquiring lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:04:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-5ad04bbb-44f8-413e-b267-e21a8299da6b req-e7178420-9b41-464a-a3fb-ea09b11e152b service nova] Lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:04:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-5ad04bbb-44f8-413e-b267-e21a8299da6b req-e7178420-9b41-464a-a3fb-ea09b11e152b service nova] Lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:04:10 user nova-compute[71321]: DEBUG nova.compute.manager [req-5ad04bbb-44f8-413e-b267-e21a8299da6b req-e7178420-9b41-464a-a3fb-ea09b11e152b service nova] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] No waiting events found dispatching network-vif-plugged-f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:04:10 user nova-compute[71321]: WARNING nova.compute.manager [req-5ad04bbb-44f8-413e-b267-e21a8299da6b req-e7178420-9b41-464a-a3fb-ea09b11e152b service nova] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Received unexpected event network-vif-plugged-f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac for instance with vm_state building and task_state spawning.
Apr 12 13:04:10 user nova-compute[71321]: INFO nova.compute.manager [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Took 6.04 seconds to build instance.
Apr 12 13:04:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.137s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:04:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:04:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:04:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:04:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:04:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:04:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:04:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:04:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:04:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:04:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:04:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:04:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:04:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:04:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:04:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:04:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:04:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:04:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:04:34 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:04:34 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71321) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 13:04:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:04:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:04:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:04:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:04:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:04:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:04:38 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:04:39 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:04:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:04:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:04:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:04:39 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 13:04:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:04:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:04:39 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 13:04:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:04:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:04:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:04:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:04:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:04:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:04:41 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:04:41 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:04:41 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:04:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8520MB free_disk=26.036251068115234GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 13:04:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:04:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:04:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:04:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 38198e86-bd23-4196-98a0-79455206305f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:04:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance e47cf07b-9759-4350-9e10-bd5bb15678f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:04:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance acd99758-64c1-4852-b906-e5f941868a8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:04:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:04:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 13:04:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 13:04:41 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 13:04:41 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 13:04:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 13:04:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.326s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:04:41 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:04:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:04:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:04:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:04:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:04:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:04:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:04:47 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:04:47 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:04:47 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:04:47 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 13:04:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "d1820783-afa6-434c-9da4-09d9c4990fa1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:04:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "d1820783-afa6-434c-9da4-09d9c4990fa1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:04:47 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 13:04:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:04:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:04:47 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 13:04:47 user nova-compute[71321]: INFO nova.compute.claims [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Claim successful on node user
Apr 12 13:04:48 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 13:04:48 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 13:04:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.315s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:04:48 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 13:04:48 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 13:04:48 user nova-compute[71321]: DEBUG nova.network.neutron [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 13:04:48 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 13:04:48 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 13:04:48 user nova-compute[71321]: INFO nova.virt.block_device [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Booting with volume-backed-image 10cdaa6e-1722-4d2a-835d-7b112d771c50 at /dev/vda
Apr 12 13:04:48 user nova-compute[71321]: DEBUG nova.policy [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 13:04:48 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:04:48 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:04:49 user nova-compute[71321]: DEBUG nova.network.neutron [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Successfully created port: 3bd889e8-1b3d-4902-ad45-01a3b961d658 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 13:04:49 user nova-compute[71321]: DEBUG nova.network.neutron [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Successfully updated port: 3bd889e8-1b3d-4902-ad45-01a3b961d658 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 13:04:49 user nova-compute[71321]: DEBUG nova.compute.manager [req-04605c8f-1542-43e8-9cf5-d39a94238e15 req-b7cf7231-2f8e-428b-b3c0-8fba26a27dec service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Received event network-changed-3bd889e8-1b3d-4902-ad45-01a3b961d658 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:04:49 user nova-compute[71321]: DEBUG nova.compute.manager [req-04605c8f-1542-43e8-9cf5-d39a94238e15 req-b7cf7231-2f8e-428b-b3c0-8fba26a27dec service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Refreshing instance network info cache due to event network-changed-3bd889e8-1b3d-4902-ad45-01a3b961d658. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 13:04:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-04605c8f-1542-43e8-9cf5-d39a94238e15 req-b7cf7231-2f8e-428b-b3c0-8fba26a27dec service nova] Acquiring lock "refresh_cache-d1820783-afa6-434c-9da4-09d9c4990fa1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 13:04:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-04605c8f-1542-43e8-9cf5-d39a94238e15 req-b7cf7231-2f8e-428b-b3c0-8fba26a27dec service nova] Acquired lock "refresh_cache-d1820783-afa6-434c-9da4-09d9c4990fa1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 13:04:49 user nova-compute[71321]: DEBUG nova.network.neutron [req-04605c8f-1542-43e8-9cf5-d39a94238e15 req-b7cf7231-2f8e-428b-b3c0-8fba26a27dec service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Refreshing network info cache for port 3bd889e8-1b3d-4902-ad45-01a3b961d658 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 13:04:49 user nova-compute[71321]: DEBUG nova.network.neutron [req-04605c8f-1542-43e8-9cf5-d39a94238e15 req-b7cf7231-2f8e-428b-b3c0-8fba26a27dec service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 13:04:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "refresh_cache-d1820783-afa6-434c-9da4-09d9c4990fa1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 13:04:50 user nova-compute[71321]: DEBUG nova.network.neutron [req-04605c8f-1542-43e8-9cf5-d39a94238e15 req-b7cf7231-2f8e-428b-b3c0-8fba26a27dec service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:04:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-04605c8f-1542-43e8-9cf5-d39a94238e15 req-b7cf7231-2f8e-428b-b3c0-8fba26a27dec service nova] Releasing lock "refresh_cache-d1820783-afa6-434c-9da4-09d9c4990fa1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 13:04:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquired lock "refresh_cache-d1820783-afa6-434c-9da4-09d9c4990fa1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 13:04:50 user nova-compute[71321]: DEBUG nova.network.neutron [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 13:04:50 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:04:50 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 13:04:50 user nova-compute[71321]: DEBUG nova.network.neutron [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 13:04:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-e47cf07b-9759-4350-9e10-bd5bb15678f3" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 13:04:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-e47cf07b-9759-4350-9e10-bd5bb15678f3" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 13:04:50 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 13:04:50 user nova-compute[71321]: DEBUG nova.network.neutron [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Updating instance_info_cache with network_info: [{"id": "3bd889e8-1b3d-4902-ad45-01a3b961d658", "address": "fa:16:3e:fe:4f:ca", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd889e8-1b", "ovs_interfaceid": "3bd889e8-1b3d-4902-ad45-01a3b961d658", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:04:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Releasing lock "refresh_cache-d1820783-afa6-434c-9da4-09d9c4990fa1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 13:04:50 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Instance network_info: |[{"id": "3bd889e8-1b3d-4902-ad45-01a3b961d658", "address": "fa:16:3e:fe:4f:ca", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd889e8-1b", "ovs_interfaceid": "3bd889e8-1b3d-4902-ad45-01a3b961d658", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 13:04:51 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Updating instance_info_cache with network_info: [{"id": "2f2f437b-b72e-4842-9047-36ee6e17bf9b", "address": "fa:16:3e:15:a4:ec", "network": {"id": "f7ac30df-76aa-400e-868d-9ad902bd9446", "bridge": "br-int", "label": "tempest-TestStampPattern-423905686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51e624010914d7680080956cbb0c720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2f437b-b7", "ovs_interfaceid": "2f2f437b-b72e-4842-9047-36ee6e17bf9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:04:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-e47cf07b-9759-4350-9e10-bd5bb15678f3" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 13:04:51 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 13:04:51 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:04:51 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:04:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:04:54 user nova-compute[71321]: DEBUG os_brick.utils [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 13:04:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:04:54 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38358bb-27f4-4b7f-b555-07d956500548]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:04:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:04:54 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7c6706-4c77-4cb2-8d6e-c1d85ee99913]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:04:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:04:54 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[40031392-2a95-4f7a-9a23-52c0b10d01e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:04:54 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fc9db0-deb2-4e7b-885a-f3777b5af78e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:04:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 13:04:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 13:04:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:54 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 13:04:54 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 13:04:54 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[441993ae-2b1d-4c04-ac31-8fe23a1375ac]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:04:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 13:04:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 13:04:54 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 13:04:54 user nova-compute[71321]: DEBUG os_brick.utils [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 13:04:54 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Updating existing volume attachment record: d920fab2-9633-4e85-93d0-5f5a605a57b9 {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 13:04:56 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:04:56 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 13:04:58 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Creating image(s)
Apr 12 13:04:58 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Did not create local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Ensure instance console log exists: /opt/stack/data/nova/instances/d1820783-afa6-434c-9da4-09d9c4990fa1/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Start _get_guest_xml network_info=[{"id": "3bd889e8-1b3d-4902-ad45-01a3b961d658", "address": "fa:16:3e:fe:4f:ca", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd889e8-1b", "ovs_interfaceid": "3bd889e8-1b3d-4902-ad45-01a3b961d658", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd920fab2-9633-4e85-93d0-5f5a605a57b9', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TZaSwXbq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd1820783-afa6-434c-9da4-09d9c4990fa1', 'attached_at': '', 'detached_at': '', 'volume_id': '8e136e31-e43a-4a77-b73d-50a179407498', 'serial': '8e136e31-e43a-4a77-b73d-50a179407498'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 13:04:58 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:04:58 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:04:58 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TZaSwXbq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 13:04:58 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 13:04:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 13:04:58 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 13:04:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 13:04:58 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b69b693-0706-4de3-a74c-5314b3f03087]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 13:04:58 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e076b26-aa6d-4c6e-a4c5-a041269693ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498] added
Apr 12 13:04:58 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bbe2f0-f956-4b1c-a6f2-86367093afcb]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[365b9062-a226-4a7c-8acc-f7f3bba75c43]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TZaSwXbq {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TZaSwXbq" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4083a367-6706-40f1-941f-7009d368b1f4]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TZaSwXbq'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a7f0c7-dc40-40f2-b897-be9fbc1be4d7]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de1f815-6382-4a73-8bfc-3748cac6774c]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 13:04:58 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 13:04:58 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99325e5-b932-4f50-8a9e-948942648c38]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498, portal: 172.16.0.220,3260]
Apr 12 13:04:58 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498, portal: 172.16.0.220,3260] successful.
Apr 12 13:04:58 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bfb44f-eb61-45e4-8d06-22f8bb5c9a0a]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[919e9181-779f-4b56-9171-df7d58c25d65]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 13:04:58 user nova-compute[71321]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 (non-flash)
Apr 12 13:04:58 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 13:04:58 user nova-compute[71321]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 (non-flash)
Apr 12 13:04:58 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab60b10-20d2-40fa-8fb5-805854fadd7a]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 13:04:58 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TZaSwXbq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 13:04:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 13:04:59 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '23166613363613561', 'path': '/dev/sdc'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 13:04:59 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166613363613561', 'path': '/dev/sdc'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 13:04:59 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T13:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1366095873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1366095873',id=46,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f20ad21427a04683b9b102d2ff0290a5',ramdisk_id='',reservation_id='r-rd8kq37i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-636247513',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T13:04:48Z,user_data=None,user_id='435e0d6fd2b3437f837e82730b4d955f',uuid=d1820783-afa6-434c-9da4-09d9c4990fa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bd889e8-1b3d-4902-ad45-01a3b961d658", "address": "fa:16:3e:fe:4f:ca", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd889e8-1b", "ovs_interfaceid": "3bd889e8-1b3d-4902-ad45-01a3b961d658", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 13:04:59 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Converting VIF {"id": "3bd889e8-1b3d-4902-ad45-01a3b961d658", "address": "fa:16:3e:fe:4f:ca", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd889e8-1b", "ovs_interfaceid": "3bd889e8-1b3d-4902-ad45-01a3b961d658", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 13:04:59 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:4f:ca,bridge_name='br-int',has_traffic_filtering=True,id=3bd889e8-1b3d-4902-ad45-01a3b961d658,network=Network(bb52f82e-56ca-41f7-b171-a3cacb549ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bd889e8-1b') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 13:04:59 user nova-compute[71321]: DEBUG nova.objects.instance [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lazy-loading 'pci_devices' on Instance uuid d1820783-afa6-434c-9da4-09d9c4990fa1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:04:59 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] End _get_guest_xml xml=<domain type="kvm">
Apr 12 13:04:59 user nova-compute[71321]:   <uuid>d1820783-afa6-434c-9da4-09d9c4990fa1</uuid>
Apr 12 13:04:59 user nova-compute[71321]:   <name>instance-0000002e</name>
Apr 12 13:04:59 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 13:04:59 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 13:04:59 user nova-compute[71321]:   <metadata>
Apr 12 13:04:59 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 13:04:59 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 13:04:59 user nova-compute[71321]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1366095873</nova:name>
Apr 12 13:04:59 user nova-compute[71321]:       <nova:creationTime>2023-04-12 13:04:58</nova:creationTime>
Apr 12 13:04:59 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 13:04:59 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 13:04:59 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 13:04:59 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 13:04:59 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 13:04:59 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 13:04:59 user nova-compute[71321]:       </nova:flavor>
Apr 12 13:04:59 user nova-compute[71321]:       <nova:owner>
Apr 12 13:04:59 user nova-compute[71321]:         <nova:user uuid="435e0d6fd2b3437f837e82730b4d955f">tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member</nova:user>
Apr 12 13:04:59 user nova-compute[71321]:         <nova:project uuid="f20ad21427a04683b9b102d2ff0290a5">tempest-ServerBootFromVolumeStableRescueTest-636247513</nova:project>
Apr 12 13:04:59 user nova-compute[71321]:       </nova:owner>
Apr 12 13:04:59 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 13:04:59 user nova-compute[71321]:       <nova:ports>
Apr 12 13:04:59 user nova-compute[71321]:         <nova:port uuid="3bd889e8-1b3d-4902-ad45-01a3b961d658">
Apr 12 13:04:59 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 13:04:59 user nova-compute[71321]:         </nova:port>
Apr 12 13:04:59 user nova-compute[71321]:       </nova:ports>
Apr 12 13:04:59 user nova-compute[71321]:     </nova:instance>
Apr 12 13:04:59 user nova-compute[71321]:   </metadata>
Apr 12 13:04:59 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 13:04:59 user nova-compute[71321]:     <system>
Apr 12 13:04:59 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 13:04:59 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 13:04:59 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 13:04:59 user nova-compute[71321]:       <entry name="serial">d1820783-afa6-434c-9da4-09d9c4990fa1</entry>
Apr 12 13:04:59 user nova-compute[71321]:       <entry name="uuid">d1820783-afa6-434c-9da4-09d9c4990fa1</entry>
Apr 12 13:04:59 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 13:04:59 user nova-compute[71321]:     </system>
Apr 12 13:04:59 user nova-compute[71321]:   </sysinfo>
Apr 12 13:04:59 user nova-compute[71321]:   <os>
Apr 12 13:04:59 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 13:04:59 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 13:04:59 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 13:04:59 user nova-compute[71321]:   </os>
Apr 12 13:04:59 user nova-compute[71321]:   <features>
Apr 12 13:04:59 user nova-compute[71321]:     <acpi/>
Apr 12 13:04:59 user nova-compute[71321]:     <apic/>
Apr 12 13:04:59 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 13:04:59 user nova-compute[71321]:   </features>
Apr 12 13:04:59 user nova-compute[71321]:   <clock offset="utc">
Apr 12 13:04:59 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 13:04:59 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 13:04:59 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 13:04:59 user nova-compute[71321]:   </clock>
Apr 12 13:04:59 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 13:04:59 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 13:04:59 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 13:04:59 user nova-compute[71321]:   </cpu>
Apr 12 13:04:59 user nova-compute[71321]:   <devices>
Apr 12 13:04:59 user nova-compute[71321]:     <disk type="block" device="disk">
Apr 12 13:04:59 user nova-compute[71321]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 13:04:59 user nova-compute[71321]:       <source dev="/dev/sdc"/>
Apr 12 13:04:59 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 13:04:59 user nova-compute[71321]:       <serial>8e136e31-e43a-4a77-b73d-50a179407498</serial>
Apr 12 13:04:59 user nova-compute[71321]:     </disk>
Apr 12 13:04:59 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 13:04:59 user nova-compute[71321]:       <mac address="fa:16:3e:fe:4f:ca"/>
Apr 12 13:04:59 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 13:04:59 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 13:04:59 user nova-compute[71321]:       <target dev="tap3bd889e8-1b"/>
Apr 12 13:04:59 user nova-compute[71321]:     </interface>
Apr 12 13:04:59 user nova-compute[71321]:     <serial type="pty">
Apr 12 13:04:59 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/d1820783-afa6-434c-9da4-09d9c4990fa1/console.log" append="off"/>
Apr 12 13:04:59 user nova-compute[71321]:     </serial>
Apr 12 13:04:59 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 13:04:59 user nova-compute[71321]:     <video>
Apr 12 13:04:59 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 13:04:59 user nova-compute[71321]:     </video>
Apr 12 13:04:59 user nova-compute[71321]:     <rng model="virtio">
Apr 12 13:04:59 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 13:04:59 user nova-compute[71321]:     </rng>
Apr 12 13:04:59 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 13:04:59 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 13:04:59 user nova-compute[71321]:       <stats period="10"/>
Apr 12 13:04:59 user nova-compute[71321]:     </memballoon>
Apr 12 13:04:59 user nova-compute[71321]:   </devices>
Apr 12 13:04:59 user nova-compute[71321]: </domain>
Apr 12 13:04:59 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 13:04:59 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T13:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1366095873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1366095873',id=46,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f20ad21427a04683b9b102d2ff0290a5',ramdisk_id='',reservation_id='r-rd8kq37i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-636247513',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T13:04:48Z,user_data=None,user_id='435e0d6fd2b3437f837e82730b4d955f',uuid=d1820783-afa6-434c-9da4-09d9c4990fa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bd889e8-1b3d-4902-ad45-01a3b961d658", "address": "fa:16:3e:fe:4f:ca", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd889e8-1b", "ovs_interfaceid": "3bd889e8-1b3d-4902-ad45-01a3b961d658", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 13:04:59 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Converting VIF {"id": "3bd889e8-1b3d-4902-ad45-01a3b961d658", "address": "fa:16:3e:fe:4f:ca", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd889e8-1b", "ovs_interfaceid": "3bd889e8-1b3d-4902-ad45-01a3b961d658", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 13:04:59 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:4f:ca,bridge_name='br-int',has_traffic_filtering=True,id=3bd889e8-1b3d-4902-ad45-01a3b961d658,network=Network(bb52f82e-56ca-41f7-b171-a3cacb549ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bd889e8-1b') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 13:04:59 user nova-compute[71321]: DEBUG os_vif [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:4f:ca,bridge_name='br-int',has_traffic_filtering=True,id=3bd889e8-1b3d-4902-ad45-01a3b961d658,network=Network(bb52f82e-56ca-41f7-b171-a3cacb549ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bd889e8-1b') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 13:04:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:04:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 13:04:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 13:04:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:04:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3bd889e8-1b, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 13:04:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3bd889e8-1b, col_values=(('external_ids', {'iface-id': '3bd889e8-1b3d-4902-ad45-01a3b961d658', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:4f:ca', 'vm-uuid': 'd1820783-afa6-434c-9da4-09d9c4990fa1'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 13:04:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:04:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:04:59 user nova-compute[71321]: INFO os_vif [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:4f:ca,bridge_name='br-int',has_traffic_filtering=True,id=3bd889e8-1b3d-4902-ad45-01a3b961d658,network=Network(bb52f82e-56ca-41f7-b171-a3cacb549ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bd889e8-1b')
Apr 12 13:04:59 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 13:04:59 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] No VIF found with MAC fa:16:3e:fe:4f:ca, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 13:05:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:05:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:05:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:05:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:05:01 user nova-compute[71321]: DEBUG nova.compute.manager [req-b46a7b89-009b-49b0-b32c-d7030c9e31cc req-e8405afd-671e-4065-a9ea-109ecd0d516f service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Received event network-vif-plugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:05:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b46a7b89-009b-49b0-b32c-d7030c9e31cc req-e8405afd-671e-4065-a9ea-109ecd0d516f service nova] Acquiring lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:05:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b46a7b89-009b-49b0-b32c-d7030c9e31cc req-e8405afd-671e-4065-a9ea-109ecd0d516f service nova] Lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:05:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b46a7b89-009b-49b0-b32c-d7030c9e31cc req-e8405afd-671e-4065-a9ea-109ecd0d516f service nova] Lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:05:01 user nova-compute[71321]: DEBUG nova.compute.manager [req-b46a7b89-009b-49b0-b32c-d7030c9e31cc req-e8405afd-671e-4065-a9ea-109ecd0d516f service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] No waiting events found dispatching network-vif-plugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:05:01 user nova-compute[71321]: WARNING nova.compute.manager [req-b46a7b89-009b-49b0-b32c-d7030c9e31cc req-e8405afd-671e-4065-a9ea-109ecd0d516f service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Received unexpected event network-vif-plugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 for instance with vm_state building and task_state spawning.
Apr 12 13:05:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:05:03 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681304703.0522423, d1820783-afa6-434c-9da4-09d9c4990fa1 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 13:05:03 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] VM Resumed (Lifecycle Event)
Apr 12 13:05:03 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 13:05:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 13:05:03 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Instance spawned successfully.
Apr 12 13:05:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 13:05:03 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 13:05:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 13:05:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 13:05:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 13:05:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 13:05:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 13:05:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 13:05:03 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 13:05:03 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 13:05:03 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681304703.0536823, d1820783-afa6-434c-9da4-09d9c4990fa1 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 13:05:03 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] VM Started (Lifecycle Event)
Apr 12 13:05:03 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 13:05:03 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 13:05:03 user nova-compute[71321]: INFO nova.compute.manager [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Took 4.87 seconds to spawn the instance on the hypervisor.
Apr 12 13:05:03 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 13:05:03 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 13:05:03 user nova-compute[71321]: DEBUG nova.compute.manager [req-d3337608-c0be-42c4-85b6-8dff67823352 req-bcce8bdd-a272-4b2b-b3bf-f3be323e8202 service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Received event network-vif-plugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:05:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d3337608-c0be-42c4-85b6-8dff67823352 req-bcce8bdd-a272-4b2b-b3bf-f3be323e8202 service nova] Acquiring lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:05:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d3337608-c0be-42c4-85b6-8dff67823352 req-bcce8bdd-a272-4b2b-b3bf-f3be323e8202 service nova] Lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:05:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d3337608-c0be-42c4-85b6-8dff67823352 req-bcce8bdd-a272-4b2b-b3bf-f3be323e8202 service nova] Lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:05:03 user nova-compute[71321]: DEBUG nova.compute.manager [req-d3337608-c0be-42c4-85b6-8dff67823352 req-bcce8bdd-a272-4b2b-b3bf-f3be323e8202 service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] No waiting events found dispatching network-vif-plugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:05:03 user nova-compute[71321]: WARNING nova.compute.manager [req-d3337608-c0be-42c4-85b6-8dff67823352 req-bcce8bdd-a272-4b2b-b3bf-f3be323e8202 service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Received unexpected event network-vif-plugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 for instance with vm_state building and task_state spawning.
Apr 12 13:05:03 user nova-compute[71321]: INFO nova.compute.manager [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Took 15.90 seconds to build instance.
Apr 12 13:05:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "d1820783-afa6-434c-9da4-09d9c4990fa1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:05:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:05:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:05:09 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:05:09 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Cleaning up deleted instances {{(pid=71321) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 13:05:09 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] There are 0 instances to clean {{(pid=71321) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 13:05:09 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:05:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:05:11 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:05:11 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Triggering sync for uuid e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 {{(pid=71321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 13:05:11 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Triggering sync for uuid 38198e86-bd23-4196-98a0-79455206305f {{(pid=71321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 13:05:11 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Triggering sync for uuid e47cf07b-9759-4350-9e10-bd5bb15678f3 {{(pid=71321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 13:05:11 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Triggering sync for uuid acd99758-64c1-4852-b906-e5f941868a8e {{(pid=71321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 13:05:11 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Triggering sync for uuid 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 {{(pid=71321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 13:05:11 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Triggering sync for uuid d1820783-afa6-434c-9da4-09d9c4990fa1 {{(pid=71321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 13:05:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:05:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:05:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "38198e86-bd23-4196-98a0-79455206305f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:05:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "38198e86-bd23-4196-98a0-79455206305f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:05:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "e47cf07b-9759-4350-9e10-bd5bb15678f3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:05:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "e47cf07b-9759-4350-9e10-bd5bb15678f3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:05:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "acd99758-64c1-4852-b906-e5f941868a8e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:05:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "acd99758-64c1-4852-b906-e5f941868a8e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:05:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:05:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:05:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "d1820783-afa6-434c-9da4-09d9c4990fa1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:05:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "d1820783-afa6-434c-9da4-09d9c4990fa1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:05:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "38198e86-bd23-4196-98a0-79455206305f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:05:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "e47cf07b-9759-4350-9e10-bd5bb15678f3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:05:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:05:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:05:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "acd99758-64c1-4852-b906-e5f941868a8e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:05:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "d1820783-afa6-434c-9da4-09d9c4990fa1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:05:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:05:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:05:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:05:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:05:24 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:05:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:05:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:05:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:05:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:05:39 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:05:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:05:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:05:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:05:39 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 13:05:39 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 13:05:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:05:39 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:05:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:05:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:05:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:05:39 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 13:05:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:05:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:05:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:05:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:05:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:05:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:05:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:05:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:05:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:05:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:05:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:05:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:05:41 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:05:41 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:05:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8384MB free_disk=26.03438949584961GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 13:05:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:05:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:05:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:05:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 38198e86-bd23-4196-98a0-79455206305f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:05:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance e47cf07b-9759-4350-9e10-bd5bb15678f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:05:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance acd99758-64c1-4852-b906-e5f941868a8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:05:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:05:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance d1820783-afa6-434c-9da4-09d9c4990fa1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:05:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 13:05:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 13:05:41 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Refreshing inventories for resource provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 13:05:41 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Updating ProviderTree inventory for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 13:05:41 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Updating inventory in ProviderTree for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 13:05:41 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Refreshing aggregate associations for resource provider 7ca624fd-d5cc-42af-93e3-9d62256fa231, aggregates: None {{(pid=71321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 13:05:41 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Refreshing trait associations for resource provider 7ca624fd-d5cc-42af-93e3-9d62256fa231, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=71321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 13:05:41 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 13:05:41 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 13:05:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 13:05:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.636s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:05:42 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:05:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:05:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:05:46 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:05:46 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:05:46 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 13:05:47 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:05:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:05:50 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:05:51 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:05:51 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 13:05:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-acd99758-64c1-4852-b906-e5f941868a8e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 13:05:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-acd99758-64c1-4852-b906-e5f941868a8e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 13:05:51 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 13:05:51 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Updating instance_info_cache with network_info: [{"id": "6afd3a74-bd8e-488e-be66-9f25ef4dce8d", "address": "fa:16:3e:f3:14:cc", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afd3a74-bd", "ovs_interfaceid": "6afd3a74-bd8e-488e-be66-9f25ef4dce8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:05:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-acd99758-64c1-4852-b906-e5f941868a8e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 13:05:51 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 13:05:52 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:05:52 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:05:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:05:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:05:55 user nova-compute[71321]: DEBUG nova.compute.manager [req-89a4a9e7-c959-4493-a586-8507db0ba179 req-86a60f4f-b08c-416e-8e6a-b58b21099985 service nova] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Received event network-changed-f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:05:55 user nova-compute[71321]: DEBUG nova.compute.manager [req-89a4a9e7-c959-4493-a586-8507db0ba179 req-86a60f4f-b08c-416e-8e6a-b58b21099985 service nova] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Refreshing instance network info cache due to event network-changed-f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 13:05:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-89a4a9e7-c959-4493-a586-8507db0ba179 req-86a60f4f-b08c-416e-8e6a-b58b21099985 service nova] Acquiring lock "refresh_cache-2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 13:05:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-89a4a9e7-c959-4493-a586-8507db0ba179 req-86a60f4f-b08c-416e-8e6a-b58b21099985 service nova] Acquired lock "refresh_cache-2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 13:05:55 user nova-compute[71321]: DEBUG nova.network.neutron [req-89a4a9e7-c959-4493-a586-8507db0ba179 req-86a60f4f-b08c-416e-8e6a-b58b21099985 service nova] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Refreshing network info cache for port f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 13:05:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:05:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:05:55 user nova-compute[71321]: DEBUG nova.objects.instance [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lazy-loading 'flavor' on Instance uuid 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:05:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:05:56 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:05:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:05:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:05:56 user nova-compute[71321]: INFO nova.compute.manager [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Attaching volume 951427af-91f8-4372-b076-f1f3998ccff0 to /dev/vdb
Apr 12 13:05:56 user nova-compute[71321]: DEBUG os_brick.utils [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 13:05:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:05:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:05:56 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[59388799-8209-4109-afbb-344b4cf9f18b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f0597cb7ad88\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:05:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:05:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:05:56 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9831836-eb00-43f3-b929-0eeb7c30532f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:05:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:05:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:05:56 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fb3eab-3a5d-475f-9d72-aa2727ce363f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:05:56 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07c4375-e364-46fd-8c3b-807c09fd9809]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:05:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Running cmd (subprocess): nvme version {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:05:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] 'nvme version' failed. Not Retrying. {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 13:05:56 user nova-compute[71321]: DEBUG nova.network.neutron [req-89a4a9e7-c959-4493-a586-8507db0ba179 req-86a60f4f-b08c-416e-8e6a-b58b21099985 service nova] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Updated VIF entry in instance network info cache for port f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 13:05:56 user nova-compute[71321]: DEBUG nova.network.neutron [req-89a4a9e7-c959-4493-a586-8507db0ba179 req-86a60f4f-b08c-416e-8e6a-b58b21099985 service nova] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Updating instance_info_cache with network_info: [{"id": "f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac", "address": "fa:16:3e:c9:39:a4", "network": {"id": "f7ac30df-76aa-400e-868d-9ad902bd9446", "bridge": "br-int", "label": "tempest-TestStampPattern-423905686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51e624010914d7680080956cbb0c720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b0ea0e-f3", "ovs_interfaceid": "f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:05:56 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] nvme not present on system {{(pid=71321) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 13:05:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:05:56 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 13:05:56 user nova-compute[71321]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 13:05:56 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[670c7c96-3d43-44e8-8796-50bc02fb0c35]: (4, '') {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:05:56 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71321) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 13:05:56 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 13:05:56 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.lightos [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] LIGHTOS: no hostnqn found. {{(pid=71321) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 13:05:56 user nova-compute[71321]: DEBUG os_brick.utils [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f0597cb7ad88', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 13:05:56 user nova-compute[71321]: DEBUG nova.virt.block_device [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Updating existing volume attachment record: b882a7c1-98c2-45b0-9b28-08ecc996b81b {{(pid=71321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 13:05:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-89a4a9e7-c959-4493-a586-8507db0ba179 req-86a60f4f-b08c-416e-8e6a-b58b21099985 service nova] Releasing lock "refresh_cache-2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 13:05:59 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TspGDJRh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 13:06:00 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 13:06:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 13:06:00 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 13:06:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 13:06:00 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 13:06:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b33bc95-5ec2-4e83-9d04-fa4d3d0456ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 13:06:00 user nova-compute[71321]:  {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[99993df7-0e29-4884-9feb-b51514039b2c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0] added\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0] added
Apr 12 13:06:00 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9362de55-6852-4ca1-85c0-bca39a45cbed]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a76b07-f5f4-4908-8947-e98ca214f8bc]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TspGDJRh {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TspGDJRh" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[5137d015-588b-4bc4-a9e4-573640670146]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TspGDJRh'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[43931635-d036-4de7-8a81-839890662b0d]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8ad81d-af64-4c7f-947a-b4d411ea3da0]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 13:06:00 user nova-compute[71321]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 (non-flash)
Apr 12 13:06:00 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 13:06:00 user nova-compute[71321]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 (non-flash)
Apr 12 13:06:00 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0 -p 172.16.0.220:3260 --login {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4a8cb2-62da-4519-b894-4d8971c278e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0, portal: 172.16.0.220,3260]
Apr 12 13:06:00 user nova-compute[71321]: Login to [iface: default, target: iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0, portal: 172.16.0.220,3260] successful.
Apr 12 13:06:00 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc13f08-fa4e-408f-80b9-147c2241b8d5]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[0887831a-b762-4d30-96d6-696a59f261dd]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 13:06:00 user nova-compute[71321]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 (non-flash)
Apr 12 13:06:00 user nova-compute[71321]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0 (non-flash)
Apr 12 13:06:00 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 13:06:00 user nova-compute[71321]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 (non-flash)
Apr 12 13:06:00 user nova-compute[71321]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0 (non-flash)
Apr 12 13:06:00 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] HCTL ('35', '-', '-', 0) found on session 54 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1f1cb5-094b-4f82-be57-aa04c17f4910]: (4, ('- - 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:06:00 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: None {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 13:06:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:01 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 13:06:01 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TspGDJRh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 13:06:01 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 13:06:01 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26361373431373030', 'path': '/dev/sdd'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 13:06:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361373431373030', 'path': '/dev/sdd'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 13:06:01 user nova-compute[71321]: DEBUG nova.objects.instance [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lazy-loading 'flavor' on Instance uuid 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:06:01 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 13:06:01 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 13:06:01 user nova-compute[71321]:   <source dev="/dev/sdd"/>
Apr 12 13:06:01 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 13:06:01 user nova-compute[71321]:   <serial>951427af-91f8-4372-b076-f1f3998ccff0</serial>
Apr 12 13:06:01 user nova-compute[71321]: </disk>
Apr 12 13:06:01 user nova-compute[71321]:  {{(pid=71321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 13:06:02 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 13:06:02 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 13:06:02 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] No VIF found with MAC fa:16:3e:c9:39:a4, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 13:06:02 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.293s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:06:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:06:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:06:03 user nova-compute[71321]: INFO nova.compute.manager [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Detaching volume 951427af-91f8-4372-b076-f1f3998ccff0
Apr 12 13:06:03 user nova-compute[71321]: INFO nova.virt.block_device [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Attempting to driver detach volume 951427af-91f8-4372-b076-f1f3998ccff0 from mountpoint /dev/vdb
Apr 12 13:06:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Attempting to detach device vdb from instance 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 from the persistent domain config. {{(pid=71321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 13:06:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 13:06:03 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 13:06:03 user nova-compute[71321]:   <source dev="/dev/sdd"/>
Apr 12 13:06:03 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 13:06:03 user nova-compute[71321]:   <serial>951427af-91f8-4372-b076-f1f3998ccff0</serial>
Apr 12 13:06:03 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 13:06:03 user nova-compute[71321]: </disk>
Apr 12 13:06:03 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 13:06:03 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Successfully detached device vdb from instance 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 from the persistent domain config.
Apr 12 13:06:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 from the live domain config. {{(pid=71321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 13:06:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.guest [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 13:06:03 user nova-compute[71321]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 13:06:03 user nova-compute[71321]:   <source dev="/dev/sdd"/>
Apr 12 13:06:03 user nova-compute[71321]:   <target dev="vdb" bus="virtio"/>
Apr 12 13:06:03 user nova-compute[71321]:   <serial>951427af-91f8-4372-b076-f1f3998ccff0</serial>
Apr 12 13:06:03 user nova-compute[71321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 13:06:03 user nova-compute[71321]: </disk>
Apr 12 13:06:03 user nova-compute[71321]:  {{(pid=71321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 13:06:03 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Received event <DeviceRemovedEvent: 1681304763.9965854, 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 {{(pid=71321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 13:06:04 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Successfully detached device vdb from instance 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 from the live domain config.
Apr 12 13:06:04 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TspGDJRh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 13:06:04 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 13:06:04 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[6987ffd3-f691-4c82-96e6-61b26c2920dc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 13:06:04 user nova-compute[71321]: No targets found.
Apr 12 13:06:04 user nova-compute[71321]: iSNS:
Apr 12 13:06:04 user nova-compute[71321]: No targets found.
Apr 12 13:06:04 user nova-compute[71321]: STATIC:
Apr 12 13:06:04 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2
Apr 12 13:06:04 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 13:06:04 user nova-compute[71321]:                 Iface Name: default
Apr 12 13:06:04 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498
Apr 12 13:06:04 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 13:06:04 user nova-compute[71321]:                 Iface Name: default
Apr 12 13:06:04 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0
Apr 12 13:06:04 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 13:06:04 user nova-compute[71321]:                 Iface Name: default
Apr 12 13:06:04 user nova-compute[71321]: FIRMWARE:
Apr 12 13:06:04 user nova-compute[71321]: No targets found.
Apr 12 13:06:04 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 13:06:04 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 13:06:04 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21e5474-7cc0-4a26-9d47-fcfcdcd04872]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ba6c79-326a-4ac5-b084-9b3b3aa7a3bd]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 13:06:04 user nova-compute[71321]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 (non-flash)
Apr 12 13:06:04 user nova-compute[71321]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0 (non-flash)
Apr 12 13:06:04 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 13:06:04 user nova-compute[71321]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 (non-flash)
Apr 12 13:06:04 user nova-compute[71321]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0 (non-flash)
Apr 12 13:06:04 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef443697e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0'): ({'sdd'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Removing single pathed devices sdd {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[706877dd-ec7d-43c2-92de-4fe2b3920a0a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3451732-5c5a-4cae-bb79-8d902795fb77]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Flushing IO for device /dev/sdd {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f120beb-4ed7-4b85-abad-33417ef7c143]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.028s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5a8acf-688a-41e4-9c3c-ca7366ee5663]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] SCSI volumes sdd have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1758993b-c852-478d-a8e4-135d19df29c6]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[122aa55f-a650-4ea3-8ebe-a9f433779db5]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0, portal: 172.16.0.220,3260]
Apr 12 13:06:04 user nova-compute[71321]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0, portal: 172.16.0.220,3260] successful.
Apr 12 13:06:04 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951427af-91f8-4372-b076-f1f3998ccff0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb106096-408d-4625-a2b4-37e62899dc6a]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] <== disconnect_volume: return (276ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 13:06:04 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:05 user nova-compute[71321]: DEBUG nova.objects.instance [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lazy-loading 'flavor' on Instance uuid 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:06:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.664s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:06:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:14 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:19 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:24 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:06:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:34 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:38 user nova-compute[71321]: INFO nova.compute.manager [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Rescuing
Apr 12 13:06:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "refresh_cache-d1820783-afa6-434c-9da4-09d9c4990fa1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 13:06:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquired lock "refresh_cache-d1820783-afa6-434c-9da4-09d9c4990fa1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 13:06:38 user nova-compute[71321]: DEBUG nova.network.neutron [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 13:06:38 user nova-compute[71321]: DEBUG nova.network.neutron [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Updating instance_info_cache with network_info: [{"id": "3bd889e8-1b3d-4902-ad45-01a3b961d658", "address": "fa:16:3e:fe:4f:ca", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd889e8-1b", "ovs_interfaceid": "3bd889e8-1b3d-4902-ad45-01a3b961d658", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:06:38 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Releasing lock "refresh_cache-d1820783-afa6-434c-9da4-09d9c4990fa1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 13:06:39 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-3d3e0539-1df2-431b-8ee1-22dbe3832f65 req-86864e69-360a-4636-82a5-88a5b77b1eab service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Received event network-vif-unplugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:06:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3d3e0539-1df2-431b-8ee1-22dbe3832f65 req-86864e69-360a-4636-82a5-88a5b77b1eab service nova] Acquiring lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:06:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3d3e0539-1df2-431b-8ee1-22dbe3832f65 req-86864e69-360a-4636-82a5-88a5b77b1eab service nova] Lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:06:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-3d3e0539-1df2-431b-8ee1-22dbe3832f65 req-86864e69-360a-4636-82a5-88a5b77b1eab service nova] Lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:06:39 user nova-compute[71321]: DEBUG nova.compute.manager [req-3d3e0539-1df2-431b-8ee1-22dbe3832f65 req-86864e69-360a-4636-82a5-88a5b77b1eab service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] No waiting events found dispatching network-vif-unplugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:06:39 user nova-compute[71321]: WARNING nova.compute.manager [req-3d3e0539-1df2-431b-8ee1-22dbe3832f65 req-86864e69-360a-4636-82a5-88a5b77b1eab service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Received unexpected event network-vif-unplugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 for instance with vm_state active and task_state rescuing.
Apr 12 13:06:39 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:39 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:39 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:06:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:06:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:06:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:06:39 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 13:06:39 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:39 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:39 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Instance destroyed successfully.
Apr 12 13:06:39 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Attempting a stable device rescue
Apr 12 13:06:39 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71321) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 13:06:39 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Instance directory exists: not creating {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 13:06:39 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Creating image(s)
Apr 12 13:06:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "/opt/stack/data/nova/instances/d1820783-afa6-434c-9da4-09d9c4990fa1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:06:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "/opt/stack/data/nova/instances/d1820783-afa6-434c-9da4-09d9c4990fa1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:06:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "/opt/stack/data/nova/instances/d1820783-afa6-434c-9da4-09d9c4990fa1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:06:39 user nova-compute[71321]: DEBUG nova.objects.instance [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lazy-loading 'trusted_certs' on Instance uuid d1820783-afa6-434c-9da4-09d9c4990fa1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:06:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "298eada47c4bcaf382318991c6a66d74b1bb9d25" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:06:39 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "298eada47c4bcaf382318991c6a66d74b1bb9d25" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:06:39 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 13:06:39 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/298eada47c4bcaf382318991c6a66d74b1bb9d25.part --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json" returned: 0 in 0.855s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/298eada47c4bcaf382318991c6a66d74b1bb9d25.part --force-share --output=json" returned: 0 in 0.136s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:40 user nova-compute[71321]: DEBUG nova.virt.images [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 29f26fe8-ee5c-401f-be18-735ba4a5665d was qcow2, converting to raw {{(pid=71321) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 13:06:40 user nova-compute[71321]: DEBUG nova.privsep.utils [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 13:06:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/298eada47c4bcaf382318991c6a66d74b1bb9d25.part /opt/stack/data/nova/instances/_base/298eada47c4bcaf382318991c6a66d74b1bb9d25.converted {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:40 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 13:06:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/298eada47c4bcaf382318991c6a66d74b1bb9d25.part /opt/stack/data/nova/instances/_base/298eada47c4bcaf382318991c6a66d74b1bb9d25.converted" returned: 0 in 0.283s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/298eada47c4bcaf382318991c6a66d74b1bb9d25.converted --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/298eada47c4bcaf382318991c6a66d74b1bb9d25.converted --force-share --output=json" returned: 0 in 0.135s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "298eada47c4bcaf382318991c6a66d74b1bb9d25" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.462s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "298eada47c4bcaf382318991c6a66d74b1bb9d25" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "298eada47c4bcaf382318991c6a66d74b1bb9d25" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/298eada47c4bcaf382318991c6a66d74b1bb9d25 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG nova.compute.manager [req-c36205bb-1244-413a-964c-1b39c146436d req-6b14a158-188f-4c67-a486-184d38d4268d service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Received event network-vif-plugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c36205bb-1244-413a-964c-1b39c146436d req-6b14a158-188f-4c67-a486-184d38d4268d service nova] Acquiring lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c36205bb-1244-413a-964c-1b39c146436d req-6b14a158-188f-4c67-a486-184d38d4268d service nova] Lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c36205bb-1244-413a-964c-1b39c146436d req-6b14a158-188f-4c67-a486-184d38d4268d service nova] Lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG nova.compute.manager [req-c36205bb-1244-413a-964c-1b39c146436d req-6b14a158-188f-4c67-a486-184d38d4268d service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] No waiting events found dispatching network-vif-plugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:06:41 user nova-compute[71321]: WARNING nova.compute.manager [req-c36205bb-1244-413a-964c-1b39c146436d req-6b14a158-188f-4c67-a486-184d38d4268d service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Received unexpected event network-vif-plugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 for instance with vm_state active and task_state rescuing.
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/298eada47c4bcaf382318991c6a66d74b1bb9d25 --force-share --output=json" returned: 0 in 0.128s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/298eada47c4bcaf382318991c6a66d74b1bb9d25,backing_fmt=raw /opt/stack/data/nova/instances/d1820783-afa6-434c-9da4-09d9c4990fa1/disk.rescue {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/298eada47c4bcaf382318991c6a66d74b1bb9d25,backing_fmt=raw /opt/stack/data/nova/instances/d1820783-afa6-434c-9da4-09d9c4990fa1/disk.rescue" returned: 0 in 0.047s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "298eada47c4bcaf382318991c6a66d74b1bb9d25" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.181s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG nova.objects.instance [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lazy-loading 'migration_context' on Instance uuid d1820783-afa6-434c-9da4-09d9c4990fa1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Start _get_guest_xml network_info=[{"id": "3bd889e8-1b3d-4902-ad45-01a3b961d658", "address": "fa:16:3e:fe:4f:ca", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "vif_mac": "fa:16:3e:fe:4f:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd889e8-1b", "ovs_interfaceid": "3bd889e8-1b3d-4902-ad45-01a3b961d658", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '29f26fe8-ee5c-401f-be18-735ba4a5665d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd920fab2-9633-4e85-93d0-5f5a605a57b9', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TZaSwXbq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'd1820783-afa6-434c-9da4-09d9c4990fa1', 'attached_at': '', 'detached_at': '', 'volume_id': '8e136e31-e43a-4a77-b73d-50a179407498', 'serial': '8e136e31-e43a-4a77-b73d-50a179407498'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG nova.objects.instance [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lazy-loading 'resources' on Instance uuid d1820783-afa6-434c-9da4-09d9c4990fa1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG nova.objects.instance [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lazy-loading 'numa_topology' on Instance uuid d1820783-afa6-434c-9da4-09d9c4990fa1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:06:41 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:06:41 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:06:41 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG nova.objects.instance [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lazy-loading 'vcpu_model' on Instance uuid d1820783-afa6-434c-9da4-09d9c4990fa1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Calling os-brick to attach iSCSI Volume {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TZaSwXbq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 13:06:41 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 13:06:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 13:06:41 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 13:06:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 13:06:41 user nova-compute[71321]: INFO os_brick.initiator.connectors.iscsi [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 -p 172.16.0.220:3260 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[3850326c-317a-4303-9c47-9d79ba878139]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = TZaSwXbq\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 12 13:06:41 user nova-compute[71321]: node.name = iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498
Apr 12 13:06:41 user nova-compute[71321]: node.tpgt = -1
Apr 12 13:06:41 user nova-compute[71321]: node.startup = automatic
Apr 12 13:06:41 user nova-compute[71321]: node.leading_login = No
Apr 12 13:06:41 user nova-compute[71321]: iface.iscsi_ifacename = default
Apr 12 13:06:41 user nova-compute[71321]: iface.net_ifacename = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.ipaddress = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.prefix_len = 0
Apr 12 13:06:41 user nova-compute[71321]: iface.hwaddress = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.transport_name = tcp
Apr 12 13:06:41 user nova-compute[71321]: iface.initiatorname = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.state = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.vlan_id = 0
Apr 12 13:06:41 user nova-compute[71321]: iface.vlan_priority = 0
Apr 12 13:06:41 user nova-compute[71321]: iface.vlan_state = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.iface_num = 0
Apr 12 13:06:41 user nova-compute[71321]: iface.mtu = 0
Apr 12 13:06:41 user nova-compute[71321]: iface.port = 0
Apr 12 13:06:41 user nova-compute[71321]: iface.bootproto = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.subnet_mask = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.gateway = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.dhcp_alt_client_id_state = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.dhcp_alt_client_id = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.dhcp_dns = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.dhcp_learn_iqn = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.dhcp_req_vendor_id_state = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.dhcp_vendor_id_state = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.dhcp_vendor_id = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.dhcp_slp_da = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.fragmentation = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.gratuitous_arp = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.incoming_forwarding = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.tos_state = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.tos = 0
Apr 12 13:06:41 user nova-compute[71321]: iface.ttl = 0
Apr 12 13:06:41 user nova-compute[71321]: iface.delayed_ack = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.tcp_nagle = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.tcp_wsf_state = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.tcp_wsf = 0
Apr 12 13:06:41 user nova-compute[71321]: iface.tcp_timer_scale = 0
Apr 12 13:06:41 user nova-compute[71321]: iface.tcp_timestamp = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.redirect = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.def_task_mgmt_timeout = 0
Apr 12 13:06:41 user nova-compute[71321]: iface.header_digest = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.data_digest = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.immediate_data = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.initial_r2t = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.data_seq_inorder = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.data_pdu_inorder = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.erl = 0
Apr 12 13:06:41 user nova-compute[71321]: iface.max_receive_data_len = 0
Apr 12 13:06:41 user nova-compute[71321]: iface.first_burst_len = 0
Apr 12 13:06:41 user nova-compute[71321]: iface.max_outstanding_r2t = 0
Apr 12 13:06:41 user nova-compute[71321]: iface.max_burst_len = 0
Apr 12 13:06:41 user nova-compute[71321]: iface.chap_auth = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.bidi_chap = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.strict_login_compliance = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.discovery_auth = <empty>
Apr 12 13:06:41 user nova-compute[71321]: iface.discovery_logout = <empty>
Apr 12 13:06:41 user nova-compute[71321]: node.discovery_address = <empty>
Apr 12 13:06:41 user nova-compute[71321]: node.discovery_port = 0
Apr 12 13:06:41 user nova-compute[71321]: node.discovery_type = static
Apr 12 13:06:41 user nova-compute[71321]: node.session.initial_cmdsn = 0
Apr 12 13:06:41 user nova-compute[71321]: node.session.initial_login_retry_max = 8
Apr 12 13:06:41 user nova-compute[71321]: node.session.xmit_thread_priority = -20
Apr 12 13:06:41 user nova-compute[71321]: node.session.cmds_max = 128
Apr 12 13:06:41 user nova-compute[71321]: node.session.queue_depth = 32
Apr 12 13:06:41 user nova-compute[71321]: node.session.nr_sessions = 1
Apr 12 13:06:41 user nova-compute[71321]: node.session.auth.authmethod = CHAP
Apr 12 13:06:41 user nova-compute[71321]: node.session.auth.username = TZaSwXbq
Apr 12 13:06:41 user nova-compute[71321]: node.session.auth.password = ***
Apr 12 13:06:41 user nova-compute[71321]: node.session.auth.username_in = <empty>
Apr 12 13:06:41 user nova-compute[71321]: node.session.auth.password_in = <empty>
Apr 12 13:06:41 user nova-compute[71321]: node.session.auth.chap_algs = MD5
Apr 12 13:06:41 user nova-compute[71321]: node.session.timeo.replacement_timeout = 120
Apr 12 13:06:41 user nova-compute[71321]: node.session.err_timeo.abort_timeout = 15
Apr 12 13:06:41 user nova-compute[71321]: node.session.err_timeo.lu_reset_timeout = 30
Apr 12 13:06:41 user nova-compute[71321]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 12 13:06:41 user nova-compute[71321]: node.session.err_timeo.host_reset_timeout = 60
Apr 12 13:06:41 user nova-compute[71321]: node.session.iscsi.FastAbort = Yes
Apr 12 13:06:41 user nova-compute[71321]: node.session.iscsi.InitialR2T = No
Apr 12 13:06:41 user nova-compute[71321]: node.session.iscsi.ImmediateData = Yes
Apr 12 13:06:41 user nova-compute[71321]: node.session.iscsi.FirstBurstLength = 262144
Apr 12 13:06:41 user nova-compute[71321]: node.session.iscsi.MaxBurstLength = 16776192
Apr 12 13:06:41 user nova-compute[71321]: node.session.iscsi.DefaultTime2Retain = 0
Apr 12 13:06:41 user nova-compute[71321]: node.session.iscsi.DefaultTime2Wait = 2
Apr 12 13:06:41 user nova-compute[71321]: node.session.iscsi.MaxConnections = 1
Apr 12 13:06:41 user nova-compute[71321]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 12 13:06:41 user nova-compute[71321]: node.session.iscsi.ERL = 0
Apr 12 13:06:41 user nova-compute[71321]: node.session.scan = manual
Apr 12 13:06:41 user nova-compute[71321]: node.session.reopen_max = 0
Apr 12 13:06:41 user nova-compute[71321]: node.conn[0].address = 172.16.0.220
Apr 12 13:06:41 user nova-compute[71321]: node.conn[0].port = 3260
Apr 12 13:06:41 user nova-compute[71321]: node.conn[0].startup = manual
Apr 12 13:06:41 user nova-compute[71321]: node.conn[0].tcp.window_size = 524288
Apr 12 13:06:41 user nova-compute[71321]: node.conn[0].tcp.type_of_service = 0
Apr 12 13:06:41 user nova-compute[71321]: node.conn[0].timeo.logout_timeout = 15
Apr 12 13:06:41 user nova-compute[71321]: node.conn[0].timeo.login_timeout = 15
Apr 12 13:06:41 user nova-compute[71321]: node.conn[0].timeo.auth_timeout = 45
Apr 12 13:06:41 user nova-compute[71321]: node.conn[0].timeo.noop_out_interval = 5
Apr 12 13:06:41 user nova-compute[71321]: node.conn[0].timeo.noop_out_timeout = 5
Apr 12 13:06:41 user nova-compute[71321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 12 13:06:41 user nova-compute[71321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 12 13:06:41 user nova-compute[71321]: node.conn[0].iscsi.HeaderDigest = None
Apr 12 13:06:41 user nova-compute[71321]: node.conn[0].iscsi.DataDigest = None
Apr 12 13:06:41 user nova-compute[71321]: node.conn[0].iscsi.IFMarker = No
Apr 12 13:06:41 user nova-compute[71321]: node.conn[0].iscsi.OFMarker = No
Apr 12 13:06:41 user nova-compute[71321]: # END RECORD
Apr 12 13:06:41 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45c3b21-e1e2-42aa-bf80-1c0feed233bf]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d20d9c6-045b-4788-9c25-3a64fa9710da]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TZaSwXbq {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TZaSwXbq" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d716db-fd74-482b-9a3a-52e596986980]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TZaSwXbq'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[19191f55-1f55-4181-9cf2-4dcdb4f3c9f9]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7c962f-9967-41e4-b6e3-855f5e8cdf40]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 13:06:41 user nova-compute[71321]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 (non-flash)
Apr 12 13:06:41 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 13:06:41 user nova-compute[71321]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 (non-flash)
Apr 12 13:06:41 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.189s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Connected to 172.16.0.220:3260 {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] HCTL ('34', '0', '0', 0) found on session 53 with lun 0 {{(pid=71321) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 13:06:41 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=71321) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 13:06:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:06:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:06:42 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[549176b0-b91d-4f8c-98cf-df9a750691c7]: (4, ('0 0 0', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:06:42 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Searching for a device in session 53 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=71321) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 13:06:42 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TZaSwXbq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71321) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 13:06:42 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.581s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 13:06:42 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] <== connect_volume: return (583ms) {'type': 'block', 'scsi_wwn': '23166613363613561', 'path': '/dev/sdc'} {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 13:06:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166613363613561', 'path': '/dev/sdc'} {{(pid=71321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 13:06:42 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:06:42 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:06:42 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8501MB free_disk=26.033241271972656GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 13:06:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:06:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:06:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T13:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1366095873',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1366095873',id=46,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T13:05:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f20ad21427a04683b9b102d2ff0290a5',ramdisk_id='',reservation_id='r-rd8kq37i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-636247513',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T13:05:03Z,user_data=None,user_id='435e0d6fd2b3437f837e82730b4d955f',uuid=d1820783-afa6-434c-9da4-09d9c4990fa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3bd889e8-1b3d-4902-ad45-01a3b961d658", "address": "fa:16:3e:fe:4f:ca", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "vif_mac": "fa:16:3e:fe:4f:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd889e8-1b", "ovs_interfaceid": "3bd889e8-1b3d-4902-ad45-01a3b961d658", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 13:06:42 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Converting VIF {"id": "3bd889e8-1b3d-4902-ad45-01a3b961d658", "address": "fa:16:3e:fe:4f:ca", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "vif_mac": "fa:16:3e:fe:4f:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd889e8-1b", "ovs_interfaceid": "3bd889e8-1b3d-4902-ad45-01a3b961d658", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 13:06:42 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:4f:ca,bridge_name='br-int',has_traffic_filtering=True,id=3bd889e8-1b3d-4902-ad45-01a3b961d658,network=Network(bb52f82e-56ca-41f7-b171-a3cacb549ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bd889e8-1b') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 13:06:42 user nova-compute[71321]: DEBUG nova.objects.instance [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lazy-loading 'pci_devices' on Instance uuid d1820783-afa6-434c-9da4-09d9c4990fa1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:06:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] End _get_guest_xml xml=<domain type="kvm">
Apr 12 13:06:42 user nova-compute[71321]:   <uuid>d1820783-afa6-434c-9da4-09d9c4990fa1</uuid>
Apr 12 13:06:42 user nova-compute[71321]:   <name>instance-0000002e</name>
Apr 12 13:06:42 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 13:06:42 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 13:06:42 user nova-compute[71321]:   <metadata>
Apr 12 13:06:42 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 13:06:42 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 13:06:42 user nova-compute[71321]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1366095873</nova:name>
Apr 12 13:06:42 user nova-compute[71321]:       <nova:creationTime>2023-04-12 13:06:41</nova:creationTime>
Apr 12 13:06:42 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 13:06:42 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 13:06:42 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 13:06:42 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 13:06:42 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 13:06:42 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 13:06:42 user nova-compute[71321]:       </nova:flavor>
Apr 12 13:06:42 user nova-compute[71321]:       <nova:owner>
Apr 12 13:06:42 user nova-compute[71321]:         <nova:user uuid="435e0d6fd2b3437f837e82730b4d955f">tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member</nova:user>
Apr 12 13:06:42 user nova-compute[71321]:         <nova:project uuid="f20ad21427a04683b9b102d2ff0290a5">tempest-ServerBootFromVolumeStableRescueTest-636247513</nova:project>
Apr 12 13:06:42 user nova-compute[71321]:       </nova:owner>
Apr 12 13:06:42 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 13:06:42 user nova-compute[71321]:       <nova:ports>
Apr 12 13:06:42 user nova-compute[71321]:         <nova:port uuid="3bd889e8-1b3d-4902-ad45-01a3b961d658">
Apr 12 13:06:42 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 13:06:42 user nova-compute[71321]:         </nova:port>
Apr 12 13:06:42 user nova-compute[71321]:       </nova:ports>
Apr 12 13:06:42 user nova-compute[71321]:     </nova:instance>
Apr 12 13:06:42 user nova-compute[71321]:   </metadata>
Apr 12 13:06:42 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 13:06:42 user nova-compute[71321]:     <system>
Apr 12 13:06:42 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 13:06:42 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 13:06:42 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 13:06:42 user nova-compute[71321]:       <entry name="serial">d1820783-afa6-434c-9da4-09d9c4990fa1</entry>
Apr 12 13:06:42 user nova-compute[71321]:       <entry name="uuid">d1820783-afa6-434c-9da4-09d9c4990fa1</entry>
Apr 12 13:06:42 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 13:06:42 user nova-compute[71321]:     </system>
Apr 12 13:06:42 user nova-compute[71321]:   </sysinfo>
Apr 12 13:06:42 user nova-compute[71321]:   <os>
Apr 12 13:06:42 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 13:06:42 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 13:06:42 user nova-compute[71321]:   </os>
Apr 12 13:06:42 user nova-compute[71321]:   <features>
Apr 12 13:06:42 user nova-compute[71321]:     <acpi/>
Apr 12 13:06:42 user nova-compute[71321]:     <apic/>
Apr 12 13:06:42 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 13:06:42 user nova-compute[71321]:   </features>
Apr 12 13:06:42 user nova-compute[71321]:   <clock offset="utc">
Apr 12 13:06:42 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 13:06:42 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 13:06:42 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 13:06:42 user nova-compute[71321]:   </clock>
Apr 12 13:06:42 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 13:06:42 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 13:06:42 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 13:06:42 user nova-compute[71321]:   </cpu>
Apr 12 13:06:42 user nova-compute[71321]:   <devices>
Apr 12 13:06:42 user nova-compute[71321]:     <disk type="block" device="disk">
Apr 12 13:06:42 user nova-compute[71321]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 13:06:42 user nova-compute[71321]:       <source dev="/dev/sdc"/>
Apr 12 13:06:42 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 13:06:42 user nova-compute[71321]:       <serial>8e136e31-e43a-4a77-b73d-50a179407498</serial>
Apr 12 13:06:42 user nova-compute[71321]:     </disk>
Apr 12 13:06:42 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 13:06:42 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 13:06:42 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/d1820783-afa6-434c-9da4-09d9c4990fa1/disk.rescue"/>
Apr 12 13:06:42 user nova-compute[71321]:       <target dev="vdb" bus="virtio"/>
Apr 12 13:06:42 user nova-compute[71321]:       <boot order="1"/>
Apr 12 13:06:42 user nova-compute[71321]:     </disk>
Apr 12 13:06:42 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 13:06:42 user nova-compute[71321]:       <mac address="fa:16:3e:fe:4f:ca"/>
Apr 12 13:06:42 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 13:06:42 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 13:06:42 user nova-compute[71321]:       <target dev="tap3bd889e8-1b"/>
Apr 12 13:06:42 user nova-compute[71321]:     </interface>
Apr 12 13:06:42 user nova-compute[71321]:     <serial type="pty">
Apr 12 13:06:42 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/d1820783-afa6-434c-9da4-09d9c4990fa1/console.log" append="off"/>
Apr 12 13:06:42 user nova-compute[71321]:     </serial>
Apr 12 13:06:42 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 13:06:42 user nova-compute[71321]:     <video>
Apr 12 13:06:42 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 13:06:42 user nova-compute[71321]:     </video>
Apr 12 13:06:42 user nova-compute[71321]:     <rng model="virtio">
Apr 12 13:06:42 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 13:06:42 user nova-compute[71321]:     </rng>
Apr 12 13:06:42 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 13:06:42 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 13:06:42 user nova-compute[71321]:       <stats period="10"/>
Apr 12 13:06:42 user nova-compute[71321]:     </memballoon>
Apr 12 13:06:42 user nova-compute[71321]:   </devices>
Apr 12 13:06:42 user nova-compute[71321]: </domain>
Apr 12 13:06:42 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 13:06:42 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Instance destroyed successfully.
Apr 12 13:06:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 13:06:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 13:06:42 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] No VIF found with MAC fa:16:3e:fe:4f:ca, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 13:06:42 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:06:42 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 38198e86-bd23-4196-98a0-79455206305f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:06:42 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance e47cf07b-9759-4350-9e10-bd5bb15678f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:06:42 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance acd99758-64c1-4852-b906-e5f941868a8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:06:42 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:06:42 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance d1820783-afa6-434c-9da4-09d9c4990fa1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:06:42 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 13:06:42 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 13:06:42 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 13:06:42 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 13:06:42 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 13:06:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.436s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:06:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:43 user nova-compute[71321]: DEBUG nova.compute.manager [req-d6f59256-9c47-489e-bf91-6a1d8e727a70 req-afba8b3f-c0df-45a1-aa46-a8b1982d3d29 service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Received event network-vif-plugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:06:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d6f59256-9c47-489e-bf91-6a1d8e727a70 req-afba8b3f-c0df-45a1-aa46-a8b1982d3d29 service nova] Acquiring lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:06:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d6f59256-9c47-489e-bf91-6a1d8e727a70 req-afba8b3f-c0df-45a1-aa46-a8b1982d3d29 service nova] Lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:06:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-d6f59256-9c47-489e-bf91-6a1d8e727a70 req-afba8b3f-c0df-45a1-aa46-a8b1982d3d29 service nova] Lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:06:43 user nova-compute[71321]: DEBUG nova.compute.manager [req-d6f59256-9c47-489e-bf91-6a1d8e727a70 req-afba8b3f-c0df-45a1-aa46-a8b1982d3d29 service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] No waiting events found dispatching network-vif-plugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:06:43 user nova-compute[71321]: WARNING nova.compute.manager [req-d6f59256-9c47-489e-bf91-6a1d8e727a70 req-afba8b3f-c0df-45a1-aa46-a8b1982d3d29 service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Received unexpected event network-vif-plugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 for instance with vm_state active and task_state rescuing.
Apr 12 13:06:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:44 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:06:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:45 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Removed pending event for d1820783-afa6-434c-9da4-09d9c4990fa1 due to event {{(pid=71321) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 13:06:45 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681304805.8082638, d1820783-afa6-434c-9da4-09d9c4990fa1 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 13:06:45 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] VM Resumed (Lifecycle Event)
Apr 12 13:06:45 user nova-compute[71321]: DEBUG nova.compute.manager [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 13:06:45 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 13:06:45 user nova-compute[71321]: DEBUG nova.compute.manager [req-91b4ed2e-9274-4bba-ba12-e4e787f3be88 req-ea168d95-754d-4735-bd95-6d7f2751b2c9 service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Received event network-vif-plugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:06:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-91b4ed2e-9274-4bba-ba12-e4e787f3be88 req-ea168d95-754d-4735-bd95-6d7f2751b2c9 service nova] Acquiring lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:06:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-91b4ed2e-9274-4bba-ba12-e4e787f3be88 req-ea168d95-754d-4735-bd95-6d7f2751b2c9 service nova] Lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:06:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-91b4ed2e-9274-4bba-ba12-e4e787f3be88 req-ea168d95-754d-4735-bd95-6d7f2751b2c9 service nova] Lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:06:45 user nova-compute[71321]: DEBUG nova.compute.manager [req-91b4ed2e-9274-4bba-ba12-e4e787f3be88 req-ea168d95-754d-4735-bd95-6d7f2751b2c9 service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] No waiting events found dispatching network-vif-plugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:06:45 user nova-compute[71321]: WARNING nova.compute.manager [req-91b4ed2e-9274-4bba-ba12-e4e787f3be88 req-ea168d95-754d-4735-bd95-6d7f2751b2c9 service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Received unexpected event network-vif-plugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 for instance with vm_state active and task_state rescuing.
Apr 12 13:06:45 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 13:06:45 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 13:06:45 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681304805.809855, d1820783-afa6-434c-9da4-09d9c4990fa1 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 13:06:45 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] VM Started (Lifecycle Event)
Apr 12 13:06:45 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 13:06:45 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 13:06:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:48 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:06:48 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:06:48 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:06:48 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 13:06:49 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:06:49 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:50 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:06:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:51 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:06:51 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 13:06:51 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Rebuilding the list of instances to heal {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 13:06:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 13:06:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 13:06:51 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 13:06:51 user nova-compute[71321]: DEBUG nova.objects.instance [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lazy-loading 'info_cache' on Instance uuid e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:06:51 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Updating instance_info_cache with network_info: [{"id": "9f228391-1910-4bd3-b317-f1afa3e98a0f", "address": "fa:16:3e:bf:a8:a8", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f228391-19", "ovs_interfaceid": "9f228391-1910-4bd3-b317-f1afa3e98a0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:06:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 13:06:51 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 13:06:53 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:06:53 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:06:54 user nova-compute[71321]: DEBUG nova.compute.manager [req-9d309892-9058-4692-99d8-d30f4aefadf1 req-92856e83-06b6-4ecf-aa6e-33bb10f8299f service nova] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Received event network-changed-f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:06:54 user nova-compute[71321]: DEBUG nova.compute.manager [req-9d309892-9058-4692-99d8-d30f4aefadf1 req-92856e83-06b6-4ecf-aa6e-33bb10f8299f service nova] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Refreshing instance network info cache due to event network-changed-f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 13:06:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9d309892-9058-4692-99d8-d30f4aefadf1 req-92856e83-06b6-4ecf-aa6e-33bb10f8299f service nova] Acquiring lock "refresh_cache-2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 13:06:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9d309892-9058-4692-99d8-d30f4aefadf1 req-92856e83-06b6-4ecf-aa6e-33bb10f8299f service nova] Acquired lock "refresh_cache-2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 13:06:54 user nova-compute[71321]: DEBUG nova.network.neutron [req-9d309892-9058-4692-99d8-d30f4aefadf1 req-92856e83-06b6-4ecf-aa6e-33bb10f8299f service nova] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Refreshing network info cache for port f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 13:06:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3f31e1d7-ffe0-44b1-9a87-03578a79b2e3 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:06:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3f31e1d7-ffe0-44b1-9a87-03578a79b2e3 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:06:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3f31e1d7-ffe0-44b1-9a87-03578a79b2e3 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:06:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3f31e1d7-ffe0-44b1-9a87-03578a79b2e3 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:06:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3f31e1d7-ffe0-44b1-9a87-03578a79b2e3 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:06:54 user nova-compute[71321]: INFO nova.compute.manager [None req-3f31e1d7-ffe0-44b1-9a87-03578a79b2e3 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Terminating instance
Apr 12 13:06:54 user nova-compute[71321]: DEBUG nova.compute.manager [None req-3f31e1d7-ffe0-44b1-9a87-03578a79b2e3 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 13:06:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:54 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:54 user nova-compute[71321]: DEBUG nova.compute.manager [req-957cefdd-3f16-4d3e-8e37-c65a91827fc1 req-87112289-2b0a-4dac-822c-6ea68535f31d service nova] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Received event network-vif-unplugged-f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:06:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-957cefdd-3f16-4d3e-8e37-c65a91827fc1 req-87112289-2b0a-4dac-822c-6ea68535f31d service nova] Acquiring lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:06:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-957cefdd-3f16-4d3e-8e37-c65a91827fc1 req-87112289-2b0a-4dac-822c-6ea68535f31d service nova] Lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:06:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-957cefdd-3f16-4d3e-8e37-c65a91827fc1 req-87112289-2b0a-4dac-822c-6ea68535f31d service nova] Lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:06:54 user nova-compute[71321]: DEBUG nova.compute.manager [req-957cefdd-3f16-4d3e-8e37-c65a91827fc1 req-87112289-2b0a-4dac-822c-6ea68535f31d service nova] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] No waiting events found dispatching network-vif-unplugged-f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:06:54 user nova-compute[71321]: DEBUG nova.compute.manager [req-957cefdd-3f16-4d3e-8e37-c65a91827fc1 req-87112289-2b0a-4dac-822c-6ea68535f31d service nova] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Received event network-vif-unplugged-f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 13:06:54 user nova-compute[71321]: DEBUG nova.network.neutron [req-9d309892-9058-4692-99d8-d30f4aefadf1 req-92856e83-06b6-4ecf-aa6e-33bb10f8299f service nova] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Updated VIF entry in instance network info cache for port f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 13:06:54 user nova-compute[71321]: DEBUG nova.network.neutron [req-9d309892-9058-4692-99d8-d30f4aefadf1 req-92856e83-06b6-4ecf-aa6e-33bb10f8299f service nova] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Updating instance_info_cache with network_info: [{"id": "f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac", "address": "fa:16:3e:c9:39:a4", "network": {"id": "f7ac30df-76aa-400e-868d-9ad902bd9446", "bridge": "br-int", "label": "tempest-TestStampPattern-423905686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51e624010914d7680080956cbb0c720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b0ea0e-f3", "ovs_interfaceid": "f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:06:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-9d309892-9058-4692-99d8-d30f4aefadf1 req-92856e83-06b6-4ecf-aa6e-33bb10f8299f service nova] Releasing lock "refresh_cache-2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 13:06:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:55 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Instance destroyed successfully.
Apr 12 13:06:55 user nova-compute[71321]: DEBUG nova.objects.instance [None req-3f31e1d7-ffe0-44b1-9a87-03578a79b2e3 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lazy-loading 'resources' on Instance uuid 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:06:55 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-3f31e1d7-ffe0-44b1-9a87-03578a79b2e3 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T13:04:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-469200579',display_name='tempest-TestStampPattern-server-469200579',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-469200579',id=45,image_ref='f809e75f-4f4b-4f31-abc7-1036ed53155c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4/5v3eCbyqn1cBjTbTlpYaNU+pu9bnoXsJrgMiEn/z8xxIi9MkvXpvfk3KhnFx+XRfpoIpI1zKXf4THCFNpnfEDB0Wv8SQLcFxbpIn7/+LQHs5b/5vFRKuB/DiXoVA+A==',key_name='tempest-TestStampPattern-193639278',keypairs=<?>,launch_index=0,launched_at=2023-04-12T13:04:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f51e624010914d7680080956cbb0c720',ramdisk_id='',reservation_id='r-wvx6ykxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e47cf07b-9759-4350-9e10-bd5bb15678f3',image_min_disk='1',image_min_ram='0',image_owner_id='f51e624010914d7680080956cbb0c720',image_owner_project_name='tempest-TestStampPattern-1801373189',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1801373189-project-member',image_user_id='bc5b75e437444fe4a54c1516964f0cfa',owner_project_name='tempest-TestStampPattern-1801373189',owner_user_name='tempest-TestStampPattern-1801373189-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T13:04:10Z,user_data=None,user_id='bc5b75e437444fe4a54c1516964f0cfa',uuid=2888a6ec-4c3a-44ee-809b-c1ea4a560aa1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac", "address": "fa:16:3e:c9:39:a4", "network": {"id": "f7ac30df-76aa-400e-868d-9ad902bd9446", "bridge": "br-int", "label": "tempest-TestStampPattern-423905686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51e624010914d7680080956cbb0c720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b0ea0e-f3", "ovs_interfaceid": "f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 13:06:55 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-3f31e1d7-ffe0-44b1-9a87-03578a79b2e3 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Converting VIF {"id": "f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac", "address": "fa:16:3e:c9:39:a4", "network": {"id": "f7ac30df-76aa-400e-868d-9ad902bd9446", "bridge": "br-int", "label": "tempest-TestStampPattern-423905686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51e624010914d7680080956cbb0c720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b0ea0e-f3", "ovs_interfaceid": "f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 13:06:55 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-3f31e1d7-ffe0-44b1-9a87-03578a79b2e3 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:39:a4,bridge_name='br-int',has_traffic_filtering=True,id=f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac,network=Network(f7ac30df-76aa-400e-868d-9ad902bd9446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1b0ea0e-f3') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 13:06:55 user nova-compute[71321]: DEBUG os_vif [None req-3f31e1d7-ffe0-44b1-9a87-03578a79b2e3 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:39:a4,bridge_name='br-int',has_traffic_filtering=True,id=f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac,network=Network(f7ac30df-76aa-400e-868d-9ad902bd9446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1b0ea0e-f3') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 13:06:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1b0ea0e-f3, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 13:06:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:06:55 user nova-compute[71321]: INFO os_vif [None req-3f31e1d7-ffe0-44b1-9a87-03578a79b2e3 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:39:a4,bridge_name='br-int',has_traffic_filtering=True,id=f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac,network=Network(f7ac30df-76aa-400e-868d-9ad902bd9446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1b0ea0e-f3')
Apr 12 13:06:55 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-3f31e1d7-ffe0-44b1-9a87-03578a79b2e3 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Deleting instance files /opt/stack/data/nova/instances/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1_del
Apr 12 13:06:55 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-3f31e1d7-ffe0-44b1-9a87-03578a79b2e3 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Deletion of /opt/stack/data/nova/instances/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1_del complete
Apr 12 13:06:55 user nova-compute[71321]: INFO nova.compute.manager [None req-3f31e1d7-ffe0-44b1-9a87-03578a79b2e3 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 12 13:06:55 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-3f31e1d7-ffe0-44b1-9a87-03578a79b2e3 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 13:06:55 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 13:06:55 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 13:06:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:06:55 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:06:55 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Took 0.47 seconds to deallocate network for instance.
Apr 12 13:06:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3f31e1d7-ffe0-44b1-9a87-03578a79b2e3 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:06:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3f31e1d7-ffe0-44b1-9a87-03578a79b2e3 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:06:56 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-3f31e1d7-ffe0-44b1-9a87-03578a79b2e3 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 13:06:56 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-3f31e1d7-ffe0-44b1-9a87-03578a79b2e3 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 13:06:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3f31e1d7-ffe0-44b1-9a87-03578a79b2e3 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.201s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:06:56 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-3f31e1d7-ffe0-44b1-9a87-03578a79b2e3 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Deleted allocations for instance 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1
Apr 12 13:06:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-3f31e1d7-ffe0-44b1-9a87-03578a79b2e3 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.738s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:06:56 user nova-compute[71321]: DEBUG nova.compute.manager [req-873e53e0-ebe4-46cd-94db-970b0e4e6fd4 req-425a8618-423e-4d02-8241-98fecef8a637 service nova] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Received event network-vif-deleted-f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:06:56 user nova-compute[71321]: DEBUG nova.compute.manager [req-2bd82564-a171-45c4-b2c6-fbf6692c3d1e req-5f5dba95-3ba2-4bfc-96c4-22c11cce42c5 service nova] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Received event network-vif-plugged-f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:06:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2bd82564-a171-45c4-b2c6-fbf6692c3d1e req-5f5dba95-3ba2-4bfc-96c4-22c11cce42c5 service nova] Acquiring lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:06:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2bd82564-a171-45c4-b2c6-fbf6692c3d1e req-5f5dba95-3ba2-4bfc-96c4-22c11cce42c5 service nova] Lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:06:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2bd82564-a171-45c4-b2c6-fbf6692c3d1e req-5f5dba95-3ba2-4bfc-96c4-22c11cce42c5 service nova] Lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:06:56 user nova-compute[71321]: DEBUG nova.compute.manager [req-2bd82564-a171-45c4-b2c6-fbf6692c3d1e req-5f5dba95-3ba2-4bfc-96c4-22c11cce42c5 service nova] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] No waiting events found dispatching network-vif-plugged-f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:06:56 user nova-compute[71321]: WARNING nova.compute.manager [req-2bd82564-a171-45c4-b2c6-fbf6692c3d1e req-5f5dba95-3ba2-4bfc-96c4-22c11cce42c5 service nova] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Received unexpected event network-vif-plugged-f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac for instance with vm_state deleted and task_state None.
Apr 12 13:06:56 user nova-compute[71321]: DEBUG nova.compute.manager [req-2bd82564-a171-45c4-b2c6-fbf6692c3d1e req-5f5dba95-3ba2-4bfc-96c4-22c11cce42c5 service nova] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Received event network-vif-plugged-f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:06:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2bd82564-a171-45c4-b2c6-fbf6692c3d1e req-5f5dba95-3ba2-4bfc-96c4-22c11cce42c5 service nova] Acquiring lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:06:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2bd82564-a171-45c4-b2c6-fbf6692c3d1e req-5f5dba95-3ba2-4bfc-96c4-22c11cce42c5 service nova] Lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:06:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-2bd82564-a171-45c4-b2c6-fbf6692c3d1e req-5f5dba95-3ba2-4bfc-96c4-22c11cce42c5 service nova] Lock "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:06:56 user nova-compute[71321]: DEBUG nova.compute.manager [req-2bd82564-a171-45c4-b2c6-fbf6692c3d1e req-5f5dba95-3ba2-4bfc-96c4-22c11cce42c5 service nova] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] No waiting events found dispatching network-vif-plugged-f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:06:56 user nova-compute[71321]: WARNING nova.compute.manager [req-2bd82564-a171-45c4-b2c6-fbf6692c3d1e req-5f5dba95-3ba2-4bfc-96c4-22c11cce42c5 service nova] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Received unexpected event network-vif-plugged-f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac for instance with vm_state deleted and task_state None.
Apr 12 13:07:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:07:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:07:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:07:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:07:10 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681304815.3242676, 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 13:07:10 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] VM Stopped (Lifecycle Event)
Apr 12 13:07:10 user nova-compute[71321]: DEBUG nova.compute.manager [None req-a375d310-97df-4999-8152-17301b3efe6b None None] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 13:07:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:07:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:07:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:07:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:07:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:07:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:07:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:07:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:07:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:07:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:07:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:07:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:07:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:07:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:07:40 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:07:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:07:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:07:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:07:40 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 13:07:40 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 13:07:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1820783-afa6-434c-9da4-09d9c4990fa1/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:07:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1820783-afa6-434c-9da4-09d9c4990fa1/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:07:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1820783-afa6-434c-9da4-09d9c4990fa1/disk.rescue --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:07:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1820783-afa6-434c-9da4-09d9c4990fa1/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:07:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:07:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:07:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:07:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:07:41 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 13:07:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:07:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:07:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:07:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:07:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:07:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:07:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:07:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:07:42 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:07:42 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:07:42 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8481MB free_disk=25.96355438232422GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 13:07:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:07:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:07:42 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:07:42 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 38198e86-bd23-4196-98a0-79455206305f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:07:42 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance e47cf07b-9759-4350-9e10-bd5bb15678f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:07:42 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance acd99758-64c1-4852-b906-e5f941868a8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:07:42 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance d1820783-afa6-434c-9da4-09d9c4990fa1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:07:42 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 13:07:42 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 13:07:42 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 13:07:42 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 13:07:42 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 13:07:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.313s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:07:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:07:45 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:07:48 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:07:48 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 13:07:49 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:07:50 user nova-compute[71321]: DEBUG nova.compute.manager [req-88c0c04b-2179-4afa-a4e0-29a9af510092 req-66618016-5b8a-4a2e-983d-ef72f06ab861 service nova] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Received event network-changed-2f2f437b-b72e-4842-9047-36ee6e17bf9b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:07:50 user nova-compute[71321]: DEBUG nova.compute.manager [req-88c0c04b-2179-4afa-a4e0-29a9af510092 req-66618016-5b8a-4a2e-983d-ef72f06ab861 service nova] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Refreshing instance network info cache due to event network-changed-2f2f437b-b72e-4842-9047-36ee6e17bf9b. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 13:07:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-88c0c04b-2179-4afa-a4e0-29a9af510092 req-66618016-5b8a-4a2e-983d-ef72f06ab861 service nova] Acquiring lock "refresh_cache-e47cf07b-9759-4350-9e10-bd5bb15678f3" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 13:07:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-88c0c04b-2179-4afa-a4e0-29a9af510092 req-66618016-5b8a-4a2e-983d-ef72f06ab861 service nova] Acquired lock "refresh_cache-e47cf07b-9759-4350-9e10-bd5bb15678f3" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 13:07:50 user nova-compute[71321]: DEBUG nova.network.neutron [req-88c0c04b-2179-4afa-a4e0-29a9af510092 req-66618016-5b8a-4a2e-983d-ef72f06ab861 service nova] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Refreshing network info cache for port 2f2f437b-b72e-4842-9047-36ee6e17bf9b {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 13:07:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:07:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:07:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:07:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:07:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:07:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:07:50 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:07:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-f3f50095-b183-4f36-8785-e407ce9b18aa tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "e47cf07b-9759-4350-9e10-bd5bb15678f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:07:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-f3f50095-b183-4f36-8785-e407ce9b18aa tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "e47cf07b-9759-4350-9e10-bd5bb15678f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:07:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-f3f50095-b183-4f36-8785-e407ce9b18aa tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "e47cf07b-9759-4350-9e10-bd5bb15678f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:07:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-f3f50095-b183-4f36-8785-e407ce9b18aa tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "e47cf07b-9759-4350-9e10-bd5bb15678f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:07:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-f3f50095-b183-4f36-8785-e407ce9b18aa tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "e47cf07b-9759-4350-9e10-bd5bb15678f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:07:50 user nova-compute[71321]: INFO nova.compute.manager [None req-f3f50095-b183-4f36-8785-e407ce9b18aa tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Terminating instance
Apr 12 13:07:50 user nova-compute[71321]: DEBUG nova.compute.manager [None req-f3f50095-b183-4f36-8785-e407ce9b18aa tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 13:07:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:07:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:07:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:07:51 user nova-compute[71321]: DEBUG nova.network.neutron [req-88c0c04b-2179-4afa-a4e0-29a9af510092 req-66618016-5b8a-4a2e-983d-ef72f06ab861 service nova] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Updated VIF entry in instance network info cache for port 2f2f437b-b72e-4842-9047-36ee6e17bf9b. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 13:07:51 user nova-compute[71321]: DEBUG nova.network.neutron [req-88c0c04b-2179-4afa-a4e0-29a9af510092 req-66618016-5b8a-4a2e-983d-ef72f06ab861 service nova] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Updating instance_info_cache with network_info: [{"id": "2f2f437b-b72e-4842-9047-36ee6e17bf9b", "address": "fa:16:3e:15:a4:ec", "network": {"id": "f7ac30df-76aa-400e-868d-9ad902bd9446", "bridge": "br-int", "label": "tempest-TestStampPattern-423905686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51e624010914d7680080956cbb0c720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2f437b-b7", "ovs_interfaceid": "2f2f437b-b72e-4842-9047-36ee6e17bf9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:07:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-88c0c04b-2179-4afa-a4e0-29a9af510092 req-66618016-5b8a-4a2e-983d-ef72f06ab861 service nova] Releasing lock "refresh_cache-e47cf07b-9759-4350-9e10-bd5bb15678f3" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 13:07:51 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Instance destroyed successfully.
Apr 12 13:07:51 user nova-compute[71321]: DEBUG nova.objects.instance [None req-f3f50095-b183-4f36-8785-e407ce9b18aa tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lazy-loading 'resources' on Instance uuid e47cf07b-9759-4350-9e10-bd5bb15678f3 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:07:51 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-f3f50095-b183-4f36-8785-e407ce9b18aa tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T13:01:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-335893625',display_name='tempest-TestStampPattern-server-335893625',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-335893625',id=43,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4/5v3eCbyqn1cBjTbTlpYaNU+pu9bnoXsJrgMiEn/z8xxIi9MkvXpvfk3KhnFx+XRfpoIpI1zKXf4THCFNpnfEDB0Wv8SQLcFxbpIn7/+LQHs5b/5vFRKuB/DiXoVA+A==',key_name='tempest-TestStampPattern-193639278',keypairs=<?>,launch_index=0,launched_at=2023-04-12T13:01:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f51e624010914d7680080956cbb0c720',ramdisk_id='',reservation_id='r-e90ihgwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1801373189',owner_user_name='tempest-TestStampPattern-1801373189-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T13:04:00Z,user_data=None,user_id='bc5b75e437444fe4a54c1516964f0cfa',uuid=e47cf07b-9759-4350-9e10-bd5bb15678f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f2f437b-b72e-4842-9047-36ee6e17bf9b", "address": "fa:16:3e:15:a4:ec", "network": {"id": "f7ac30df-76aa-400e-868d-9ad902bd9446", "bridge": "br-int", "label": "tempest-TestStampPattern-423905686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51e624010914d7680080956cbb0c720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2f437b-b7", "ovs_interfaceid": "2f2f437b-b72e-4842-9047-36ee6e17bf9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 13:07:51 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-f3f50095-b183-4f36-8785-e407ce9b18aa tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Converting VIF {"id": "2f2f437b-b72e-4842-9047-36ee6e17bf9b", "address": "fa:16:3e:15:a4:ec", "network": {"id": "f7ac30df-76aa-400e-868d-9ad902bd9446", "bridge": "br-int", "label": "tempest-TestStampPattern-423905686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f51e624010914d7680080956cbb0c720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2f437b-b7", "ovs_interfaceid": "2f2f437b-b72e-4842-9047-36ee6e17bf9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 13:07:51 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-f3f50095-b183-4f36-8785-e407ce9b18aa tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:a4:ec,bridge_name='br-int',has_traffic_filtering=True,id=2f2f437b-b72e-4842-9047-36ee6e17bf9b,network=Network(f7ac30df-76aa-400e-868d-9ad902bd9446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2f437b-b7') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 13:07:51 user nova-compute[71321]: DEBUG os_vif [None req-f3f50095-b183-4f36-8785-e407ce9b18aa tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:a4:ec,bridge_name='br-int',has_traffic_filtering=True,id=2f2f437b-b72e-4842-9047-36ee6e17bf9b,network=Network(f7ac30df-76aa-400e-868d-9ad902bd9446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2f437b-b7') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 13:07:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:07:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f2f437b-b7, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 13:07:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:07:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:07:51 user nova-compute[71321]: INFO os_vif [None req-f3f50095-b183-4f36-8785-e407ce9b18aa tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:a4:ec,bridge_name='br-int',has_traffic_filtering=True,id=2f2f437b-b72e-4842-9047-36ee6e17bf9b,network=Network(f7ac30df-76aa-400e-868d-9ad902bd9446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2f437b-b7')
Apr 12 13:07:51 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-f3f50095-b183-4f36-8785-e407ce9b18aa tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Deleting instance files /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3_del
Apr 12 13:07:51 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-f3f50095-b183-4f36-8785-e407ce9b18aa tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Deletion of /opt/stack/data/nova/instances/e47cf07b-9759-4350-9e10-bd5bb15678f3_del complete
Apr 12 13:07:51 user nova-compute[71321]: INFO nova.compute.manager [None req-f3f50095-b183-4f36-8785-e407ce9b18aa tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Took 0.95 seconds to destroy the instance on the hypervisor.
Apr 12 13:07:51 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-f3f50095-b183-4f36-8785-e407ce9b18aa tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 13:07:51 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 13:07:51 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 13:07:51 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:07:51 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:07:51 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Took 0.46 seconds to deallocate network for instance.
Apr 12 13:07:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-f3f50095-b183-4f36-8785-e407ce9b18aa tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:07:51 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-f3f50095-b183-4f36-8785-e407ce9b18aa tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:07:52 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-f3f50095-b183-4f36-8785-e407ce9b18aa tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 13:07:52 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-f3f50095-b183-4f36-8785-e407ce9b18aa tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 13:07:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-f3f50095-b183-4f36-8785-e407ce9b18aa tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.219s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:07:52 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-f3f50095-b183-4f36-8785-e407ce9b18aa tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Deleted allocations for instance e47cf07b-9759-4350-9e10-bd5bb15678f3
Apr 12 13:07:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-f3f50095-b183-4f36-8785-e407ce9b18aa tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "e47cf07b-9759-4350-9e10-bd5bb15678f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.811s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:07:52 user nova-compute[71321]: DEBUG nova.compute.manager [req-c409319d-546b-4ee2-8525-1eb214f82d25 req-baf29ea4-4dd4-4606-906f-ec68680885bb service nova] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Received event network-vif-unplugged-2f2f437b-b72e-4842-9047-36ee6e17bf9b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:07:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c409319d-546b-4ee2-8525-1eb214f82d25 req-baf29ea4-4dd4-4606-906f-ec68680885bb service nova] Acquiring lock "e47cf07b-9759-4350-9e10-bd5bb15678f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:07:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c409319d-546b-4ee2-8525-1eb214f82d25 req-baf29ea4-4dd4-4606-906f-ec68680885bb service nova] Lock "e47cf07b-9759-4350-9e10-bd5bb15678f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:07:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c409319d-546b-4ee2-8525-1eb214f82d25 req-baf29ea4-4dd4-4606-906f-ec68680885bb service nova] Lock "e47cf07b-9759-4350-9e10-bd5bb15678f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:07:52 user nova-compute[71321]: DEBUG nova.compute.manager [req-c409319d-546b-4ee2-8525-1eb214f82d25 req-baf29ea4-4dd4-4606-906f-ec68680885bb service nova] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] No waiting events found dispatching network-vif-unplugged-2f2f437b-b72e-4842-9047-36ee6e17bf9b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:07:52 user nova-compute[71321]: WARNING nova.compute.manager [req-c409319d-546b-4ee2-8525-1eb214f82d25 req-baf29ea4-4dd4-4606-906f-ec68680885bb service nova] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Received unexpected event network-vif-unplugged-2f2f437b-b72e-4842-9047-36ee6e17bf9b for instance with vm_state deleted and task_state None.
Apr 12 13:07:52 user nova-compute[71321]: DEBUG nova.compute.manager [req-c409319d-546b-4ee2-8525-1eb214f82d25 req-baf29ea4-4dd4-4606-906f-ec68680885bb service nova] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Received event network-vif-plugged-2f2f437b-b72e-4842-9047-36ee6e17bf9b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:07:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c409319d-546b-4ee2-8525-1eb214f82d25 req-baf29ea4-4dd4-4606-906f-ec68680885bb service nova] Acquiring lock "e47cf07b-9759-4350-9e10-bd5bb15678f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:07:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c409319d-546b-4ee2-8525-1eb214f82d25 req-baf29ea4-4dd4-4606-906f-ec68680885bb service nova] Lock "e47cf07b-9759-4350-9e10-bd5bb15678f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:07:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-c409319d-546b-4ee2-8525-1eb214f82d25 req-baf29ea4-4dd4-4606-906f-ec68680885bb service nova] Lock "e47cf07b-9759-4350-9e10-bd5bb15678f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:07:52 user nova-compute[71321]: DEBUG nova.compute.manager [req-c409319d-546b-4ee2-8525-1eb214f82d25 req-baf29ea4-4dd4-4606-906f-ec68680885bb service nova] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] No waiting events found dispatching network-vif-plugged-2f2f437b-b72e-4842-9047-36ee6e17bf9b {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:07:52 user nova-compute[71321]: WARNING nova.compute.manager [req-c409319d-546b-4ee2-8525-1eb214f82d25 req-baf29ea4-4dd4-4606-906f-ec68680885bb service nova] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Received unexpected event network-vif-plugged-2f2f437b-b72e-4842-9047-36ee6e17bf9b for instance with vm_state deleted and task_state None.
Apr 12 13:07:52 user nova-compute[71321]: DEBUG nova.compute.manager [req-c409319d-546b-4ee2-8525-1eb214f82d25 req-baf29ea4-4dd4-4606-906f-ec68680885bb service nova] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Received event network-vif-deleted-2f2f437b-b72e-4842-9047-36ee6e17bf9b {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:07:53 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:07:53 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 13:07:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-38198e86-bd23-4196-98a0-79455206305f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 13:07:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-38198e86-bd23-4196-98a0-79455206305f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 13:07:53 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 13:07:53 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] Updating instance_info_cache with network_info: [{"id": "5621687b-5d0b-47f7-b11c-a24c403a590a", "address": "fa:16:3e:0e:91:7d", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621687b-5d", "ovs_interfaceid": "5621687b-5d0b-47f7-b11c-a24c403a590a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:07:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-38198e86-bd23-4196-98a0-79455206305f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 13:07:53 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 13:07:53 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:07:53 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:07:56 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:08:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:08:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:08:06 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681304871.2160847, e47cf07b-9759-4350-9e10-bd5bb15678f3 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 13:08:06 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] VM Stopped (Lifecycle Event)
Apr 12 13:08:06 user nova-compute[71321]: DEBUG nova.compute.manager [None req-a49dde36-8b19-4106-9f72-2b516e551d88 None None] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 13:08:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:08:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:08:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:08:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:08:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:08:29 user nova-compute[71321]: INFO nova.compute.manager [None req-04d17242-ee0e-4e59-800b-f815d150d3d3 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Unrescuing
Apr 12 13:08:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-04d17242-ee0e-4e59-800b-f815d150d3d3 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "refresh_cache-d1820783-afa6-434c-9da4-09d9c4990fa1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 13:08:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-04d17242-ee0e-4e59-800b-f815d150d3d3 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquired lock "refresh_cache-d1820783-afa6-434c-9da4-09d9c4990fa1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 13:08:29 user nova-compute[71321]: DEBUG nova.network.neutron [None req-04d17242-ee0e-4e59-800b-f815d150d3d3 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 13:08:29 user nova-compute[71321]: DEBUG nova.network.neutron [None req-04d17242-ee0e-4e59-800b-f815d150d3d3 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Updating instance_info_cache with network_info: [{"id": "3bd889e8-1b3d-4902-ad45-01a3b961d658", "address": "fa:16:3e:fe:4f:ca", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd889e8-1b", "ovs_interfaceid": "3bd889e8-1b3d-4902-ad45-01a3b961d658", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:08:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-04d17242-ee0e-4e59-800b-f815d150d3d3 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Releasing lock "refresh_cache-d1820783-afa6-434c-9da4-09d9c4990fa1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 13:08:29 user nova-compute[71321]: DEBUG nova.objects.instance [None req-04d17242-ee0e-4e59-800b-f815d150d3d3 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lazy-loading 'flavor' on Instance uuid d1820783-afa6-434c-9da4-09d9c4990fa1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:08:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:08:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:08:29 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:08:29 user nova-compute[71321]: DEBUG nova.compute.manager [req-0ed29ef5-5f27-4c5d-a795-bad8de210428 req-6c6cd3c8-d720-425d-81cc-7df839835211 service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Received event network-vif-unplugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:08:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0ed29ef5-5f27-4c5d-a795-bad8de210428 req-6c6cd3c8-d720-425d-81cc-7df839835211 service nova] Acquiring lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:08:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0ed29ef5-5f27-4c5d-a795-bad8de210428 req-6c6cd3c8-d720-425d-81cc-7df839835211 service nova] Lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:08:29 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0ed29ef5-5f27-4c5d-a795-bad8de210428 req-6c6cd3c8-d720-425d-81cc-7df839835211 service nova] Lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:08:29 user nova-compute[71321]: DEBUG nova.compute.manager [req-0ed29ef5-5f27-4c5d-a795-bad8de210428 req-6c6cd3c8-d720-425d-81cc-7df839835211 service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] No waiting events found dispatching network-vif-unplugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:08:29 user nova-compute[71321]: WARNING nova.compute.manager [req-0ed29ef5-5f27-4c5d-a795-bad8de210428 req-6c6cd3c8-d720-425d-81cc-7df839835211 service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Received unexpected event network-vif-unplugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 for instance with vm_state rescued and task_state unrescuing.
Apr 12 13:08:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:08:30 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Instance destroyed successfully.
Apr 12 13:08:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:08:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:08:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:08:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:08:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:08:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:08:32 user nova-compute[71321]: DEBUG nova.compute.manager [req-b09ea851-95d6-4789-a9dc-84e01b4e5c4d req-14f5cddc-8586-4f2c-8538-1a1b8719017d service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Received event network-vif-plugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:08:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b09ea851-95d6-4789-a9dc-84e01b4e5c4d req-14f5cddc-8586-4f2c-8538-1a1b8719017d service nova] Acquiring lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:08:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b09ea851-95d6-4789-a9dc-84e01b4e5c4d req-14f5cddc-8586-4f2c-8538-1a1b8719017d service nova] Lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:08:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b09ea851-95d6-4789-a9dc-84e01b4e5c4d req-14f5cddc-8586-4f2c-8538-1a1b8719017d service nova] Lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:08:32 user nova-compute[71321]: DEBUG nova.compute.manager [req-b09ea851-95d6-4789-a9dc-84e01b4e5c4d req-14f5cddc-8586-4f2c-8538-1a1b8719017d service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] No waiting events found dispatching network-vif-plugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:08:32 user nova-compute[71321]: WARNING nova.compute.manager [req-b09ea851-95d6-4789-a9dc-84e01b4e5c4d req-14f5cddc-8586-4f2c-8538-1a1b8719017d service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Received unexpected event network-vif-plugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 for instance with vm_state rescued and task_state unrescuing.
Apr 12 13:08:32 user nova-compute[71321]: DEBUG nova.compute.manager [req-b09ea851-95d6-4789-a9dc-84e01b4e5c4d req-14f5cddc-8586-4f2c-8538-1a1b8719017d service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Received event network-vif-plugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:08:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b09ea851-95d6-4789-a9dc-84e01b4e5c4d req-14f5cddc-8586-4f2c-8538-1a1b8719017d service nova] Acquiring lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:08:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b09ea851-95d6-4789-a9dc-84e01b4e5c4d req-14f5cddc-8586-4f2c-8538-1a1b8719017d service nova] Lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:08:32 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-b09ea851-95d6-4789-a9dc-84e01b4e5c4d req-14f5cddc-8586-4f2c-8538-1a1b8719017d service nova] Lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:08:32 user nova-compute[71321]: DEBUG nova.compute.manager [req-b09ea851-95d6-4789-a9dc-84e01b4e5c4d req-14f5cddc-8586-4f2c-8538-1a1b8719017d service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] No waiting events found dispatching network-vif-plugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:08:32 user nova-compute[71321]: WARNING nova.compute.manager [req-b09ea851-95d6-4789-a9dc-84e01b4e5c4d req-14f5cddc-8586-4f2c-8538-1a1b8719017d service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Received unexpected event network-vif-plugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 for instance with vm_state rescued and task_state unrescuing.
Apr 12 13:08:33 user nova-compute[71321]: DEBUG nova.virt.libvirt.host [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Removed pending event for d1820783-afa6-434c-9da4-09d9c4990fa1 due to event {{(pid=71321) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 13:08:33 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681304913.7006564, d1820783-afa6-434c-9da4-09d9c4990fa1 => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 13:08:33 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] VM Resumed (Lifecycle Event)
Apr 12 13:08:33 user nova-compute[71321]: DEBUG nova.compute.manager [None req-04d17242-ee0e-4e59-800b-f815d150d3d3 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 13:08:33 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 13:08:33 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 13:08:33 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 13:08:33 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681304913.7048929, d1820783-afa6-434c-9da4-09d9c4990fa1 => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 13:08:33 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] VM Started (Lifecycle Event)
Apr 12 13:08:33 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 13:08:33 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 13:08:34 user nova-compute[71321]: DEBUG nova.compute.manager [req-8fdb4dd3-6cb8-4e7b-b910-c799786cf6ad req-a0072ea4-f90b-4a38-b6e9-e00a041c78a9 service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Received event network-vif-plugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:08:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-8fdb4dd3-6cb8-4e7b-b910-c799786cf6ad req-a0072ea4-f90b-4a38-b6e9-e00a041c78a9 service nova] Acquiring lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:08:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-8fdb4dd3-6cb8-4e7b-b910-c799786cf6ad req-a0072ea4-f90b-4a38-b6e9-e00a041c78a9 service nova] Lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:08:34 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-8fdb4dd3-6cb8-4e7b-b910-c799786cf6ad req-a0072ea4-f90b-4a38-b6e9-e00a041c78a9 service nova] Lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:08:34 user nova-compute[71321]: DEBUG nova.compute.manager [req-8fdb4dd3-6cb8-4e7b-b910-c799786cf6ad req-a0072ea4-f90b-4a38-b6e9-e00a041c78a9 service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] No waiting events found dispatching network-vif-plugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:08:34 user nova-compute[71321]: WARNING nova.compute.manager [req-8fdb4dd3-6cb8-4e7b-b910-c799786cf6ad req-a0072ea4-f90b-4a38-b6e9-e00a041c78a9 service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Received unexpected event network-vif-plugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 for instance with vm_state active and task_state None.
Apr 12 13:08:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:08:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:08:40 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:08:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:08:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:08:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:08:40 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 13:08:40 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 13:08:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:08:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:08:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:08:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:08:40 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 13:08:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:08:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:08:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:08:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:08:41 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:08:41 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:08:41 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:08:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8609MB free_disk=26.05405044555664GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 13:08:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:08:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:08:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:08:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 38198e86-bd23-4196-98a0-79455206305f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:08:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance acd99758-64c1-4852-b906-e5f941868a8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:08:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance d1820783-afa6-434c-9da4-09d9c4990fa1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:08:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 13:08:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 13:08:41 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 13:08:41 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 13:08:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 13:08:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.320s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:08:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:08:45 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:08:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:08:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:08:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:08:50 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:08:50 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:08:50 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 13:08:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:08:51 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:08:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:08:52 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:08:52 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:08:53 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:08:53 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 13:08:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-acd99758-64c1-4852-b906-e5f941868a8e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 13:08:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-acd99758-64c1-4852-b906-e5f941868a8e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 13:08:53 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 13:08:54 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Updating instance_info_cache with network_info: [{"id": "6afd3a74-bd8e-488e-be66-9f25ef4dce8d", "address": "fa:16:3e:f3:14:cc", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afd3a74-bd", "ovs_interfaceid": "6afd3a74-bd8e-488e-be66-9f25ef4dce8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:08:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-acd99758-64c1-4852-b906-e5f941868a8e" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 13:08:54 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 13:08:54 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:08:55 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:08:56 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:08:56 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:09:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:09:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:09:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:09:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:09:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:09:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:09:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:09:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:09:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:09:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:09:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:09:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:09:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:09:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:09:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:09:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:09:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:09:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:09:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:09:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:09:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:09:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:09:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:09:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:09:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:09:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:09:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:09:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:09:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:09:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:09:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:09:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:09:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:09:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:09:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:09:40 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:09:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:09:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:09:40 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:09:40 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 13:09:40 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 13:09:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:09:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:09:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:09:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:09:40 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 13:09:40 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:09:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:09:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:09:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:09:41 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:09:41 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:09:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8640MB free_disk=26.044036865234375GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 13:09:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:09:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:09:41 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:09:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:09:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 38198e86-bd23-4196-98a0-79455206305f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:09:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance acd99758-64c1-4852-b906-e5f941868a8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:09:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance d1820783-afa6-434c-9da4-09d9c4990fa1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:09:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 13:09:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 13:09:41 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 13:09:41 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 13:09:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 13:09:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.262s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:09:43 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:09:43 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71321) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 13:09:44 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:09:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:09:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:09:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:09:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:09:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:09:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:09:51 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:09:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:09:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:09:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:09:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:09:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:09:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:09:52 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:09:52 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:09:52 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:09:52 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 13:09:54 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:09:54 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 13:09:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-d1820783-afa6-434c-9da4-09d9c4990fa1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 13:09:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-d1820783-afa6-434c-9da4-09d9c4990fa1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 13:09:54 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 13:09:55 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Updating instance_info_cache with network_info: [{"id": "3bd889e8-1b3d-4902-ad45-01a3b961d658", "address": "fa:16:3e:fe:4f:ca", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd889e8-1b", "ovs_interfaceid": "3bd889e8-1b3d-4902-ad45-01a3b961d658", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:09:55 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-d1820783-afa6-434c-9da4-09d9c4990fa1" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 13:09:55 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 13:09:55 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:09:56 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:09:56 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:09:56 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:10:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:10:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:10:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:10:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:10:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:10:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:10:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:10:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:10:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:10:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:10:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:10:06 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:10:10 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:10:10 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Cleaning up deleted instances {{(pid=71321) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 13:10:10 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] There are 0 instances to clean {{(pid=71321) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 13:10:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:10:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:10:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:10:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:10:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:10:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:10:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:10:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:10:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:10:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:10:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:10:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:10:18 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:10:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "d1820783-afa6-434c-9da4-09d9c4990fa1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:10:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "d1820783-afa6-434c-9da4-09d9c4990fa1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:10:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:10:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:10:19 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:10:19 user nova-compute[71321]: INFO nova.compute.manager [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Terminating instance
Apr 12 13:10:19 user nova-compute[71321]: DEBUG nova.compute.manager [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG nova.compute.manager [req-8cd45f09-eadf-4fd8-ac6d-28b51cb42e17 req-6ee0f0fc-2154-4e51-ade5-e67b433dc467 service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Received event network-vif-unplugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-8cd45f09-eadf-4fd8-ac6d-28b51cb42e17 req-6ee0f0fc-2154-4e51-ade5-e67b433dc467 service nova] Acquiring lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-8cd45f09-eadf-4fd8-ac6d-28b51cb42e17 req-6ee0f0fc-2154-4e51-ade5-e67b433dc467 service nova] Lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-8cd45f09-eadf-4fd8-ac6d-28b51cb42e17 req-6ee0f0fc-2154-4e51-ade5-e67b433dc467 service nova] Lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG nova.compute.manager [req-8cd45f09-eadf-4fd8-ac6d-28b51cb42e17 req-6ee0f0fc-2154-4e51-ade5-e67b433dc467 service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] No waiting events found dispatching network-vif-unplugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG nova.compute.manager [req-8cd45f09-eadf-4fd8-ac6d-28b51cb42e17 req-6ee0f0fc-2154-4e51-ade5-e67b433dc467 service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Received event network-vif-unplugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:10:20 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Instance destroyed successfully.
Apr 12 13:10:20 user nova-compute[71321]: DEBUG nova.objects.instance [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lazy-loading 'resources' on Instance uuid d1820783-afa6-434c-9da4-09d9c4990fa1 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T13:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1366095873',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1366095873',id=46,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T13:06:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f20ad21427a04683b9b102d2ff0290a5',ramdisk_id='',reservation_id='r-rd8kq37i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-636247513',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T13:08:34Z,user_data=None,user_id='435e0d6fd2b3437f837e82730b4d955f',uuid=d1820783-afa6-434c-9da4-09d9c4990fa1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3bd889e8-1b3d-4902-ad45-01a3b961d658", "address": "fa:16:3e:fe:4f:ca", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd889e8-1b", "ovs_interfaceid": "3bd889e8-1b3d-4902-ad45-01a3b961d658", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Converting VIF {"id": "3bd889e8-1b3d-4902-ad45-01a3b961d658", "address": "fa:16:3e:fe:4f:ca", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bd889e8-1b", "ovs_interfaceid": "3bd889e8-1b3d-4902-ad45-01a3b961d658", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:4f:ca,bridge_name='br-int',has_traffic_filtering=True,id=3bd889e8-1b3d-4902-ad45-01a3b961d658,network=Network(bb52f82e-56ca-41f7-b171-a3cacb549ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bd889e8-1b') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG os_vif [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:4f:ca,bridge_name='br-int',has_traffic_filtering=True,id=3bd889e8-1b3d-4902-ad45-01a3b961d658,network=Network(bb52f82e-56ca-41f7-b171-a3cacb549ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bd889e8-1b') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3bd889e8-1b, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:10:20 user nova-compute[71321]: INFO os_vif [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:4f:ca,bridge_name='br-int',has_traffic_filtering=True,id=3bd889e8-1b3d-4902-ad45-01a3b961d658,network=Network(bb52f82e-56ca-41f7-b171-a3cacb549ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bd889e8-1b')
Apr 12 13:10:20 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TZaSwXbq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 13:10:20 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 13:10:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4177159-f70e-4fb7-b4b2-c0688538fdc5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 13:10:20 user nova-compute[71321]: No targets found.
Apr 12 13:10:20 user nova-compute[71321]: iSNS:
Apr 12 13:10:20 user nova-compute[71321]: No targets found.
Apr 12 13:10:20 user nova-compute[71321]: STATIC:
Apr 12 13:10:20 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2
Apr 12 13:10:20 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 13:10:20 user nova-compute[71321]:                 Iface Name: default
Apr 12 13:10:20 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498
Apr 12 13:10:20 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 13:10:20 user nova-compute[71321]:                 Iface Name: default
Apr 12 13:10:20 user nova-compute[71321]: FIRMWARE:
Apr 12 13:10:20 user nova-compute[71321]: No targets found.
Apr 12 13:10:20 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 13:10:20 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 13:10:20 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f26b6fc-267b-49d6-bfbd-649ee5a11404]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd966329-4435-465d-b65b-d8fe2bd4d5f9]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 13:10:20 user nova-compute[71321]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 (non-flash)
Apr 12 13:10:20 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 13:10:20 user nova-compute[71321]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 (non-flash)
Apr 12 13:10:20 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef8a0b7b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498'): ({'sdc'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Removing single pathed devices sdc {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cf9d96-ad59-491e-81f1-47bb67429b34]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52544d3-592c-4d80-9a81-4fcdc1e90839]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Flushing IO for device /dev/sdc {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c83afb-a70c-4d00-9bea-14bfd0eda816]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.031s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[55378fe9-35f7-4a54-b310-94853dc6a75f]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 13:10:20 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] SCSI volumes sdc have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 13:10:21 user nova-compute[71321]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23166613363613561', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_44a98f2b', '/dev/disk/by-id/scsi-1SCST_BIO44a98f2b-1fa3ca5a33c114c5') {{(pid=81736) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 13:10:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8a9ecf-855f-41fe-9524-37f1b6acf557]: (4, None) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:10:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 13:10:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:10:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:10:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccb6259-7d1f-43b6-b04e-85e1a0c538fa]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:10:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:10:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:10:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:10:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ca635c-4da4-4d2e-bfb7-e7f17d3a75f6]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:10:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498, portal: 172.16.0.220,3260]
Apr 12 13:10:21 user nova-compute[71321]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498, portal: 172.16.0.220,3260] successful.
Apr 12 13:10:21 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:10:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:10:21 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e136e31-e43a-4a77-b73d-50a179407498 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:10:21 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[813e5873-69c5-4a02-8c27-ae9e2945ba1f]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:10:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:10:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 13:10:21 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] <== disconnect_volume: return (313ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 13:10:21 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 13:10:21 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Deleting instance files /opt/stack/data/nova/instances/d1820783-afa6-434c-9da4-09d9c4990fa1_del
Apr 12 13:10:21 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Deletion of /opt/stack/data/nova/instances/d1820783-afa6-434c-9da4-09d9c4990fa1_del complete
Apr 12 13:10:21 user nova-compute[71321]: INFO nova.compute.manager [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Took 1.20 seconds to destroy the instance on the hypervisor.
Apr 12 13:10:21 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 13:10:21 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 13:10:21 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 13:10:22 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:10:22 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Took 0.82 seconds to deallocate network for instance.
Apr 12 13:10:22 user nova-compute[71321]: DEBUG nova.compute.manager [req-f7f8010f-10df-4a02-8f3b-33f20038de3e req-44b93be6-5f96-4f0d-9bb4-ceb28a5ba030 service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Received event network-vif-deleted-3bd889e8-1b3d-4902-ad45-01a3b961d658 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:10:22 user nova-compute[71321]: INFO nova.compute.manager [req-f7f8010f-10df-4a02-8f3b-33f20038de3e req-44b93be6-5f96-4f0d-9bb4-ceb28a5ba030 service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Neutron deleted interface 3bd889e8-1b3d-4902-ad45-01a3b961d658; detaching it from the instance and deleting it from the info cache
Apr 12 13:10:22 user nova-compute[71321]: DEBUG nova.network.neutron [req-f7f8010f-10df-4a02-8f3b-33f20038de3e req-44b93be6-5f96-4f0d-9bb4-ceb28a5ba030 service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:10:22 user nova-compute[71321]: DEBUG nova.compute.manager [req-f7f8010f-10df-4a02-8f3b-33f20038de3e req-44b93be6-5f96-4f0d-9bb4-ceb28a5ba030 service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Detach interface failed, port_id=3bd889e8-1b3d-4902-ad45-01a3b961d658, reason: Instance d1820783-afa6-434c-9da4-09d9c4990fa1 could not be found. {{(pid=71321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 13:10:22 user nova-compute[71321]: DEBUG nova.compute.manager [req-4c95b231-1a85-4b91-a617-4d9b625e6dc2 req-ba8eb056-2d36-4a5f-8374-242d24376801 service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Received event network-vif-plugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:10:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4c95b231-1a85-4b91-a617-4d9b625e6dc2 req-ba8eb056-2d36-4a5f-8374-242d24376801 service nova] Acquiring lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:10:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4c95b231-1a85-4b91-a617-4d9b625e6dc2 req-ba8eb056-2d36-4a5f-8374-242d24376801 service nova] Lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:10:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-4c95b231-1a85-4b91-a617-4d9b625e6dc2 req-ba8eb056-2d36-4a5f-8374-242d24376801 service nova] Lock "d1820783-afa6-434c-9da4-09d9c4990fa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:10:22 user nova-compute[71321]: DEBUG nova.compute.manager [req-4c95b231-1a85-4b91-a617-4d9b625e6dc2 req-ba8eb056-2d36-4a5f-8374-242d24376801 service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] No waiting events found dispatching network-vif-plugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:10:22 user nova-compute[71321]: WARNING nova.compute.manager [req-4c95b231-1a85-4b91-a617-4d9b625e6dc2 req-ba8eb056-2d36-4a5f-8374-242d24376801 service nova] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Received unexpected event network-vif-plugged-3bd889e8-1b3d-4902-ad45-01a3b961d658 for instance with vm_state active and task_state deleting.
Apr 12 13:10:22 user nova-compute[71321]: INFO nova.compute.manager [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Took 0.81 seconds to detach 1 volumes for instance.
Apr 12 13:10:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:10:22 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:10:23 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 13:10:23 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 13:10:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.179s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:10:23 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Deleted allocations for instance d1820783-afa6-434c-9da4-09d9c4990fa1
Apr 12 13:10:23 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "d1820783-afa6-434c-9da4-09d9c4990fa1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.195s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:10:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:10:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:10:35 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681305020.7281754, d1820783-afa6-434c-9da4-09d9c4990fa1 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 13:10:35 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] VM Stopped (Lifecycle Event)
Apr 12 13:10:35 user nova-compute[71321]: DEBUG nova.compute.manager [None req-be991229-afe8-406f-a28c-b4d42a63d174 None None] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 13:10:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:10:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:10:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:10:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:10:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:10:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:10:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:10:41 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:10:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:10:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:10:41 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:10:41 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 13:10:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:10:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:10:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:10:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:10:41 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 13:10:41 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:10:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:10:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:10:42 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:10:42 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:10:42 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:10:42 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8689MB free_disk=26.043190002441406GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 13:10:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:10:42 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:10:42 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:10:42 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 38198e86-bd23-4196-98a0-79455206305f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:10:42 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance acd99758-64c1-4852-b906-e5f941868a8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:10:42 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 13:10:42 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 13:10:42 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Refreshing inventories for resource provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 13:10:42 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Updating ProviderTree inventory for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 13:10:42 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Updating inventory in ProviderTree for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 13:10:42 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Refreshing aggregate associations for resource provider 7ca624fd-d5cc-42af-93e3-9d62256fa231, aggregates: None {{(pid=71321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 13:10:42 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Refreshing trait associations for resource provider 7ca624fd-d5cc-42af-93e3-9d62256fa231, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=71321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 13:10:43 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 13:10:43 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 13:10:43 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 13:10:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.482s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:10:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:10:48 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:10:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:10:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:10:52 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:10:52 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:10:52 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 13:10:54 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:10:54 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:10:55 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:10:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:10:56 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:10:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 13:10:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Rebuilding the list of instances to heal {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 13:10:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 13:10:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 13:10:56 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 13:10:56 user nova-compute[71321]: DEBUG nova.objects.instance [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lazy-loading 'info_cache' on Instance uuid e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:10:56 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Updating instance_info_cache with network_info: [{"id": "9f228391-1910-4bd3-b317-f1afa3e98a0f", "address": "fa:16:3e:bf:a8:a8", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f228391-19", "ovs_interfaceid": "9f228391-1910-4bd3-b317-f1afa3e98a0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:10:57 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 13:10:57 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 13:10:57 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:10:57 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:11:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:11:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:11:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:11:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fba55609-e42b-485d-a68d-4848b6a86ef6 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "acd99758-64c1-4852-b906-e5f941868a8e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:11:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fba55609-e42b-485d-a68d-4848b6a86ef6 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "acd99758-64c1-4852-b906-e5f941868a8e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:11:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fba55609-e42b-485d-a68d-4848b6a86ef6 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "acd99758-64c1-4852-b906-e5f941868a8e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:11:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fba55609-e42b-485d-a68d-4848b6a86ef6 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "acd99758-64c1-4852-b906-e5f941868a8e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:11:10 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fba55609-e42b-485d-a68d-4848b6a86ef6 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "acd99758-64c1-4852-b906-e5f941868a8e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:11:10 user nova-compute[71321]: INFO nova.compute.manager [None req-fba55609-e42b-485d-a68d-4848b6a86ef6 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Terminating instance
Apr 12 13:11:10 user nova-compute[71321]: DEBUG nova.compute.manager [None req-fba55609-e42b-485d-a68d-4848b6a86ef6 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 13:11:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:11:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:11:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:11:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:11:11 user nova-compute[71321]: DEBUG nova.compute.manager [req-0804b32b-a07d-44db-bf85-9c0abaedfc17 req-6b4b17cc-4f3a-4ee0-a051-2cf430858e7f service nova] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Received event network-vif-unplugged-6afd3a74-bd8e-488e-be66-9f25ef4dce8d {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:11:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0804b32b-a07d-44db-bf85-9c0abaedfc17 req-6b4b17cc-4f3a-4ee0-a051-2cf430858e7f service nova] Acquiring lock "acd99758-64c1-4852-b906-e5f941868a8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:11:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0804b32b-a07d-44db-bf85-9c0abaedfc17 req-6b4b17cc-4f3a-4ee0-a051-2cf430858e7f service nova] Lock "acd99758-64c1-4852-b906-e5f941868a8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:11:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-0804b32b-a07d-44db-bf85-9c0abaedfc17 req-6b4b17cc-4f3a-4ee0-a051-2cf430858e7f service nova] Lock "acd99758-64c1-4852-b906-e5f941868a8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:11:11 user nova-compute[71321]: DEBUG nova.compute.manager [req-0804b32b-a07d-44db-bf85-9c0abaedfc17 req-6b4b17cc-4f3a-4ee0-a051-2cf430858e7f service nova] [instance: acd99758-64c1-4852-b906-e5f941868a8e] No waiting events found dispatching network-vif-unplugged-6afd3a74-bd8e-488e-be66-9f25ef4dce8d {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:11:11 user nova-compute[71321]: DEBUG nova.compute.manager [req-0804b32b-a07d-44db-bf85-9c0abaedfc17 req-6b4b17cc-4f3a-4ee0-a051-2cf430858e7f service nova] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Received event network-vif-unplugged-6afd3a74-bd8e-488e-be66-9f25ef4dce8d for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 13:11:11 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Instance destroyed successfully.
Apr 12 13:11:11 user nova-compute[71321]: DEBUG nova.objects.instance [None req-fba55609-e42b-485d-a68d-4848b6a86ef6 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lazy-loading 'resources' on Instance uuid acd99758-64c1-4852-b906-e5f941868a8e {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:11:11 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-fba55609-e42b-485d-a68d-4848b6a86ef6 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T13:01:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-339222954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-339222954',id=44,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T13:01:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f20ad21427a04683b9b102d2ff0290a5',ramdisk_id='',reservation_id='r-ez458jpy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-636247513',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T13:03:46Z,user_data=None,user_id='435e0d6fd2b3437f837e82730b4d955f',uuid=acd99758-64c1-4852-b906-e5f941868a8e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6afd3a74-bd8e-488e-be66-9f25ef4dce8d", "address": "fa:16:3e:f3:14:cc", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afd3a74-bd", "ovs_interfaceid": "6afd3a74-bd8e-488e-be66-9f25ef4dce8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 13:11:11 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-fba55609-e42b-485d-a68d-4848b6a86ef6 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Converting VIF {"id": "6afd3a74-bd8e-488e-be66-9f25ef4dce8d", "address": "fa:16:3e:f3:14:cc", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afd3a74-bd", "ovs_interfaceid": "6afd3a74-bd8e-488e-be66-9f25ef4dce8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 13:11:11 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-fba55609-e42b-485d-a68d-4848b6a86ef6 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:14:cc,bridge_name='br-int',has_traffic_filtering=True,id=6afd3a74-bd8e-488e-be66-9f25ef4dce8d,network=Network(bb52f82e-56ca-41f7-b171-a3cacb549ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afd3a74-bd') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 13:11:11 user nova-compute[71321]: DEBUG os_vif [None req-fba55609-e42b-485d-a68d-4848b6a86ef6 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:14:cc,bridge_name='br-int',has_traffic_filtering=True,id=6afd3a74-bd8e-488e-be66-9f25ef4dce8d,network=Network(bb52f82e-56ca-41f7-b171-a3cacb549ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afd3a74-bd') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 13:11:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:11:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6afd3a74-bd, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 13:11:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:11:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:11:11 user nova-compute[71321]: INFO os_vif [None req-fba55609-e42b-485d-a68d-4848b6a86ef6 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:14:cc,bridge_name='br-int',has_traffic_filtering=True,id=6afd3a74-bd8e-488e-be66-9f25ef4dce8d,network=Network(bb52f82e-56ca-41f7-b171-a3cacb549ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afd3a74-bd')
Apr 12 13:11:11 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-fba55609-e42b-485d-a68d-4848b6a86ef6 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Deleting instance files /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e_del
Apr 12 13:11:11 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-fba55609-e42b-485d-a68d-4848b6a86ef6 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Deletion of /opt/stack/data/nova/instances/acd99758-64c1-4852-b906-e5f941868a8e_del complete
Apr 12 13:11:11 user nova-compute[71321]: INFO nova.compute.manager [None req-fba55609-e42b-485d-a68d-4848b6a86ef6 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Took 0.68 seconds to destroy the instance on the hypervisor.
Apr 12 13:11:11 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-fba55609-e42b-485d-a68d-4848b6a86ef6 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 13:11:11 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 13:11:11 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: acd99758-64c1-4852-b906-e5f941868a8e] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 13:11:12 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:11:12 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Took 0.49 seconds to deallocate network for instance.
Apr 12 13:11:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fba55609-e42b-485d-a68d-4848b6a86ef6 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:11:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fba55609-e42b-485d-a68d-4848b6a86ef6 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:11:12 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-fba55609-e42b-485d-a68d-4848b6a86ef6 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 13:11:12 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-fba55609-e42b-485d-a68d-4848b6a86ef6 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 13:11:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fba55609-e42b-485d-a68d-4848b6a86ef6 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.154s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:11:12 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-fba55609-e42b-485d-a68d-4848b6a86ef6 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Deleted allocations for instance acd99758-64c1-4852-b906-e5f941868a8e
Apr 12 13:11:12 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-fba55609-e42b-485d-a68d-4848b6a86ef6 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "acd99758-64c1-4852-b906-e5f941868a8e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.521s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:11:13 user nova-compute[71321]: DEBUG nova.compute.manager [req-45b52b5f-c858-451d-a7ea-2eebcaa7123f req-a73ac50c-0e52-477d-ba9a-8af2f9517816 service nova] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Received event network-vif-plugged-6afd3a74-bd8e-488e-be66-9f25ef4dce8d {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:11:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-45b52b5f-c858-451d-a7ea-2eebcaa7123f req-a73ac50c-0e52-477d-ba9a-8af2f9517816 service nova] Acquiring lock "acd99758-64c1-4852-b906-e5f941868a8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:11:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-45b52b5f-c858-451d-a7ea-2eebcaa7123f req-a73ac50c-0e52-477d-ba9a-8af2f9517816 service nova] Lock "acd99758-64c1-4852-b906-e5f941868a8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:11:13 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-45b52b5f-c858-451d-a7ea-2eebcaa7123f req-a73ac50c-0e52-477d-ba9a-8af2f9517816 service nova] Lock "acd99758-64c1-4852-b906-e5f941868a8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:11:13 user nova-compute[71321]: DEBUG nova.compute.manager [req-45b52b5f-c858-451d-a7ea-2eebcaa7123f req-a73ac50c-0e52-477d-ba9a-8af2f9517816 service nova] [instance: acd99758-64c1-4852-b906-e5f941868a8e] No waiting events found dispatching network-vif-plugged-6afd3a74-bd8e-488e-be66-9f25ef4dce8d {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:11:13 user nova-compute[71321]: WARNING nova.compute.manager [req-45b52b5f-c858-451d-a7ea-2eebcaa7123f req-a73ac50c-0e52-477d-ba9a-8af2f9517816 service nova] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Received unexpected event network-vif-plugged-6afd3a74-bd8e-488e-be66-9f25ef4dce8d for instance with vm_state deleted and task_state None.
Apr 12 13:11:13 user nova-compute[71321]: DEBUG nova.compute.manager [req-45b52b5f-c858-451d-a7ea-2eebcaa7123f req-a73ac50c-0e52-477d-ba9a-8af2f9517816 service nova] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Received event network-vif-deleted-6afd3a74-bd8e-488e-be66-9f25ef4dce8d {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:11:16 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:11:21 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:11:26 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681305071.456525, acd99758-64c1-4852-b906-e5f941868a8e => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 13:11:26 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: acd99758-64c1-4852-b906-e5f941868a8e] VM Stopped (Lifecycle Event)
Apr 12 13:11:26 user nova-compute[71321]: DEBUG nova.compute.manager [None req-f3e64349-3816-4bcb-afd0-b96115884ea4 None None] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 13:11:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:11:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:11:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:11:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:11:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:11:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:11:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:11:36 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:11:41 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:11:43 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:11:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:11:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:11:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:11:43 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 13:11:43 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 13:11:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:11:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:11:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:11:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:11:44 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:11:44 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:11:44 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8765MB free_disk=26.134071350097656GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 13:11:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:11:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:11:44 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:11:44 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 38198e86-bd23-4196-98a0-79455206305f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:11:44 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 13:11:44 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 13:11:44 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 13:11:44 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 13:11:44 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 13:11:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:11:46 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:11:47 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:11:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:11:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:11:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:11:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:11:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:11:51 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:11:52 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:11:52 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 13:11:53 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:11:56 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:11:56 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:11:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 13:11:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-38198e86-bd23-4196-98a0-79455206305f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 13:11:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-38198e86-bd23-4196-98a0-79455206305f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 13:11:56 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 13:11:56 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:11:56 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] Updating instance_info_cache with network_info: [{"id": "5621687b-5d0b-47f7-b11c-a24c403a590a", "address": "fa:16:3e:0e:91:7d", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621687b-5d", "ovs_interfaceid": "5621687b-5d0b-47f7-b11c-a24c403a590a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:11:56 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-38198e86-bd23-4196-98a0-79455206305f" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 13:11:56 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 13:11:56 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:11:58 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:11:59 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:12:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "38198e86-bd23-4196-98a0-79455206305f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:12:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "38198e86-bd23-4196-98a0-79455206305f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:12:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "38198e86-bd23-4196-98a0-79455206305f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:12:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "38198e86-bd23-4196-98a0-79455206305f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:12:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "38198e86-bd23-4196-98a0-79455206305f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:12:01 user nova-compute[71321]: INFO nova.compute.manager [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Terminating instance
Apr 12 13:12:01 user nova-compute[71321]: DEBUG nova.compute.manager [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 13:12:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:12:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:12:01 user nova-compute[71321]: DEBUG nova.compute.manager [req-21944684-46f8-4c38-86ac-7131390ddbd6 req-a3503189-b2d8-4ed1-ae06-a220bc4cdb37 service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] Received event network-vif-unplugged-5621687b-5d0b-47f7-b11c-a24c403a590a {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:12:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-21944684-46f8-4c38-86ac-7131390ddbd6 req-a3503189-b2d8-4ed1-ae06-a220bc4cdb37 service nova] Acquiring lock "38198e86-bd23-4196-98a0-79455206305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:12:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-21944684-46f8-4c38-86ac-7131390ddbd6 req-a3503189-b2d8-4ed1-ae06-a220bc4cdb37 service nova] Lock "38198e86-bd23-4196-98a0-79455206305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:12:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-21944684-46f8-4c38-86ac-7131390ddbd6 req-a3503189-b2d8-4ed1-ae06-a220bc4cdb37 service nova] Lock "38198e86-bd23-4196-98a0-79455206305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:12:01 user nova-compute[71321]: DEBUG nova.compute.manager [req-21944684-46f8-4c38-86ac-7131390ddbd6 req-a3503189-b2d8-4ed1-ae06-a220bc4cdb37 service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] No waiting events found dispatching network-vif-unplugged-5621687b-5d0b-47f7-b11c-a24c403a590a {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:12:01 user nova-compute[71321]: DEBUG nova.compute.manager [req-21944684-46f8-4c38-86ac-7131390ddbd6 req-a3503189-b2d8-4ed1-ae06-a220bc4cdb37 service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] Received event network-vif-unplugged-5621687b-5d0b-47f7-b11c-a24c403a590a for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 13:12:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:12:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:12:01 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:12:02 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 38198e86-bd23-4196-98a0-79455206305f] Instance destroyed successfully.
Apr 12 13:12:02 user nova-compute[71321]: DEBUG nova.objects.instance [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lazy-loading 'resources' on Instance uuid 38198e86-bd23-4196-98a0-79455206305f {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:56:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1998019959',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1998019959',id=40,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:58:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f20ad21427a04683b9b102d2ff0290a5',ramdisk_id='',reservation_id='r-dgt4i0o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-636247513',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T13:00:03Z,user_data=None,user_id='435e0d6fd2b3437f837e82730b4d955f',uuid=38198e86-bd23-4196-98a0-79455206305f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5621687b-5d0b-47f7-b11c-a24c403a590a", "address": "fa:16:3e:0e:91:7d", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621687b-5d", "ovs_interfaceid": "5621687b-5d0b-47f7-b11c-a24c403a590a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Converting VIF {"id": "5621687b-5d0b-47f7-b11c-a24c403a590a", "address": "fa:16:3e:0e:91:7d", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621687b-5d", "ovs_interfaceid": "5621687b-5d0b-47f7-b11c-a24c403a590a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:91:7d,bridge_name='br-int',has_traffic_filtering=True,id=5621687b-5d0b-47f7-b11c-a24c403a590a,network=Network(bb52f82e-56ca-41f7-b171-a3cacb549ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5621687b-5d') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG os_vif [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:91:7d,bridge_name='br-int',has_traffic_filtering=True,id=5621687b-5d0b-47f7-b11c-a24c403a590a,network=Network(bb52f82e-56ca-41f7-b171-a3cacb549ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5621687b-5d') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5621687b-5d, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:12:02 user nova-compute[71321]: INFO os_vif [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:91:7d,bridge_name='br-int',has_traffic_filtering=True,id=5621687b-5d0b-47f7-b11c-a24c403a590a,network=Network(bb52f82e-56ca-41f7-b171-a3cacb549ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5621687b-5d')
Apr 12 13:12:02 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] calling os-brick to detach iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fef641d9f30>, {'target_iqn': 'iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VtOdZwTM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 13:12:02 user nova-compute[71321]: WARNING os_brick.initiator.connectors.base [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 13:12:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9584d81-142c-4b5d-bf4e-d6d4a85bd218]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 13:12:02 user nova-compute[71321]: No targets found.
Apr 12 13:12:02 user nova-compute[71321]: iSNS:
Apr 12 13:12:02 user nova-compute[71321]: No targets found.
Apr 12 13:12:02 user nova-compute[71321]: STATIC:
Apr 12 13:12:02 user nova-compute[71321]: Target: iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2
Apr 12 13:12:02 user nova-compute[71321]:         Portal: 172.16.0.220:3260,-1
Apr 12 13:12:02 user nova-compute[71321]:                 Iface Name: default
Apr 12 13:12:02 user nova-compute[71321]: FIRMWARE:
Apr 12 13:12:02 user nova-compute[71321]: No targets found.
Apr 12 13:12:02 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 13:12:02 user nova-compute[71321]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 13:12:02 user nova-compute[71321]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71321) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2', 0)] {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[634c5c54-54e6-4603-b723-3aa4cfff6a62]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d95bb3f-896a-441e-8fe9-593b8731b891]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 13:12:02 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 (non-flash)
Apr 12 13:12:02 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fef442b4700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2'): ({'sdb'}, set())}) {{(pid=71321) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Removing single pathed devices sdb {{(pid=71321) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[44dc7991-3216-4a98-a5d7-0dbe2a2facc7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[c492d75b-73fa-4b96-8fa8-02bff93b86e0]: (4, ('ok\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Flushing IO for device /dev/sdb {{(pid=71321) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[9879701e-7e39-4924-9265-2dcbfeab2335]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71321) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[791fa896-d35c-45e0-aa82-217d5b14de8c]: (4, ('1', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG os_brick.initiator.linuxscsi [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] SCSI volumes sdb have been removed. {{(pid=71321) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2')] {{(pid=71321) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d5cda9-bb5c-4412-bdd7-1b71a08e2ad8]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 -p 172.16.0.220:3260 --logout {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b95a14-902d-41fe-abf9-b699991cc736]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2, portal: 172.16.0.220,3260]
Apr 12 13:12:02 user nova-compute[71321]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2, portal: 172.16.0.220,3260] successful.
Apr 12 13:12:02 user nova-compute[71321]:  stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 -p 172.16.0.220:3260 --op delete {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:667b3302-208b-42d6-8f06-0baa6b9482b2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81736) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG oslo.privsep.daemon [-] privsep: reply[96360461-e5b2-4ab4-8a38-5d76fba031af]: (4, ('', '')) {{(pid=81736) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71321) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.base [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] <== disconnect_volume: return (295ms) None {{(pid=71321) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Disconnected iSCSI Volume {{(pid=71321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 13:12:02 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Deleting instance files /opt/stack/data/nova/instances/38198e86-bd23-4196-98a0-79455206305f_del
Apr 12 13:12:02 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Deletion of /opt/stack/data/nova/instances/38198e86-bd23-4196-98a0-79455206305f_del complete
Apr 12 13:12:02 user nova-compute[71321]: INFO nova.compute.manager [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Took 1.16 seconds to destroy the instance on the hypervisor.
Apr 12 13:12:02 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: 38198e86-bd23-4196-98a0-79455206305f] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 38198e86-bd23-4196-98a0-79455206305f] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 13:12:02 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 38198e86-bd23-4196-98a0-79455206305f] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:12:03 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 38198e86-bd23-4196-98a0-79455206305f] Took 0.51 seconds to deallocate network for instance.
Apr 12 13:12:03 user nova-compute[71321]: DEBUG nova.compute.manager [req-adaa9e18-8276-4b51-85f1-15ea03e82880 req-dc9b2635-37b7-4e4b-90d5-5029a800504e service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] Received event network-vif-plugged-5621687b-5d0b-47f7-b11c-a24c403a590a {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:12:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-adaa9e18-8276-4b51-85f1-15ea03e82880 req-dc9b2635-37b7-4e4b-90d5-5029a800504e service nova] Acquiring lock "38198e86-bd23-4196-98a0-79455206305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:12:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-adaa9e18-8276-4b51-85f1-15ea03e82880 req-dc9b2635-37b7-4e4b-90d5-5029a800504e service nova] Lock "38198e86-bd23-4196-98a0-79455206305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:12:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-adaa9e18-8276-4b51-85f1-15ea03e82880 req-dc9b2635-37b7-4e4b-90d5-5029a800504e service nova] Lock "38198e86-bd23-4196-98a0-79455206305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:12:03 user nova-compute[71321]: DEBUG nova.compute.manager [req-adaa9e18-8276-4b51-85f1-15ea03e82880 req-dc9b2635-37b7-4e4b-90d5-5029a800504e service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] No waiting events found dispatching network-vif-plugged-5621687b-5d0b-47f7-b11c-a24c403a590a {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:12:03 user nova-compute[71321]: WARNING nova.compute.manager [req-adaa9e18-8276-4b51-85f1-15ea03e82880 req-dc9b2635-37b7-4e4b-90d5-5029a800504e service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] Received unexpected event network-vif-plugged-5621687b-5d0b-47f7-b11c-a24c403a590a for instance with vm_state active and task_state deleting.
Apr 12 13:12:03 user nova-compute[71321]: DEBUG nova.compute.manager [req-adaa9e18-8276-4b51-85f1-15ea03e82880 req-dc9b2635-37b7-4e4b-90d5-5029a800504e service nova] [instance: 38198e86-bd23-4196-98a0-79455206305f] Received event network-vif-deleted-5621687b-5d0b-47f7-b11c-a24c403a590a {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:12:03 user nova-compute[71321]: INFO nova.compute.manager [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Took 0.75 seconds to detach 1 volumes for instance.
Apr 12 13:12:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:12:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:12:03 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 13:12:03 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 13:12:03 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.131s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:12:03 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Deleted allocations for instance 38198e86-bd23-4196-98a0-79455206305f
Apr 12 13:12:04 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "38198e86-bd23-4196-98a0-79455206305f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.721s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:12:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:12:12 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:12:17 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681305122.0821316, 38198e86-bd23-4196-98a0-79455206305f => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 13:12:17 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 38198e86-bd23-4196-98a0-79455206305f] VM Stopped (Lifecycle Event)
Apr 12 13:12:17 user nova-compute[71321]: DEBUG nova.compute.manager [None req-a493d2cb-de60-43ba-8980-45eb62ab329c None None] [instance: 38198e86-bd23-4196-98a0-79455206305f] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 13:12:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:12:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:12:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:12:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:12:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:12:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:12:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:12:27 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:12:32 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:12:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:12:42 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:12:43 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:12:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:12:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:12:43 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:12:43 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 13:12:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:12:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:12:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:12:43 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:12:44 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:12:44 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:12:44 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8774MB free_disk=26.13327407836914GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 13:12:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:12:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:12:44 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:12:44 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 13:12:44 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 13:12:44 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 13:12:44 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 13:12:44 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 13:12:44 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:12:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:12:47 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:12:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-eeafc2b6-5e82-4548-9b02-6a6aaab6c10b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:12:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-eeafc2b6-5e82-4548-9b02-6a6aaab6c10b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:12:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-eeafc2b6-5e82-4548-9b02-6a6aaab6c10b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "e0752f9c-73b1-4cb8-82a9-ca6ce9141a26-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:12:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-eeafc2b6-5e82-4548-9b02-6a6aaab6c10b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "e0752f9c-73b1-4cb8-82a9-ca6ce9141a26-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:12:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-eeafc2b6-5e82-4548-9b02-6a6aaab6c10b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "e0752f9c-73b1-4cb8-82a9-ca6ce9141a26-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:12:52 user nova-compute[71321]: INFO nova.compute.manager [None req-eeafc2b6-5e82-4548-9b02-6a6aaab6c10b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Terminating instance
Apr 12 13:12:52 user nova-compute[71321]: DEBUG nova.compute.manager [None req-eeafc2b6-5e82-4548-9b02-6a6aaab6c10b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 13:12:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:12:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:12:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:12:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:12:52 user nova-compute[71321]: DEBUG nova.compute.manager [req-08e366b7-1f84-4ea5-8ce5-2e2f0b9a0ab7 req-38c84cf8-b8a0-45d2-89f2-7f2bd56e5bdc service nova] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Received event network-vif-unplugged-9f228391-1910-4bd3-b317-f1afa3e98a0f {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:12:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-08e366b7-1f84-4ea5-8ce5-2e2f0b9a0ab7 req-38c84cf8-b8a0-45d2-89f2-7f2bd56e5bdc service nova] Acquiring lock "e0752f9c-73b1-4cb8-82a9-ca6ce9141a26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:12:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-08e366b7-1f84-4ea5-8ce5-2e2f0b9a0ab7 req-38c84cf8-b8a0-45d2-89f2-7f2bd56e5bdc service nova] Lock "e0752f9c-73b1-4cb8-82a9-ca6ce9141a26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:12:52 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-08e366b7-1f84-4ea5-8ce5-2e2f0b9a0ab7 req-38c84cf8-b8a0-45d2-89f2-7f2bd56e5bdc service nova] Lock "e0752f9c-73b1-4cb8-82a9-ca6ce9141a26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:12:52 user nova-compute[71321]: DEBUG nova.compute.manager [req-08e366b7-1f84-4ea5-8ce5-2e2f0b9a0ab7 req-38c84cf8-b8a0-45d2-89f2-7f2bd56e5bdc service nova] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] No waiting events found dispatching network-vif-unplugged-9f228391-1910-4bd3-b317-f1afa3e98a0f {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:12:52 user nova-compute[71321]: DEBUG nova.compute.manager [req-08e366b7-1f84-4ea5-8ce5-2e2f0b9a0ab7 req-38c84cf8-b8a0-45d2-89f2-7f2bd56e5bdc service nova] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Received event network-vif-unplugged-9f228391-1910-4bd3-b317-f1afa3e98a0f for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 13:12:52 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:12:52 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 13:12:52 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Instance destroyed successfully.
Apr 12 13:12:52 user nova-compute[71321]: DEBUG nova.objects.instance [None req-eeafc2b6-5e82-4548-9b02-6a6aaab6c10b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lazy-loading 'resources' on Instance uuid e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:12:52 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-eeafc2b6-5e82-4548-9b02-6a6aaab6c10b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T12:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1011361966',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1011361966',id=38,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T12:53:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f20ad21427a04683b9b102d2ff0290a5',ramdisk_id='',reservation_id='r-mqqg1rqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-636247513',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T12:55:15Z,user_data=None,user_id='435e0d6fd2b3437f837e82730b4d955f',uuid=e0752f9c-73b1-4cb8-82a9-ca6ce9141a26,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f228391-1910-4bd3-b317-f1afa3e98a0f", "address": "fa:16:3e:bf:a8:a8", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f228391-19", "ovs_interfaceid": "9f228391-1910-4bd3-b317-f1afa3e98a0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 13:12:52 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-eeafc2b6-5e82-4548-9b02-6a6aaab6c10b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Converting VIF {"id": "9f228391-1910-4bd3-b317-f1afa3e98a0f", "address": "fa:16:3e:bf:a8:a8", "network": {"id": "bb52f82e-56ca-41f7-b171-a3cacb549ef5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1511502341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20ad21427a04683b9b102d2ff0290a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f228391-19", "ovs_interfaceid": "9f228391-1910-4bd3-b317-f1afa3e98a0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 13:12:52 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-eeafc2b6-5e82-4548-9b02-6a6aaab6c10b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:a8:a8,bridge_name='br-int',has_traffic_filtering=True,id=9f228391-1910-4bd3-b317-f1afa3e98a0f,network=Network(bb52f82e-56ca-41f7-b171-a3cacb549ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f228391-19') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 13:12:52 user nova-compute[71321]: DEBUG os_vif [None req-eeafc2b6-5e82-4548-9b02-6a6aaab6c10b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:a8:a8,bridge_name='br-int',has_traffic_filtering=True,id=9f228391-1910-4bd3-b317-f1afa3e98a0f,network=Network(bb52f82e-56ca-41f7-b171-a3cacb549ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f228391-19') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 13:12:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:12:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f228391-19, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 13:12:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:12:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:12:52 user nova-compute[71321]: INFO os_vif [None req-eeafc2b6-5e82-4548-9b02-6a6aaab6c10b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:a8:a8,bridge_name='br-int',has_traffic_filtering=True,id=9f228391-1910-4bd3-b317-f1afa3e98a0f,network=Network(bb52f82e-56ca-41f7-b171-a3cacb549ef5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f228391-19')
Apr 12 13:12:52 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-eeafc2b6-5e82-4548-9b02-6a6aaab6c10b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Deleting instance files /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26_del
Apr 12 13:12:52 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-eeafc2b6-5e82-4548-9b02-6a6aaab6c10b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Deletion of /opt/stack/data/nova/instances/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26_del complete
Apr 12 13:12:52 user nova-compute[71321]: INFO nova.compute.manager [None req-eeafc2b6-5e82-4548-9b02-6a6aaab6c10b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 12 13:12:52 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-eeafc2b6-5e82-4548-9b02-6a6aaab6c10b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 13:12:52 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 13:12:52 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 13:12:53 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:12:53 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Took 0.42 seconds to deallocate network for instance.
Apr 12 13:12:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-eeafc2b6-5e82-4548-9b02-6a6aaab6c10b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:12:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-eeafc2b6-5e82-4548-9b02-6a6aaab6c10b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:12:53 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:12:53 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-eeafc2b6-5e82-4548-9b02-6a6aaab6c10b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 13:12:53 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-eeafc2b6-5e82-4548-9b02-6a6aaab6c10b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 13:12:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-eeafc2b6-5e82-4548-9b02-6a6aaab6c10b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.124s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:12:53 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-eeafc2b6-5e82-4548-9b02-6a6aaab6c10b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Deleted allocations for instance e0752f9c-73b1-4cb8-82a9-ca6ce9141a26
Apr 12 13:12:53 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-eeafc2b6-5e82-4548-9b02-6a6aaab6c10b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.576s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:12:54 user nova-compute[71321]: DEBUG nova.compute.manager [req-60e2c15b-e40e-4039-ab5d-0b5da76fb283 req-49a19552-1ece-4a18-95b0-e9ab8128ca48 service nova] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Received event network-vif-plugged-9f228391-1910-4bd3-b317-f1afa3e98a0f {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:12:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-60e2c15b-e40e-4039-ab5d-0b5da76fb283 req-49a19552-1ece-4a18-95b0-e9ab8128ca48 service nova] Acquiring lock "e0752f9c-73b1-4cb8-82a9-ca6ce9141a26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:12:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-60e2c15b-e40e-4039-ab5d-0b5da76fb283 req-49a19552-1ece-4a18-95b0-e9ab8128ca48 service nova] Lock "e0752f9c-73b1-4cb8-82a9-ca6ce9141a26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:12:54 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-60e2c15b-e40e-4039-ab5d-0b5da76fb283 req-49a19552-1ece-4a18-95b0-e9ab8128ca48 service nova] Lock "e0752f9c-73b1-4cb8-82a9-ca6ce9141a26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:12:54 user nova-compute[71321]: DEBUG nova.compute.manager [req-60e2c15b-e40e-4039-ab5d-0b5da76fb283 req-49a19552-1ece-4a18-95b0-e9ab8128ca48 service nova] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] No waiting events found dispatching network-vif-plugged-9f228391-1910-4bd3-b317-f1afa3e98a0f {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:12:54 user nova-compute[71321]: WARNING nova.compute.manager [req-60e2c15b-e40e-4039-ab5d-0b5da76fb283 req-49a19552-1ece-4a18-95b0-e9ab8128ca48 service nova] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Received unexpected event network-vif-plugged-9f228391-1910-4bd3-b317-f1afa3e98a0f for instance with vm_state deleted and task_state None.
Apr 12 13:12:54 user nova-compute[71321]: DEBUG nova.compute.manager [req-60e2c15b-e40e-4039-ab5d-0b5da76fb283 req-49a19552-1ece-4a18-95b0-e9ab8128ca48 service nova] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Received event network-vif-deleted-9f228391-1910-4bd3-b317-f1afa3e98a0f {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:12:55 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:12:57 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:12:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:12:58 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:12:58 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 13:12:58 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Didn't find any instances for network info cache update. {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 13:12:58 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:12:58 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:13:00 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:13:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:13:07 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681305172.8055232, e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 13:13:07 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] VM Stopped (Lifecycle Event)
Apr 12 13:13:07 user nova-compute[71321]: DEBUG nova.compute.manager [None req-0264e80a-192d-4442-a181-8feeb8315e85 None None] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 13:13:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:13:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:13:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:13:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:13:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:13:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:13:12 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:13:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:13:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:13:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:13:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:13:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:13:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:13:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:13:27 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:13:32 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:13:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:13:42 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:13:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:13:44 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:13:45 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:13:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:13:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:13:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:13:45 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 13:13:45 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:13:45 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:13:45 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8884MB free_disk=26.224044799804688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 13:13:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:13:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:13:45 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 13:13:45 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 13:13:45 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 13:13:45 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 13:13:45 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 13:13:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:13:47 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:13:48 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:13:52 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:13:53 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:13:53 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 13:13:54 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:13:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:13:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:13:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:13:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:13:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:13:57 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:13:58 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:13:58 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 13:13:58 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Rebuilding the list of instances to heal {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 13:13:58 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Didn't find any instances for network info cache update. {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 13:13:58 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:13:59 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:14:00 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:14:02 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:14:02 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:14:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Acquiring lock "1c02ed35-402b-4473-b43d-6353b9ef06ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:14:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "1c02ed35-402b-4473-b43d-6353b9ef06ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:14:05 user nova-compute[71321]: DEBUG nova.compute.manager [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Starting instance... {{(pid=71321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 13:14:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:14:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:14:05 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 13:14:05 user nova-compute[71321]: INFO nova.compute.claims [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Claim successful on node user
Apr 12 13:14:05 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 13:14:05 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 13:14:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.176s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:14:05 user nova-compute[71321]: DEBUG nova.compute.manager [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Start building networks asynchronously for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 13:14:05 user nova-compute[71321]: DEBUG nova.compute.manager [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Allocating IP information in the background. {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 13:14:05 user nova-compute[71321]: DEBUG nova.network.neutron [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] allocate_for_instance() {{(pid=71321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 13:14:05 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 13:14:05 user nova-compute[71321]: DEBUG nova.compute.manager [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Start building block device mappings for instance. {{(pid=71321) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 13:14:05 user nova-compute[71321]: DEBUG nova.policy [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '664243c5d28d42178333c2dadda1f105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40d4c1f298b4586a9b8bc8764605d03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71321) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 13:14:05 user nova-compute[71321]: DEBUG nova.compute.manager [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Start spawning the instance on the hypervisor. {{(pid=71321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 13:14:05 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Creating instance directory {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 13:14:05 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Creating image(s)
Apr 12 13:14:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c02ed35-402b-4473-b43d-6353b9ef06ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:14:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "/opt/stack/data/nova/instances/1c02ed35-402b-4473-b43d-6353b9ef06ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:14:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "/opt/stack/data/nova/instances/1c02ed35-402b-4473-b43d-6353b9ef06ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:14:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:14:05 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.147s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:14:05 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Acquiring lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:14:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:14:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:14:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.137s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:14:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/1c02ed35-402b-4473-b43d-6353b9ef06ba/disk 1073741824 {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:14:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787,backing_fmt=raw /opt/stack/data/nova/instances/1c02ed35-402b-4473-b43d-6353b9ef06ba/disk 1073741824" returned: 0 in 0.053s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:14:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "4d14e90ebd3ddf411ab96dc6086f9deba2622787" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:14:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:14:06 user nova-compute[71321]: DEBUG nova.network.neutron [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Successfully created port: c56cb583-e7bf-463b-a5f5-42b513189d34 {{(pid=71321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 13:14:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d14e90ebd3ddf411ab96dc6086f9deba2622787 --force-share --output=json" returned: 0 in 0.165s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:14:06 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c02ed35-402b-4473-b43d-6353b9ef06ba/disk. size=1073741824 {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 13:14:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c02ed35-402b-4473-b43d-6353b9ef06ba/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:14:06 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c02ed35-402b-4473-b43d-6353b9ef06ba/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:14:06 user nova-compute[71321]: DEBUG nova.virt.disk.api [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Cannot resize image /opt/stack/data/nova/instances/1c02ed35-402b-4473-b43d-6353b9ef06ba/disk to a smaller size. {{(pid=71321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 13:14:06 user nova-compute[71321]: DEBUG nova.objects.instance [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lazy-loading 'migration_context' on Instance uuid 1c02ed35-402b-4473-b43d-6353b9ef06ba {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:14:06 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Created local disks {{(pid=71321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 13:14:06 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Ensure instance console log exists: /opt/stack/data/nova/instances/1c02ed35-402b-4473-b43d-6353b9ef06ba/console.log {{(pid=71321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 13:14:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:14:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:14:06 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG nova.network.neutron [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Successfully updated port: c56cb583-e7bf-463b-a5f5-42b513189d34 {{(pid=71321) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Acquiring lock "refresh_cache-1c02ed35-402b-4473-b43d-6353b9ef06ba" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Acquired lock "refresh_cache-1c02ed35-402b-4473-b43d-6353b9ef06ba" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG nova.network.neutron [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Building network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG nova.compute.manager [req-ead6672d-eceb-42b1-b149-38ced80b3386 req-9ab8868c-d78f-451d-9d00-ec664b874d3c service nova] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Received event network-changed-c56cb583-e7bf-463b-a5f5-42b513189d34 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG nova.compute.manager [req-ead6672d-eceb-42b1-b149-38ced80b3386 req-9ab8868c-d78f-451d-9d00-ec664b874d3c service nova] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Refreshing instance network info cache due to event network-changed-c56cb583-e7bf-463b-a5f5-42b513189d34. {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ead6672d-eceb-42b1-b149-38ced80b3386 req-9ab8868c-d78f-451d-9d00-ec664b874d3c service nova] Acquiring lock "refresh_cache-1c02ed35-402b-4473-b43d-6353b9ef06ba" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG nova.network.neutron [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Instance cache missing network info. {{(pid=71321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG nova.network.neutron [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Updating instance_info_cache with network_info: [{"id": "c56cb583-e7bf-463b-a5f5-42b513189d34", "address": "fa:16:3e:2d:03:b5", "network": {"id": "41ec14a2-1d8a-43b4-b9f5-0c3a5fdbe2e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424862872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b40d4c1f298b4586a9b8bc8764605d03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56cb583-e7", "ovs_interfaceid": "c56cb583-e7bf-463b-a5f5-42b513189d34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Releasing lock "refresh_cache-1c02ed35-402b-4473-b43d-6353b9ef06ba" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG nova.compute.manager [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Instance network_info: |[{"id": "c56cb583-e7bf-463b-a5f5-42b513189d34", "address": "fa:16:3e:2d:03:b5", "network": {"id": "41ec14a2-1d8a-43b4-b9f5-0c3a5fdbe2e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424862872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b40d4c1f298b4586a9b8bc8764605d03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56cb583-e7", "ovs_interfaceid": "c56cb583-e7bf-463b-a5f5-42b513189d34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ead6672d-eceb-42b1-b149-38ced80b3386 req-9ab8868c-d78f-451d-9d00-ec664b874d3c service nova] Acquired lock "refresh_cache-1c02ed35-402b-4473-b43d-6353b9ef06ba" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG nova.network.neutron [req-ead6672d-eceb-42b1-b149-38ced80b3386 req-9ab8868c-d78f-451d-9d00-ec664b874d3c service nova] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Refreshing network info cache for port c56cb583-e7bf-463b-a5f5-42b513189d34 {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Start _get_guest_xml network_info=[{"id": "c56cb583-e7bf-463b-a5f5-42b513189d34", "address": "fa:16:3e:2d:03:b5", "network": {"id": "41ec14a2-1d8a-43b4-b9f5-0c3a5fdbe2e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424862872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b40d4c1f298b4586a9b8bc8764605d03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56cb583-e7", "ovs_interfaceid": "c56cb583-e7bf-463b-a5f5-42b513189d34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '10cdaa6e-1722-4d2a-835d-7b112d771c50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 13:14:07 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:14:07 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:14:07 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T12:25:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T12:24:36Z,direct_url=<?>,disk_format='qcow2',id=10cdaa6e-1722-4d2a-835d-7b112d771c50,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='df919367bacb43bb89689f1b01773445',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T12:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Flavor limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Image limits 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Flavor pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Image pref 0:0:0 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Got 1 possible topologies {{(pid=71321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG nova.virt.hardware [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T13:14:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-43772807',display_name='tempest-VolumesActionsTest-instance-43772807',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-43772807',id=47,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b40d4c1f298b4586a9b8bc8764605d03',ramdisk_id='',reservation_id='r-o3le24vf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-838949396',owner_user_name='tempest-VolumesActionsTest-838949396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T13:14:06Z,user_data=None,user_id='664243c5d28d42178333c2dadda1f105',uuid=1c02ed35-402b-4473-b43d-6353b9ef06ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c56cb583-e7bf-463b-a5f5-42b513189d34", "address": "fa:16:3e:2d:03:b5", "network": {"id": "41ec14a2-1d8a-43b4-b9f5-0c3a5fdbe2e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424862872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b40d4c1f298b4586a9b8bc8764605d03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56cb583-e7", "ovs_interfaceid": "c56cb583-e7bf-463b-a5f5-42b513189d34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Converting VIF {"id": "c56cb583-e7bf-463b-a5f5-42b513189d34", "address": "fa:16:3e:2d:03:b5", "network": {"id": "41ec14a2-1d8a-43b4-b9f5-0c3a5fdbe2e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424862872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b40d4c1f298b4586a9b8bc8764605d03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56cb583-e7", "ovs_interfaceid": "c56cb583-e7bf-463b-a5f5-42b513189d34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:03:b5,bridge_name='br-int',has_traffic_filtering=True,id=c56cb583-e7bf-463b-a5f5-42b513189d34,network=Network(41ec14a2-1d8a-43b4-b9f5-0c3a5fdbe2e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc56cb583-e7') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG nova.objects.instance [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c02ed35-402b-4473-b43d-6353b9ef06ba {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] End _get_guest_xml xml=<domain type="kvm">
Apr 12 13:14:07 user nova-compute[71321]:   <uuid>1c02ed35-402b-4473-b43d-6353b9ef06ba</uuid>
Apr 12 13:14:07 user nova-compute[71321]:   <name>instance-0000002f</name>
Apr 12 13:14:07 user nova-compute[71321]:   <memory>131072</memory>
Apr 12 13:14:07 user nova-compute[71321]:   <vcpu>1</vcpu>
Apr 12 13:14:07 user nova-compute[71321]:   <metadata>
Apr 12 13:14:07 user nova-compute[71321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 13:14:07 user nova-compute[71321]:       <nova:package version="0.0.0"/>
Apr 12 13:14:07 user nova-compute[71321]:       <nova:name>tempest-VolumesActionsTest-instance-43772807</nova:name>
Apr 12 13:14:07 user nova-compute[71321]:       <nova:creationTime>2023-04-12 13:14:07</nova:creationTime>
Apr 12 13:14:07 user nova-compute[71321]:       <nova:flavor name="m1.nano">
Apr 12 13:14:07 user nova-compute[71321]:         <nova:memory>128</nova:memory>
Apr 12 13:14:07 user nova-compute[71321]:         <nova:disk>1</nova:disk>
Apr 12 13:14:07 user nova-compute[71321]:         <nova:swap>0</nova:swap>
Apr 12 13:14:07 user nova-compute[71321]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 13:14:07 user nova-compute[71321]:         <nova:vcpus>1</nova:vcpus>
Apr 12 13:14:07 user nova-compute[71321]:       </nova:flavor>
Apr 12 13:14:07 user nova-compute[71321]:       <nova:owner>
Apr 12 13:14:07 user nova-compute[71321]:         <nova:user uuid="664243c5d28d42178333c2dadda1f105">tempest-VolumesActionsTest-838949396-project-member</nova:user>
Apr 12 13:14:07 user nova-compute[71321]:         <nova:project uuid="b40d4c1f298b4586a9b8bc8764605d03">tempest-VolumesActionsTest-838949396</nova:project>
Apr 12 13:14:07 user nova-compute[71321]:       </nova:owner>
Apr 12 13:14:07 user nova-compute[71321]:       <nova:root type="image" uuid="10cdaa6e-1722-4d2a-835d-7b112d771c50"/>
Apr 12 13:14:07 user nova-compute[71321]:       <nova:ports>
Apr 12 13:14:07 user nova-compute[71321]:         <nova:port uuid="c56cb583-e7bf-463b-a5f5-42b513189d34">
Apr 12 13:14:07 user nova-compute[71321]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 13:14:07 user nova-compute[71321]:         </nova:port>
Apr 12 13:14:07 user nova-compute[71321]:       </nova:ports>
Apr 12 13:14:07 user nova-compute[71321]:     </nova:instance>
Apr 12 13:14:07 user nova-compute[71321]:   </metadata>
Apr 12 13:14:07 user nova-compute[71321]:   <sysinfo type="smbios">
Apr 12 13:14:07 user nova-compute[71321]:     <system>
Apr 12 13:14:07 user nova-compute[71321]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 13:14:07 user nova-compute[71321]:       <entry name="product">OpenStack Nova</entry>
Apr 12 13:14:07 user nova-compute[71321]:       <entry name="version">0.0.0</entry>
Apr 12 13:14:07 user nova-compute[71321]:       <entry name="serial">1c02ed35-402b-4473-b43d-6353b9ef06ba</entry>
Apr 12 13:14:07 user nova-compute[71321]:       <entry name="uuid">1c02ed35-402b-4473-b43d-6353b9ef06ba</entry>
Apr 12 13:14:07 user nova-compute[71321]:       <entry name="family">Virtual Machine</entry>
Apr 12 13:14:07 user nova-compute[71321]:     </system>
Apr 12 13:14:07 user nova-compute[71321]:   </sysinfo>
Apr 12 13:14:07 user nova-compute[71321]:   <os>
Apr 12 13:14:07 user nova-compute[71321]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 13:14:07 user nova-compute[71321]:     <boot dev="hd"/>
Apr 12 13:14:07 user nova-compute[71321]:     <smbios mode="sysinfo"/>
Apr 12 13:14:07 user nova-compute[71321]:   </os>
Apr 12 13:14:07 user nova-compute[71321]:   <features>
Apr 12 13:14:07 user nova-compute[71321]:     <acpi/>
Apr 12 13:14:07 user nova-compute[71321]:     <apic/>
Apr 12 13:14:07 user nova-compute[71321]:     <vmcoreinfo/>
Apr 12 13:14:07 user nova-compute[71321]:   </features>
Apr 12 13:14:07 user nova-compute[71321]:   <clock offset="utc">
Apr 12 13:14:07 user nova-compute[71321]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 13:14:07 user nova-compute[71321]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 13:14:07 user nova-compute[71321]:     <timer name="hpet" present="no"/>
Apr 12 13:14:07 user nova-compute[71321]:   </clock>
Apr 12 13:14:07 user nova-compute[71321]:   <cpu mode="custom" match="exact">
Apr 12 13:14:07 user nova-compute[71321]:     <model>Nehalem</model>
Apr 12 13:14:07 user nova-compute[71321]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 13:14:07 user nova-compute[71321]:   </cpu>
Apr 12 13:14:07 user nova-compute[71321]:   <devices>
Apr 12 13:14:07 user nova-compute[71321]:     <disk type="file" device="disk">
Apr 12 13:14:07 user nova-compute[71321]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 13:14:07 user nova-compute[71321]:       <source file="/opt/stack/data/nova/instances/1c02ed35-402b-4473-b43d-6353b9ef06ba/disk"/>
Apr 12 13:14:07 user nova-compute[71321]:       <target dev="vda" bus="virtio"/>
Apr 12 13:14:07 user nova-compute[71321]:     </disk>
Apr 12 13:14:07 user nova-compute[71321]:     <interface type="ethernet">
Apr 12 13:14:07 user nova-compute[71321]:       <mac address="fa:16:3e:2d:03:b5"/>
Apr 12 13:14:07 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 13:14:07 user nova-compute[71321]:       <mtu size="1442"/>
Apr 12 13:14:07 user nova-compute[71321]:       <target dev="tapc56cb583-e7"/>
Apr 12 13:14:07 user nova-compute[71321]:     </interface>
Apr 12 13:14:07 user nova-compute[71321]:     <serial type="pty">
Apr 12 13:14:07 user nova-compute[71321]:       <log file="/opt/stack/data/nova/instances/1c02ed35-402b-4473-b43d-6353b9ef06ba/console.log" append="off"/>
Apr 12 13:14:07 user nova-compute[71321]:     </serial>
Apr 12 13:14:07 user nova-compute[71321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 13:14:07 user nova-compute[71321]:     <video>
Apr 12 13:14:07 user nova-compute[71321]:       <model type="virtio"/>
Apr 12 13:14:07 user nova-compute[71321]:     </video>
Apr 12 13:14:07 user nova-compute[71321]:     <rng model="virtio">
Apr 12 13:14:07 user nova-compute[71321]:       <backend model="random">/dev/urandom</backend>
Apr 12 13:14:07 user nova-compute[71321]:     </rng>
Apr 12 13:14:07 user nova-compute[71321]:     <controller type="usb" index="0" model="none"/>
Apr 12 13:14:07 user nova-compute[71321]:     <memballoon model="virtio">
Apr 12 13:14:07 user nova-compute[71321]:       <stats period="10"/>
Apr 12 13:14:07 user nova-compute[71321]:     </memballoon>
Apr 12 13:14:07 user nova-compute[71321]:   </devices>
Apr 12 13:14:07 user nova-compute[71321]: </domain>
Apr 12 13:14:07 user nova-compute[71321]:  {{(pid=71321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T13:14:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-43772807',display_name='tempest-VolumesActionsTest-instance-43772807',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-43772807',id=47,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b40d4c1f298b4586a9b8bc8764605d03',ramdisk_id='',reservation_id='r-o3le24vf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-838949396',owner_user_name='tempest-VolumesActionsTest-838949396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T13:14:06Z,user_data=None,user_id='664243c5d28d42178333c2dadda1f105',uuid=1c02ed35-402b-4473-b43d-6353b9ef06ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c56cb583-e7bf-463b-a5f5-42b513189d34", "address": "fa:16:3e:2d:03:b5", "network": {"id": "41ec14a2-1d8a-43b4-b9f5-0c3a5fdbe2e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424862872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b40d4c1f298b4586a9b8bc8764605d03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56cb583-e7", "ovs_interfaceid": "c56cb583-e7bf-463b-a5f5-42b513189d34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Converting VIF {"id": "c56cb583-e7bf-463b-a5f5-42b513189d34", "address": "fa:16:3e:2d:03:b5", "network": {"id": "41ec14a2-1d8a-43b4-b9f5-0c3a5fdbe2e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424862872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b40d4c1f298b4586a9b8bc8764605d03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56cb583-e7", "ovs_interfaceid": "c56cb583-e7bf-463b-a5f5-42b513189d34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:03:b5,bridge_name='br-int',has_traffic_filtering=True,id=c56cb583-e7bf-463b-a5f5-42b513189d34,network=Network(41ec14a2-1d8a-43b4-b9f5-0c3a5fdbe2e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc56cb583-e7') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG os_vif [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:03:b5,bridge_name='br-int',has_traffic_filtering=True,id=c56cb583-e7bf-463b-a5f5-42b513189d34,network=Network(41ec14a2-1d8a-43b4-b9f5-0c3a5fdbe2e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc56cb583-e7') {{(pid=71321) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc56cb583-e7, may_exist=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc56cb583-e7, col_values=(('external_ids', {'iface-id': 'c56cb583-e7bf-463b-a5f5-42b513189d34', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:03:b5', 'vm-uuid': '1c02ed35-402b-4473-b43d-6353b9ef06ba'}),)) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:14:07 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:14:07 user nova-compute[71321]: INFO os_vif [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:03:b5,bridge_name='br-int',has_traffic_filtering=True,id=c56cb583-e7bf-463b-a5f5-42b513189d34,network=Network(41ec14a2-1d8a-43b4-b9f5-0c3a5fdbe2e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc56cb583-e7')
Apr 12 13:14:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] No BDM found with device name vda, not building metadata. {{(pid=71321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 13:14:08 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] No VIF found with MAC fa:16:3e:2d:03:b5, not building metadata {{(pid=71321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 13:14:08 user nova-compute[71321]: DEBUG nova.network.neutron [req-ead6672d-eceb-42b1-b149-38ced80b3386 req-9ab8868c-d78f-451d-9d00-ec664b874d3c service nova] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Updated VIF entry in instance network info cache for port c56cb583-e7bf-463b-a5f5-42b513189d34. {{(pid=71321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 13:14:08 user nova-compute[71321]: DEBUG nova.network.neutron [req-ead6672d-eceb-42b1-b149-38ced80b3386 req-9ab8868c-d78f-451d-9d00-ec664b874d3c service nova] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Updating instance_info_cache with network_info: [{"id": "c56cb583-e7bf-463b-a5f5-42b513189d34", "address": "fa:16:3e:2d:03:b5", "network": {"id": "41ec14a2-1d8a-43b4-b9f5-0c3a5fdbe2e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424862872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b40d4c1f298b4586a9b8bc8764605d03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56cb583-e7", "ovs_interfaceid": "c56cb583-e7bf-463b-a5f5-42b513189d34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:14:08 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-ead6672d-eceb-42b1-b149-38ced80b3386 req-9ab8868c-d78f-451d-9d00-ec664b874d3c service nova] Releasing lock "refresh_cache-1c02ed35-402b-4473-b43d-6353b9ef06ba" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 13:14:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:14:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:14:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:14:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:14:09 user nova-compute[71321]: DEBUG nova.compute.manager [req-7c1dfd38-c7a2-4d18-b50c-b875a0c119bd req-c6538682-21b8-4fa3-9621-71fa5b9ff6d8 service nova] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Received event network-vif-plugged-c56cb583-e7bf-463b-a5f5-42b513189d34 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:14:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7c1dfd38-c7a2-4d18-b50c-b875a0c119bd req-c6538682-21b8-4fa3-9621-71fa5b9ff6d8 service nova] Acquiring lock "1c02ed35-402b-4473-b43d-6353b9ef06ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:14:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7c1dfd38-c7a2-4d18-b50c-b875a0c119bd req-c6538682-21b8-4fa3-9621-71fa5b9ff6d8 service nova] Lock "1c02ed35-402b-4473-b43d-6353b9ef06ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:14:09 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-7c1dfd38-c7a2-4d18-b50c-b875a0c119bd req-c6538682-21b8-4fa3-9621-71fa5b9ff6d8 service nova] Lock "1c02ed35-402b-4473-b43d-6353b9ef06ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:14:09 user nova-compute[71321]: DEBUG nova.compute.manager [req-7c1dfd38-c7a2-4d18-b50c-b875a0c119bd req-c6538682-21b8-4fa3-9621-71fa5b9ff6d8 service nova] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] No waiting events found dispatching network-vif-plugged-c56cb583-e7bf-463b-a5f5-42b513189d34 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:14:09 user nova-compute[71321]: WARNING nova.compute.manager [req-7c1dfd38-c7a2-4d18-b50c-b875a0c119bd req-c6538682-21b8-4fa3-9621-71fa5b9ff6d8 service nova] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Received unexpected event network-vif-plugged-c56cb583-e7bf-463b-a5f5-42b513189d34 for instance with vm_state building and task_state spawning.
Apr 12 13:14:11 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:14:11 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681305251.4440162, 1c02ed35-402b-4473-b43d-6353b9ef06ba => Resumed> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 13:14:11 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] VM Resumed (Lifecycle Event)
Apr 12 13:14:11 user nova-compute[71321]: DEBUG nova.compute.manager [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Instance event wait completed in 0 seconds for  {{(pid=71321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 13:14:11 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Guest created on hypervisor {{(pid=71321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 13:14:11 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Instance spawned successfully.
Apr 12 13:14:11 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 13:14:11 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 13:14:11 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 13:14:11 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Found default for hw_cdrom_bus of ide {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 13:14:11 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Found default for hw_disk_bus of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 13:14:11 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Found default for hw_input_bus of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 13:14:11 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Found default for hw_pointer_model of None {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 13:14:11 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Found default for hw_video_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 13:14:11 user nova-compute[71321]: DEBUG nova.virt.libvirt.driver [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Found default for hw_vif_model of virtio {{(pid=71321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 13:14:11 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 13:14:11 user nova-compute[71321]: DEBUG nova.virt.driver [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] Emitting event <LifecycleEvent: 1681305251.4477983, 1c02ed35-402b-4473-b43d-6353b9ef06ba => Started> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 13:14:11 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] VM Started (Lifecycle Event)
Apr 12 13:14:11 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 13:14:11 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 13:14:11 user nova-compute[71321]: INFO nova.compute.manager [None req-b9a2eb42-30ff-4d8d-90a7-c1ea0ae60d3b None None] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 13:14:11 user nova-compute[71321]: INFO nova.compute.manager [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Took 5.71 seconds to spawn the instance on the hypervisor.
Apr 12 13:14:11 user nova-compute[71321]: DEBUG nova.compute.manager [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 13:14:11 user nova-compute[71321]: INFO nova.compute.manager [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Took 6.23 seconds to build instance.
Apr 12 13:14:11 user nova-compute[71321]: DEBUG nova.compute.manager [req-acb72747-a1b7-43dc-b002-c93f3584da5f req-17e6e58a-b71c-44a3-bed2-fc144d8a0f1f service nova] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Received event network-vif-plugged-c56cb583-e7bf-463b-a5f5-42b513189d34 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:14:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-acb72747-a1b7-43dc-b002-c93f3584da5f req-17e6e58a-b71c-44a3-bed2-fc144d8a0f1f service nova] Acquiring lock "1c02ed35-402b-4473-b43d-6353b9ef06ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:14:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-acb72747-a1b7-43dc-b002-c93f3584da5f req-17e6e58a-b71c-44a3-bed2-fc144d8a0f1f service nova] Lock "1c02ed35-402b-4473-b43d-6353b9ef06ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:14:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-acb72747-a1b7-43dc-b002-c93f3584da5f req-17e6e58a-b71c-44a3-bed2-fc144d8a0f1f service nova] Lock "1c02ed35-402b-4473-b43d-6353b9ef06ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:14:11 user nova-compute[71321]: DEBUG nova.compute.manager [req-acb72747-a1b7-43dc-b002-c93f3584da5f req-17e6e58a-b71c-44a3-bed2-fc144d8a0f1f service nova] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] No waiting events found dispatching network-vif-plugged-c56cb583-e7bf-463b-a5f5-42b513189d34 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:14:11 user nova-compute[71321]: WARNING nova.compute.manager [req-acb72747-a1b7-43dc-b002-c93f3584da5f req-17e6e58a-b71c-44a3-bed2-fc144d8a0f1f service nova] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Received unexpected event network-vif-plugged-c56cb583-e7bf-463b-a5f5-42b513189d34 for instance with vm_state building and task_state spawning.
Apr 12 13:14:11 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "1c02ed35-402b-4473-b43d-6353b9ef06ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.321s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:14:12 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:14:17 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:14:22 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:14:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:14:27 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:14:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:14:32 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:14:37 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:14:41 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:14:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:14:43 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:14:43 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71321) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 13:14:45 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:14:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:14:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:14:45 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:14:45 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 13:14:45 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c02ed35-402b-4473-b43d-6353b9ef06ba/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:14:45 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c02ed35-402b-4473-b43d-6353b9ef06ba/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:14:45 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c02ed35-402b-4473-b43d-6353b9ef06ba/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:14:45 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c02ed35-402b-4473-b43d-6353b9ef06ba/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:14:46 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:14:46 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:14:46 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8748MB free_disk=26.203041076660156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 13:14:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:14:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:14:46 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 1c02ed35-402b-4473-b43d-6353b9ef06ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:14:46 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 13:14:46 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 13:14:46 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 13:14:46 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 13:14:46 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 13:14:46 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:14:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:14:49 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:14:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:14:53 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:14:53 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 13:14:54 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:14:55 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:14:56 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:14:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:14:59 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:15:00 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:15:00 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 13:15:00 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Rebuilding the list of instances to heal {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 13:15:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "refresh_cache-1c02ed35-402b-4473-b43d-6353b9ef06ba" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 13:15:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquired lock "refresh_cache-1c02ed35-402b-4473-b43d-6353b9ef06ba" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 13:15:00 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Forcefully refreshing network info cache for instance {{(pid=71321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 13:15:00 user nova-compute[71321]: DEBUG nova.objects.instance [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lazy-loading 'info_cache' on Instance uuid 1c02ed35-402b-4473-b43d-6353b9ef06ba {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:15:01 user nova-compute[71321]: DEBUG nova.network.neutron [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Updating instance_info_cache with network_info: [{"id": "c56cb583-e7bf-463b-a5f5-42b513189d34", "address": "fa:16:3e:2d:03:b5", "network": {"id": "41ec14a2-1d8a-43b4-b9f5-0c3a5fdbe2e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424862872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b40d4c1f298b4586a9b8bc8764605d03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56cb583-e7", "ovs_interfaceid": "c56cb583-e7bf-463b-a5f5-42b513189d34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:15:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Releasing lock "refresh_cache-1c02ed35-402b-4473-b43d-6353b9ef06ba" {{(pid=71321) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 13:15:01 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Updated the network info_cache for instance {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 13:15:01 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:15:02 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:15:03 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:15:04 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:15:08 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:15:13 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:15:18 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:15:22 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:15:22 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Cleaning up deleted instances {{(pid=71321) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 13:15:22 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] There are 0 instances to clean {{(pid=71321) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 13:15:23 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:15:26 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:15:27 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:15:27 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Triggering sync for uuid 1c02ed35-402b-4473-b43d-6353b9ef06ba {{(pid=71321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 13:15:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "1c02ed35-402b-4473-b43d-6353b9ef06ba" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:15:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "1c02ed35-402b-4473-b43d-6353b9ef06ba" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:15:27 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "1c02ed35-402b-4473-b43d-6353b9ef06ba" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:15:28 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:15:28 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:15:31 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:15:33 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:15:38 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:15:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:15:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:15:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:15:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:15:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:15:43 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:15:47 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:15:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:15:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:15:47 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:15:47 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 13:15:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c02ed35-402b-4473-b43d-6353b9ef06ba/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:15:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c02ed35-402b-4473-b43d-6353b9ef06ba/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:15:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c02ed35-402b-4473-b43d-6353b9ef06ba/disk --force-share --output=json {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 13:15:47 user nova-compute[71321]: DEBUG oslo_concurrency.processutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c02ed35-402b-4473-b43d-6353b9ef06ba/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71321) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 13:15:48 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:15:48 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:15:48 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:15:48 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8778MB free_disk=26.202465057373047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 13:15:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:15:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:15:48 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Instance 1c02ed35-402b-4473-b43d-6353b9ef06ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 13:15:48 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 13:15:48 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 13:15:48 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Refreshing inventories for resource provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 13:15:48 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Updating ProviderTree inventory for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 13:15:48 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Updating inventory in ProviderTree for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 13:15:48 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Refreshing aggregate associations for resource provider 7ca624fd-d5cc-42af-93e3-9d62256fa231, aggregates: None {{(pid=71321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 13:15:48 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Refreshing trait associations for resource provider 7ca624fd-d5cc-42af-93e3-9d62256fa231, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=71321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 13:15:48 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 13:15:48 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 13:15:48 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 13:15:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.371s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:15:49 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:15:53 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:15:53 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:15:53 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 13:15:54 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:15:58 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:15:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b53a67ce-7b1b-4dfe-ab91-7d39491e3893 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Acquiring lock "1c02ed35-402b-4473-b43d-6353b9ef06ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:15:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b53a67ce-7b1b-4dfe-ab91-7d39491e3893 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "1c02ed35-402b-4473-b43d-6353b9ef06ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:15:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b53a67ce-7b1b-4dfe-ab91-7d39491e3893 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Acquiring lock "1c02ed35-402b-4473-b43d-6353b9ef06ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:15:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b53a67ce-7b1b-4dfe-ab91-7d39491e3893 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "1c02ed35-402b-4473-b43d-6353b9ef06ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:15:59 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b53a67ce-7b1b-4dfe-ab91-7d39491e3893 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "1c02ed35-402b-4473-b43d-6353b9ef06ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:15:59 user nova-compute[71321]: INFO nova.compute.manager [None req-b53a67ce-7b1b-4dfe-ab91-7d39491e3893 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Terminating instance
Apr 12 13:16:00 user nova-compute[71321]: DEBUG nova.compute.manager [None req-b53a67ce-7b1b-4dfe-ab91-7d39491e3893 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Start destroying the instance on the hypervisor. {{(pid=71321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 13:16:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:16:00 user nova-compute[71321]: DEBUG nova.compute.manager [req-8f422cf6-d675-415c-9fb6-a91392e1b655 req-cd8eb7a8-d81d-4ed4-b5d0-f4fdc5f911f9 service nova] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Received event network-vif-unplugged-c56cb583-e7bf-463b-a5f5-42b513189d34 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:16:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-8f422cf6-d675-415c-9fb6-a91392e1b655 req-cd8eb7a8-d81d-4ed4-b5d0-f4fdc5f911f9 service nova] Acquiring lock "1c02ed35-402b-4473-b43d-6353b9ef06ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:16:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-8f422cf6-d675-415c-9fb6-a91392e1b655 req-cd8eb7a8-d81d-4ed4-b5d0-f4fdc5f911f9 service nova] Lock "1c02ed35-402b-4473-b43d-6353b9ef06ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:16:00 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-8f422cf6-d675-415c-9fb6-a91392e1b655 req-cd8eb7a8-d81d-4ed4-b5d0-f4fdc5f911f9 service nova] Lock "1c02ed35-402b-4473-b43d-6353b9ef06ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:16:00 user nova-compute[71321]: DEBUG nova.compute.manager [req-8f422cf6-d675-415c-9fb6-a91392e1b655 req-cd8eb7a8-d81d-4ed4-b5d0-f4fdc5f911f9 service nova] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] No waiting events found dispatching network-vif-unplugged-c56cb583-e7bf-463b-a5f5-42b513189d34 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:16:00 user nova-compute[71321]: DEBUG nova.compute.manager [req-8f422cf6-d675-415c-9fb6-a91392e1b655 req-cd8eb7a8-d81d-4ed4-b5d0-f4fdc5f911f9 service nova] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Received event network-vif-unplugged-c56cb583-e7bf-463b-a5f5-42b513189d34 for instance with task_state deleting. {{(pid=71321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 13:16:00 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:16:00 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:16:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:16:00 user nova-compute[71321]: INFO nova.virt.libvirt.driver [-] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Instance destroyed successfully.
Apr 12 13:16:00 user nova-compute[71321]: DEBUG nova.objects.instance [None req-b53a67ce-7b1b-4dfe-ab91-7d39491e3893 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lazy-loading 'resources' on Instance uuid 1c02ed35-402b-4473-b43d-6353b9ef06ba {{(pid=71321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 13:16:00 user nova-compute[71321]: DEBUG nova.virt.libvirt.vif [None req-b53a67ce-7b1b-4dfe-ab91-7d39491e3893 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T13:14:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-43772807',display_name='tempest-VolumesActionsTest-instance-43772807',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-43772807',id=47,image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T13:14:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b40d4c1f298b4586a9b8bc8764605d03',ramdisk_id='',reservation_id='r-o3le24vf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='10cdaa6e-1722-4d2a-835d-7b112d771c50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-838949396',owner_user_name='tempest-VolumesActionsTest-838949396-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T13:14:12Z,user_data=None,user_id='664243c5d28d42178333c2dadda1f105',uuid=1c02ed35-402b-4473-b43d-6353b9ef06ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c56cb583-e7bf-463b-a5f5-42b513189d34", "address": "fa:16:3e:2d:03:b5", "network": {"id": "41ec14a2-1d8a-43b4-b9f5-0c3a5fdbe2e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424862872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b40d4c1f298b4586a9b8bc8764605d03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56cb583-e7", "ovs_interfaceid": "c56cb583-e7bf-463b-a5f5-42b513189d34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 13:16:00 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-b53a67ce-7b1b-4dfe-ab91-7d39491e3893 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Converting VIF {"id": "c56cb583-e7bf-463b-a5f5-42b513189d34", "address": "fa:16:3e:2d:03:b5", "network": {"id": "41ec14a2-1d8a-43b4-b9f5-0c3a5fdbe2e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424862872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b40d4c1f298b4586a9b8bc8764605d03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56cb583-e7", "ovs_interfaceid": "c56cb583-e7bf-463b-a5f5-42b513189d34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 13:16:00 user nova-compute[71321]: DEBUG nova.network.os_vif_util [None req-b53a67ce-7b1b-4dfe-ab91-7d39491e3893 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:03:b5,bridge_name='br-int',has_traffic_filtering=True,id=c56cb583-e7bf-463b-a5f5-42b513189d34,network=Network(41ec14a2-1d8a-43b4-b9f5-0c3a5fdbe2e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc56cb583-e7') {{(pid=71321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 13:16:00 user nova-compute[71321]: DEBUG os_vif [None req-b53a67ce-7b1b-4dfe-ab91-7d39491e3893 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:03:b5,bridge_name='br-int',has_traffic_filtering=True,id=c56cb583-e7bf-463b-a5f5-42b513189d34,network=Network(41ec14a2-1d8a-43b4-b9f5-0c3a5fdbe2e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc56cb583-e7') {{(pid=71321) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 13:16:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:16:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc56cb583-e7, bridge=br-int, if_exists=True) {{(pid=71321) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 13:16:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:16:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:16:00 user nova-compute[71321]: INFO os_vif [None req-b53a67ce-7b1b-4dfe-ab91-7d39491e3893 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:03:b5,bridge_name='br-int',has_traffic_filtering=True,id=c56cb583-e7bf-463b-a5f5-42b513189d34,network=Network(41ec14a2-1d8a-43b4-b9f5-0c3a5fdbe2e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc56cb583-e7')
Apr 12 13:16:00 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-b53a67ce-7b1b-4dfe-ab91-7d39491e3893 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Deleting instance files /opt/stack/data/nova/instances/1c02ed35-402b-4473-b43d-6353b9ef06ba_del
Apr 12 13:16:00 user nova-compute[71321]: INFO nova.virt.libvirt.driver [None req-b53a67ce-7b1b-4dfe-ab91-7d39491e3893 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Deletion of /opt/stack/data/nova/instances/1c02ed35-402b-4473-b43d-6353b9ef06ba_del complete
Apr 12 13:16:00 user nova-compute[71321]: INFO nova.compute.manager [None req-b53a67ce-7b1b-4dfe-ab91-7d39491e3893 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 12 13:16:00 user nova-compute[71321]: DEBUG oslo.service.loopingcall [None req-b53a67ce-7b1b-4dfe-ab91-7d39491e3893 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71321) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 13:16:00 user nova-compute[71321]: DEBUG nova.compute.manager [-] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Deallocating network for instance {{(pid=71321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 13:16:00 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] deallocate_for_instance() {{(pid=71321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 13:16:01 user nova-compute[71321]: DEBUG nova.network.neutron [-] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Updating instance_info_cache with network_info: [] {{(pid=71321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 13:16:01 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Took 0.57 seconds to deallocate network for instance.
Apr 12 13:16:01 user nova-compute[71321]: DEBUG nova.compute.manager [req-ded87d92-a78a-45b5-b376-28da5d42fcb1 req-14ff3fb4-2b2e-471b-86b4-7aa83fc80ab6 service nova] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Received event network-vif-deleted-c56cb583-e7bf-463b-a5f5-42b513189d34 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:16:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b53a67ce-7b1b-4dfe-ab91-7d39491e3893 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:16:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b53a67ce-7b1b-4dfe-ab91-7d39491e3893 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:16:01 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-b53a67ce-7b1b-4dfe-ab91-7d39491e3893 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 13:16:01 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-b53a67ce-7b1b-4dfe-ab91-7d39491e3893 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 13:16:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b53a67ce-7b1b-4dfe-ab91-7d39491e3893 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:16:01 user nova-compute[71321]: INFO nova.scheduler.client.report [None req-b53a67ce-7b1b-4dfe-ab91-7d39491e3893 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Deleted allocations for instance 1c02ed35-402b-4473-b43d-6353b9ef06ba
Apr 12 13:16:01 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-b53a67ce-7b1b-4dfe-ab91-7d39491e3893 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "1c02ed35-402b-4473-b43d-6353b9ef06ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.728s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:16:02 user nova-compute[71321]: DEBUG nova.compute.manager [req-40cc855e-809b-4525-910b-47b4d5f455fb req-f6c66edf-ef5b-4daa-ac56-ba22fdd7bf31 service nova] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Received event network-vif-plugged-c56cb583-e7bf-463b-a5f5-42b513189d34 {{(pid=71321) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 13:16:02 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-40cc855e-809b-4525-910b-47b4d5f455fb req-f6c66edf-ef5b-4daa-ac56-ba22fdd7bf31 service nova] Acquiring lock "1c02ed35-402b-4473-b43d-6353b9ef06ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:16:02 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-40cc855e-809b-4525-910b-47b4d5f455fb req-f6c66edf-ef5b-4daa-ac56-ba22fdd7bf31 service nova] Lock "1c02ed35-402b-4473-b43d-6353b9ef06ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:16:02 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [req-40cc855e-809b-4525-910b-47b4d5f455fb req-f6c66edf-ef5b-4daa-ac56-ba22fdd7bf31 service nova] Lock "1c02ed35-402b-4473-b43d-6353b9ef06ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:16:02 user nova-compute[71321]: DEBUG nova.compute.manager [req-40cc855e-809b-4525-910b-47b4d5f455fb req-f6c66edf-ef5b-4daa-ac56-ba22fdd7bf31 service nova] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] No waiting events found dispatching network-vif-plugged-c56cb583-e7bf-463b-a5f5-42b513189d34 {{(pid=71321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 13:16:02 user nova-compute[71321]: WARNING nova.compute.manager [req-40cc855e-809b-4525-910b-47b4d5f455fb req-f6c66edf-ef5b-4daa-ac56-ba22fdd7bf31 service nova] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Received unexpected event network-vif-plugged-c56cb583-e7bf-463b-a5f5-42b513189d34 for instance with vm_state deleted and task_state None.
Apr 12 13:16:02 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:16:02 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:16:02 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 13:16:02 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Rebuilding the list of instances to heal {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 13:16:02 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Didn't find any instances for network info cache update. {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 13:16:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:16:06 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:16:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:16:15 user nova-compute[71321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681305360.7378936, 1c02ed35-402b-4473-b43d-6353b9ef06ba => Stopped> {{(pid=71321) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 13:16:15 user nova-compute[71321]: INFO nova.compute.manager [-] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] VM Stopped (Lifecycle Event)
Apr 12 13:16:15 user nova-compute[71321]: DEBUG nova.compute.manager [None req-14b37f9b-3140-4a6b-b174-bef8ca2a0135 None None] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Checking state {{(pid=71321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 13:16:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:16:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:16:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:16:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:16:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:16:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:16:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:16:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:16:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:16:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:16:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:16:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:16:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:16:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:16:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:16:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:16:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:16:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:16:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:16:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:16:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:16:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:16:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:16:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:16:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:16:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:16:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:16:48 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:16:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:16:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:16:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:16:48 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 13:16:48 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:16:48 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:16:48 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8888MB free_disk=26.220062255859375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 13:16:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:16:48 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:16:48 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 13:16:48 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 13:16:48 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 13:16:48 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 13:16:49 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 13:16:49 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:16:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:16:51 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:16:53 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:16:53 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 13:16:54 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:16:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:16:56 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:17:00 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:17:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:17:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:17:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:17:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:17:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:17:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:17:01 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:17:02 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:17:02 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 13:17:02 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Rebuilding the list of instances to heal {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 13:17:02 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Didn't find any instances for network info cache update. {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 13:17:04 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:17:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:17:07 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:17:09 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:17:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:17:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:17:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:17:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:17:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:17:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:17:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:17:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:17:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:17:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:17:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:17:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:17:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:17:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:17:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:17:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:17:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:17:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:17:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:17:25 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:17:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:17:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:17:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:17:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:17:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:17:30 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:17:35 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:17:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:17:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:17:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:17:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:17:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:17:40 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:17:45 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:17:50 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:17:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:17:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:17:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:17:50 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Auditing locally available compute resources for user (node: user) {{(pid=71321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 13:17:50 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:17:50 user nova-compute[71321]: WARNING nova.virt.libvirt.driver [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 13:17:50 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Hypervisor/Node resource view: name=user free_ram=8900MB free_disk=26.209102630615234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 13:17:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 13:17:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 13:17:50 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:17:50 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 13:17:50 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 13:17:50 user nova-compute[71321]: DEBUG nova.compute.provider_tree [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed in ProviderTree for provider: 7ca624fd-d5cc-42af-93e3-9d62256fa231 {{(pid=71321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 13:17:50 user nova-compute[71321]: DEBUG nova.scheduler.client.report [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Inventory has not changed for provider 7ca624fd-d5cc-42af-93e3-9d62256fa231 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 13:17:50 user nova-compute[71321]: DEBUG nova.compute.resource_tracker [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Compute_service record updated for user:user {{(pid=71321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 13:17:50 user nova-compute[71321]: DEBUG oslo_concurrency.lockutils [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.117s {{(pid=71321) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 13:17:51 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:17:54 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:17:54 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 13:17:55 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:17:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:17:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:17:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:17:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:17:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:17:55 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:18:00 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:18:02 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:18:03 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:18:04 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:18:04 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Starting heal instance info cache {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 13:18:04 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Rebuilding the list of instances to heal {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 13:18:04 user nova-compute[71321]: DEBUG nova.compute.manager [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Didn't find any instances for network info cache update. {{(pid=71321) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 13:18:05 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:18:06 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:18:09 user nova-compute[71321]: DEBUG oslo_service.periodic_task [None req-489f9566-eb86-4b40-9bd2-352e424b5259 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71321) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 13:18:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:18:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:18:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:18:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:18:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:18:10 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:18:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 13:18:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:18:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71321) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 13:18:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:18:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71321) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 13:18:15 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 13:18:20 user nova-compute[71321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71321) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}